Jun 29 03:13:34 devstack cinder-volume[82698]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jun 29 03:13:34 devstack cinder-volume[82698]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jun 29 03:13:34 devstack cinder-volume[82698]: we strongly recommend against using it for new projects. Jun 29 03:13:34 devstack cinder-volume[82698]: If you are already using Eventlet, we recommend migrating to a different Jun 29 03:13:34 devstack cinder-volume[82698]: framework. For more detail see Jun 29 03:13:34 devstack cinder-volume[82698]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jun 29 03:13:34 devstack cinder-volume[82698]: import eventlet # noqa Jun 29 03:13:37 devstack cinder-volume[82698]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=82698) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 29 03:13:37 devstack cinder-volume[82698]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=82698) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 29 03:13:37 devstack cinder-volume[82698]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=82698) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 29 03:13:38 devstack cinder-volume[82698]: INFO dbcounter [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] Registered counter for database cinder Jun 29 03:13:38 devstack cinder-volume[82698]: DEBUG oslo_db.sqlalchemy.engines [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82698) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 29 03:13:38 devstack cinder-volume[82698]: DEBUG dbcounter [-] [82698] Writer thread running {{(pid=82698) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 29 03:13:38 devstack cinder-volume[82698]: INFO cinder.rpc [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jun 29 03:13:38 devstack cinder-volume[82698]: INFO cinder.rpc [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jun 29 03:13:38 devstack cinder-volume[82698]: DEBUG oslo_db.sqlalchemy.engines [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82698) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 29 03:13:39 devstack cinder-volume[82698]: INFO cinder.volume.manager [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] Determined volume DB was empty at startup. Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG cinder.volume.manager [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=82698) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jun 29 03:13:39 devstack cinder-volume[82698]: INFO cinder.volume.manager [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] Service not found for updating active_backend_id, assuming default for driver init. Jun 29 03:13:39 devstack cinder-volume[82698]: WARNING stevedore.named [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jun 29 03:13:39 devstack cinder-volume[82698]: WARNING castellan.key_manager [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 29 03:13:39 devstack cinder-volume[82698]: WARNING cinder.keymgr.conf_key_mgr [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG cinder.volume.drivers.lvm [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=82698) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_concurrency.processutils [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=82698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_concurrency.processutils [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] CMD "cinder-rtstool verify" returned: 0 in 0.472s {{(pid=82698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_db.sqlalchemy.engines [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82698) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 29 03:13:39 devstack cinder-volume[82698]: INFO cinder.rpc [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Jun 29 03:13:39 devstack cinder-volume[82698]: INFO cinder.rpc [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Jun 29 03:13:39 devstack cinder-volume[82698]: WARNING stevedore.named [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jun 29 03:13:39 devstack cinder-volume[82698]: WARNING castellan.key_manager [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 29 03:13:39 devstack cinder-volume[82698]: INFO cinder.volume.manager [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_db.sqlalchemy.engines [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82698) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 29 03:13:39 devstack cinder-volume[82698]: INFO oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] Starting 1 workers Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] Started child 82865 {{(pid=82698) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] Full set of CONF: {{(pid=82698) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] ******************************************************************************** {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] Configuration options gathered from: {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] ================================================================================ {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] allow_availability_zone_fallback = False {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] allow_compression_on_image_upload = False {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] allowed_direct_url_schemes = [] {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] api_rate_limit = True {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] auth_strategy = keystone {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] az_cache_duration = 3600 {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] backend_availability_zone = None {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] backend_host = None {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] backend_stats_polling_interval = 60 {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] backup_api_class = cinder.backup.api.API {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] backup_name_template = backup-%s {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] backup_use_same_host = False {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] backup_use_temp_snapshot = False {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] chap_password = **** {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] chap_username = {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] cinder_internal_tenant_project_id = 56ade22bead1432aba8310729674884e {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] cinder_internal_tenant_user_id = 19d2196238ab40308b0a0e03860b214a {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] cloned_volume_same_az = True {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] cluster = None {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] compression_format = gzip {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] compute_api_class = cinder.compute.nova.API {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] config_dir = [] {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] config_source = [] {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] control_exchange = openstack {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] debug = True {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:13:39 devstack cinder-volume[82865]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] default_availability_zone = None {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] default_group_type = None {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] default_volume_type = lvmdriver-1 {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] disk_geometry = None {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] driver_client_cert = None {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] driver_client_cert_key = None {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] driver_data_namespace = None {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] driver_ssl_cert_path = None {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] driver_ssl_cert_verify = False {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] driver_use_ssl = False {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] enable_force_upload = False {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] enable_new_services = True {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] enable_unsupported_driver = False {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] enabled_backends = ['lvmdriver-1'] {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] enforce_multipath_for_image_xfer = False {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] filter_function = None {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] glance_api_insecure = False {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] glance_api_servers = ['http://192.168.122.201/image'] {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] glance_api_ssl_compression = False {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] glance_ca_certificates_file = None {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] glance_catalog_info = image:glance:publicURL {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] glance_certfile = None {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] glance_keyfile = None {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] glance_num_retries = 3 {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] glance_request_timeout = None {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] goodness_function = None {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] graceful_shutdown_timeout = 5 {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] group_api_class = cinder.group.api.API {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] host = devstack {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] image_compress_on_upload = True {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] image_conversion_address_space_limit = 1 {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] image_conversion_cpu_limit = 60 {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] image_conversion_disable = False {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] image_upload_use_cinder_backend = False {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] image_upload_use_internal_tenant = False {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] image_volume_cache_enabled = False {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] image_volume_cache_max_count = 0 {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] image_volume_cache_max_size_gb = 0 {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] init_host_max_objects_retrieval = 0 {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] instance_format = [instance: %(uuid)s] {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] iscsi_target_flags = {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] iscsi_write_cache = on {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] iser_helper = tgtadm {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] iser_ip_address = 192.168.122.201 {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] iser_port = 3260 {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] log_color = False {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] log_config_append = None {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] log_dir = None {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] log_file = None {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] log_options = True {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] log_rotate_interval = 1 {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] log_rotate_interval_type = days {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] log_rotation_type = none {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] max_age = 0 {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] max_logfile_count = 30 {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] max_logfile_size_mb = 200 {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] max_over_subscription_ratio = 20.0 {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] message_reap_interval = 86400 {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] message_ttl = 2592000 {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] migration_create_volume_timeout_secs = 300 {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] monkey_patch = False {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] monkey_patch_modules = [] {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] my_ip = 192.168.122.201 {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] no_snapshot_gb_quota = False {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] num_iser_scan_tries = 3 {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] num_shell_tries = 3 {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] num_volume_device_scan_tries = 3 {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] nvmeof_conn_info_version = 1 {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] nvmet_ns_id = 10 {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] nvmet_port_id = 1 {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] osapi_max_limit = 1000 {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] osapi_volume_ext_list = [] {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:13:39 devstack cinder-volume[82865]: INFO cinder.volume.manager [None req-a99e5f1a-9396-4cdd-82ac-b2c82ab16e9a None None] Starting volume driver LVMVolumeDriver (3.0.0) Jun 29 03:13:39 devstack cinder-volume[82865]: DEBUG oslo_concurrency.processutils [None req-a99e5f1a-9396-4cdd-82ac-b2c82ab16e9a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] osapi_volume_listen = 0.0.0.0 {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] osapi_volume_listen_port = 8776 {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] osapi_volume_use_ssl = False {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] osapi_volume_workers = None {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] per_volume_size_limit = -1 {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] periodic_fuzzy_delay = 60 {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] periodic_interval = 60 {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] project_id_regex = [0-9a-f\-]+ {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] public_endpoint = None {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] publish_errors = False {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] quota_backup_gigabytes = 1000 {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] quota_backups = 10 {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] quota_gigabytes = 1000 {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] quota_groups = 10 {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] quota_snapshots = 10 {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] quota_volumes = 10 {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] rate_limit_burst = 0 {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] rate_limit_except_level = CRITICAL {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] rate_limit_interval = 0 {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] reinit_driver_count = 3 {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] replication_device = **** {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] report_discard_supported = False {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] report_interval = 120 {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] reservation_clean_interval = 86400 {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] reservation_expire = 86400 {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] reserved_image_namespaces = [] {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] reserved_percentage = 0 {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] rpc_response_timeout = 120 {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] run_external_periodic_tasks = True {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] scst_target_driver = iscsi {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] scst_target_iqn_name = None {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] service_down_time = 720 {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] shell_completion = None {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] snapshot_name_template = snapshot-%s {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] snapshot_same_host = True {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] split_loggers = False {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] state_path = /opt/stack/data/cinder {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] storage_availability_zone = nova {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] storage_protocol = iSCSI {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] syslog_log_facility = LOG_USER {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:13:39 devstack cinder-volume[82865]: DEBUG oslo_concurrency.processutils [None req-a99e5f1a-9396-4cdd-82ac-b2c82ab16e9a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.033s {{(pid=82865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:13:39 devstack cinder-volume[82865]: DEBUG oslo_concurrency.processutils [None req-a99e5f1a-9396-4cdd-82ac-b2c82ab16e9a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] target_helper = lioadm {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] target_ip_address = 192.168.122.201 {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] target_port = 3260 {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] target_protocol = iscsi {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] target_secondary_ip_addresses = [] {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] trace_flags = None {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] transfer_api_class = cinder.transfer.api.API {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] transport_url = **** {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] until_refresh = 0 {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] use_chap_auth = False {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] use_default_quota_class = True {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] use_journal = False {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] use_json = False {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] use_multipath_for_image_xfer = False {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] use_stderr = False {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] use_syslog = False {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] verify_glance_signatures = enabled {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] volume_api_class = cinder.volume.api.API {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] volume_backend_name = None {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] volume_clear = zero {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] volume_clear_ionice = None {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] volume_clear_size = 0 {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] volume_copy_bps_limit = 0 {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] volume_dd_blocksize = 1M {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] volume_name_template = volume-%s {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] volume_service_inithost_offload = False {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] volume_usage_audit_period = month {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] zoning_mode = None {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] oslo_concurrency.disable_process_locking = False {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:39 devstack cinder-volume[82865]: DEBUG oslo_concurrency.processutils [None req-a99e5f1a-9396-4cdd-82ac-b2c82ab16e9a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.025s {{(pid=82865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:13:39 devstack cinder-volume[82865]: DEBUG oslo_concurrency.processutils [None req-a99e5f1a-9396-4cdd-82ac-b2c82ab16e9a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] keystone_authtoken.auth_section = None {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] keystone_authtoken.auth_type = password {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] keystone_authtoken.auth_version = None {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] keystone_authtoken.cache = None {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] keystone_authtoken.certfile = None {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] keystone_authtoken.delay_auth_decision = False {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] keystone_authtoken.http_connect_timeout = None {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] keystone_authtoken.include_service_catalog = True {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] keystone_authtoken.insecure = False {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] keystone_authtoken.interface = public {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] keystone_authtoken.keyfile = None {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] keystone_authtoken.memcache_password = {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] keystone_authtoken.memcache_username = {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] keystone_authtoken.region_name = None {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] keystone_authtoken.service_token_roles_required = True {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] keystone_authtoken.service_type = None {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] keystone_authtoken.token_cache_time = 300 {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.201/identity {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] cache.backend = dogpile.cache.null {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] cache.backend_argument = **** {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] cache.backend_expiration_time = None {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] cache.config_prefix = cache.oslo {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] cache.debug_cache_backend = False {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] cache.enable_retry_client = False {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:39 devstack cinder-volume[82865]: DEBUG oslo_concurrency.processutils [None req-a99e5f1a-9396-4cdd-82ac-b2c82ab16e9a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.033s {{(pid=82865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:13:39 devstack cinder-volume[82865]: DEBUG oslo_concurrency.processutils [None req-a99e5f1a-9396-4cdd-82ac-b2c82ab16e9a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=82865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] cache.enable_socket_keepalive = False {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] cache.enabled = False {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] cache.expiration_time = 600 {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] cache.hashclient_retry_attempts = 2 {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] cache.memcache_dead_retry = 300 {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] cache.memcache_pool_maxsize = 10 {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] cache.memcache_sasl_enabled = False {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] cache.password = **** {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] cache.proxies = [] {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] cache.redis_db = 0 {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] cache.redis_sentinel_service_name = mymaster {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] cache.redis_server = localhost:6379 {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] cache.retry_attempts = 2 {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] cache.retry_delay = 0.0 {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] cache.socket_keepalive_count = 1 {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] cache.socket_keepalive_idle = 1 {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] cache.socket_keepalive_interval = 1 {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] cache.socket_timeout = 1.0 {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] cache.tls_allowed_ciphers = None {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] cache.tls_cafile = None {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] cache.tls_certfile = None {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] cache.tls_enabled = False {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:39 devstack sudo[82870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Jun 29 03:13:39 devstack sudo[82870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] cache.tls_keyfile = None {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] cache.username = None {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] coordination.backend_url = **** {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] database.asyncio_connection = **** {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] database.asyncio_slave_connection = **** {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] database.backend = sqlalchemy {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] database.connection = **** {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] database.connection_debug = 0 {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] database.connection_parameters = {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] database.connection_recycle_time = 3600 {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] database.connection_trace = False {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:39 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] database.db_inc_retry_interval = True {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] database.db_max_retries = 20 {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] database.db_max_retry_interval = 10 {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] database.db_retry_interval = 1 {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] database.max_overflow = 50 {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] database.max_pool_size = 5 {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] database.max_retries = 10 {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] database.mysql_wsrep_sync_wait = None {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] database.pool_timeout = None {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] database.retry_interval = 10 {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] database.slave_connection = **** {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] database.sqlite_synchronous = True {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] database.synchronous_reader = True {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] database.use_db_reconnect = False {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] profiler.connection_string = messaging:// {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] profiler.enabled = False {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] profiler.es_doc_type = notification {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] profiler.es_scroll_size = 10000 {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] profiler.es_scroll_time = 2m {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] profiler.filter_error_trace = False {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] profiler.hmac_keys = **** {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] profiler.sentinel_service_name = mymaster {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] profiler.socket_timeout = 0.1 {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] profiler.trace_requests = False {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] profiler.trace_sqlalchemy = False {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] profiler_jaeger.process_tags = {} {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] profiler_jaeger.service_name_prefix = None {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] profiler_otlp.service_name_prefix = None {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] oslo_policy.enforce_new_defaults = False {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: WARNING oslo_config.cfg [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] oslo_policy.enforce_scope = False {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] oslo_policy.policy_default_rule = default {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] oslo_policy.policy_file = policy.yaml {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] oslo_policy.remote_timeout = 60.0 {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] privsep_osbrick.group = None {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] privsep_osbrick.helper_command = None {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] privsep_osbrick.user = None {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] cinder_sys_admin.group = None {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] cinder_sys_admin.helper_command = None {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] cinder_sys_admin.user = None {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] service_user.auth_section = None {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] service_user.auth_type = password {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] service_user.cafile = None {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] service_user.certfile = None {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] service_user.collect_timing = False {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] service_user.insecure = False {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] service_user.keyfile = None {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] service_user.send_service_user_token = True {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] service_user.split_loggers = False {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] service_user.timeout = None {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] glance.auth_section = None {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] glance.auth_type = password {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] glance.certfile = None {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] glance.collect_timing = False {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] glance.insecure = False {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] glance.keyfile = None {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] glance.region_name = None {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] glance.split_loggers = False {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] glance.timeout = None {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] backend_defaults.backend_availability_zone = None {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] backend_defaults.chap_password = **** {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] backend_defaults.chap_username = {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] backend_defaults.disk_geometry = None {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] backend_defaults.driver_client_cert = None {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] backend_defaults.driver_client_cert_key = None {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] backend_defaults.driver_data_namespace = None {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] backend_defaults.driver_use_ssl = False {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] backend_defaults.enable_unsupported_driver = False {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] backend_defaults.extra_capabilities = {} {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] backend_defaults.filter_function = None {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] backend_defaults.goodness_function = None {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] backend_defaults.iscsi_target_flags = {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] backend_defaults.iscsi_write_cache = on {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] backend_defaults.iser_helper = tgtadm {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] backend_defaults.iser_ip_address = 192.168.122.201 {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] backend_defaults.iser_port = 3260 {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] backend_defaults.lvm_mirrors = 0 {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] backend_defaults.lvm_share_target = False {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] backend_defaults.lvm_type = auto {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] backend_defaults.num_shell_tries = 3 {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] backend_defaults.nvmet_port_id = 1 {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] backend_defaults.replication_device = **** {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] backend_defaults.report_discard_supported = False {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] backend_defaults.reserved_percentage = 0 {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] backend_defaults.scst_target_driver = iscsi {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] backend_defaults.scst_target_iqn_name = None {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] backend_defaults.storage_protocol = iSCSI {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] backend_defaults.target_helper = tgtadm {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] backend_defaults.target_ip_address = 192.168.122.201 {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] backend_defaults.target_port = 3260 {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] backend_defaults.target_protocol = iscsi {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] backend_defaults.trace_flags = None {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] backend_defaults.unique_fqdn_network = True {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] backend_defaults.use_chap_auth = False {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] backend_defaults.volume_backend_name = None {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] backend_defaults.volume_clear = zero {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] backend_defaults.volume_clear_ionice = None {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] backend_defaults.volume_clear_size = 0 {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] backend_defaults.volume_group = cinder-volumes {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] oslo_reports.file_event_handler = None {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] oslo_reports.log_dir = None {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] lvmdriver-1.backend_availability_zone = None {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] lvmdriver-1.backend_host = None {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] lvmdriver-1.chap_password = **** {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] lvmdriver-1.chap_username = None {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] lvmdriver-1.chiscsi_conf = None {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] lvmdriver-1.disk_geometry = None {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] lvmdriver-1.driver_client_cert = None {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] lvmdriver-1.driver_data_namespace = None {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] lvmdriver-1.driver_use_ssl = None {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] lvmdriver-1.extra_capabilities = None {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] lvmdriver-1.filter_function = None {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] lvmdriver-1.goodness_function = None {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] lvmdriver-1.iser_helper = None {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] lvmdriver-1.iser_ip_address = None {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] lvmdriver-1.iser_port = None {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] lvmdriver-1.iser_target_prefix = None {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] lvmdriver-1.lvm_conf_file = None {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] lvmdriver-1.lvm_mirrors = None {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] lvmdriver-1.lvm_share_target = None {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] lvmdriver-1.lvm_type = auto {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] lvmdriver-1.num_shell_tries = None {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] lvmdriver-1.nvmet_port_id = None {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] lvmdriver-1.replication_device = **** {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] lvmdriver-1.report_discard_supported = None {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] lvmdriver-1.reserved_percentage = None {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] lvmdriver-1.scst_target_driver = None {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] lvmdriver-1.storage_protocol = None {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] lvmdriver-1.target_helper = lioadm {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] lvmdriver-1.target_ip_address = None {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] lvmdriver-1.target_port = 3260 {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] lvmdriver-1.target_protocol = iscsi {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] lvmdriver-1.trace_flags = None {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] lvmdriver-1.use_chap_auth = None {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] lvmdriver-1.volume_clear = zero {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] lvmdriver-1.volume_clear_size = None {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] lvmdriver-1.volumes_dir = None {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] oslo_messaging_rabbit.ssl = False {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] oslo_messaging_rabbit.ssl_version = {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] oslo_messaging_notifications.driver = [] {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] oslo_messaging_notifications.retry = -1 {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] oslo_messaging_notifications.transport_url = **** {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] key_manager.fixed_key = **** {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] barbican.barbican_api_version = None {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] barbican.barbican_endpoint = None {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] barbican.barbican_endpoint_type = public {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] barbican.barbican_region_name = None {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] barbican.cafile = None {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] barbican.certfile = None {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] barbican.collect_timing = False {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] barbican.insecure = False {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] barbican.keyfile = None {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] barbican.number_of_retries = 60 {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] barbican.retry_delay = 1 {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] barbican.send_service_user_token = False {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] barbican.split_loggers = False {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] barbican.timeout = None {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] barbican.verify_ssl = True {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] barbican.verify_ssl_path = None {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] barbican_service_user.auth_section = None {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] barbican_service_user.auth_type = None {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] barbican_service_user.cafile = None {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] barbican_service_user.certfile = None {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] barbican_service_user.collect_timing = False {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] barbican_service_user.insecure = False {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] barbican_service_user.keyfile = None {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] barbican_service_user.split_loggers = False {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] barbican_service_user.timeout = None {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] vault.approle_role_id = **** {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] vault.approle_secret_id = **** {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] vault.kv_mountpoint = secret {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] vault.kv_path = None {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] vault.kv_version = 2 {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] vault.namespace = None {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] vault.root_token_id = **** {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] vault.ssl_ca_crt_file = None {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] vault.timeout = 60.0 {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] vault.use_ssl = False {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:13:40 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] ******************************************************************************** {{(pid=82698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jun 29 03:13:40 devstack sudo[82870]: pam_unix(sudo:session): session closed for user root Jun 29 03:13:40 devstack cinder-volume[82865]: DEBUG oslo_concurrency.processutils [None req-a99e5f1a-9396-4cdd-82ac-b2c82ab16e9a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.668s {{(pid=82865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:13:40 devstack cinder-volume[82865]: DEBUG oslo_concurrency.processutils [None req-a99e5f1a-9396-4cdd-82ac-b2c82ab16e9a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:13:40 devstack sudo[82925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 29 03:13:40 devstack sudo[82925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:13:41 devstack sudo[82925]: pam_unix(sudo:session): session closed for user root Jun 29 03:13:41 devstack cinder-volume[82865]: DEBUG oslo_concurrency.processutils [None req-a99e5f1a-9396-4cdd-82ac-b2c82ab16e9a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.681s {{(pid=82865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:13:41 devstack cinder-volume[82865]: DEBUG oslo_concurrency.processutils [None req-a99e5f1a-9396-4cdd-82ac-b2c82ab16e9a None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=82865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 29 03:13:41 devstack cinder-volume[82865]: INFO cinder.brick.local_dev.lvm [None req-a99e5f1a-9396-4cdd-82ac-b2c82ab16e9a None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Jun 29 03:13:41 devstack cinder-volume[82865]: DEBUG oslo_concurrency.processutils [None req-a99e5f1a-9396-4cdd-82ac-b2c82ab16e9a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:13:41 devstack cinder-volume[82865]: DEBUG oslo_concurrency.processutils [None req-a99e5f1a-9396-4cdd-82ac-b2c82ab16e9a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=82865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:13:41 devstack cinder-volume[82865]: DEBUG oslo_concurrency.processutils [None req-a99e5f1a-9396-4cdd-82ac-b2c82ab16e9a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:13:41 devstack sudo[83174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 29 03:13:41 devstack sudo[83174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:13:42 devstack sudo[83174]: pam_unix(sudo:session): session closed for user root Jun 29 03:13:42 devstack cinder-volume[82865]: DEBUG oslo_concurrency.processutils [None req-a99e5f1a-9396-4cdd-82ac-b2c82ab16e9a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.817s {{(pid=82865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:13:42 devstack cinder-volume[82865]: DEBUG cinder.brick.local_dev.lvm [None req-a99e5f1a-9396-4cdd-82ac-b2c82ab16e9a None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=82865) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Jun 29 03:13:42 devstack cinder-volume[82865]: DEBUG oslo_concurrency.processutils [None req-a99e5f1a-9396-4cdd-82ac-b2c82ab16e9a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:13:42 devstack sudo[83436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 29 03:13:42 devstack sudo[83436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:13:43 devstack sudo[83436]: pam_unix(sudo:session): session closed for user root Jun 29 03:13:43 devstack cinder-volume[82865]: DEBUG oslo_concurrency.processutils [None req-a99e5f1a-9396-4cdd-82ac-b2c82ab16e9a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.226s {{(pid=82865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:13:43 devstack cinder-volume[82865]: DEBUG oslo_concurrency.processutils [None req-a99e5f1a-9396-4cdd-82ac-b2c82ab16e9a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:13:43 devstack cinder-volume[82865]: DEBUG oslo_concurrency.processutils [None req-a99e5f1a-9396-4cdd-82ac-b2c82ab16e9a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.027s {{(pid=82865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:13:43 devstack cinder-volume[82865]: DEBUG oslo_concurrency.processutils [None req-a99e5f1a-9396-4cdd-82ac-b2c82ab16e9a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:13:43 devstack sudo[83627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 29 03:13:43 devstack sudo[83627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:13:44 devstack sudo[83627]: pam_unix(sudo:session): session closed for user root Jun 29 03:13:44 devstack cinder-volume[82865]: DEBUG oslo_concurrency.processutils [None req-a99e5f1a-9396-4cdd-82ac-b2c82ab16e9a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.756s {{(pid=82865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:13:44 devstack cinder-volume[82865]: DEBUG oslo_concurrency.processutils [None req-a99e5f1a-9396-4cdd-82ac-b2c82ab16e9a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:13:44 devstack cinder-volume[82865]: DEBUG oslo_concurrency.processutils [None req-a99e5f1a-9396-4cdd-82ac-b2c82ab16e9a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=82865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:13:44 devstack cinder-volume[82865]: DEBUG oslo_concurrency.processutils [None req-a99e5f1a-9396-4cdd-82ac-b2c82ab16e9a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=82865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:13:44 devstack sudo[83650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Jun 29 03:13:44 devstack sudo[83650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:13:44 devstack sudo[83650]: pam_unix(sudo:session): session closed for user root Jun 29 03:13:44 devstack cinder-volume[82865]: DEBUG oslo_concurrency.processutils [None req-a99e5f1a-9396-4cdd-82ac-b2c82ab16e9a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.694s {{(pid=82865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:13:44 devstack cinder-volume[82865]: DEBUG oslo_concurrency.processutils [None req-a99e5f1a-9396-4cdd-82ac-b2c82ab16e9a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:13:44 devstack sudo[83654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 29 03:13:44 devstack sudo[83654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:13:45 devstack sudo[83654]: pam_unix(sudo:session): session closed for user root Jun 29 03:13:45 devstack cinder-volume[82865]: DEBUG oslo_concurrency.processutils [None req-a99e5f1a-9396-4cdd-82ac-b2c82ab16e9a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.935s {{(pid=82865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:13:45 devstack cinder-volume[82865]: DEBUG oslo_concurrency.processutils [None req-a99e5f1a-9396-4cdd-82ac-b2c82ab16e9a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:13:45 devstack sudo[83658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 29 03:13:45 devstack sudo[83658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:13:46 devstack sudo[83658]: pam_unix(sudo:session): session closed for user root Jun 29 03:13:46 devstack cinder-volume[82865]: DEBUG oslo_concurrency.processutils [None req-a99e5f1a-9396-4cdd-82ac-b2c82ab16e9a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.728s {{(pid=82865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:13:46 devstack cinder-volume[82865]: DEBUG oslo_concurrency.processutils [None req-a99e5f1a-9396-4cdd-82ac-b2c82ab16e9a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:13:46 devstack sudo[83669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 29 03:13:46 devstack sudo[83669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:13:47 devstack sudo[83669]: pam_unix(sudo:session): session closed for user root Jun 29 03:13:47 devstack cinder-volume[82865]: DEBUG oslo_concurrency.processutils [None req-a99e5f1a-9396-4cdd-82ac-b2c82ab16e9a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.907s {{(pid=82865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:13:47 devstack cinder-volume[82865]: DEBUG oslo_concurrency.processutils [None req-a99e5f1a-9396-4cdd-82ac-b2c82ab16e9a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:13:47 devstack sudo[83677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 29 03:13:47 devstack sudo[83677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:13:48 devstack sudo[83677]: pam_unix(sudo:session): session closed for user root Jun 29 03:13:48 devstack cinder-volume[82865]: DEBUG oslo_concurrency.processutils [None req-a99e5f1a-9396-4cdd-82ac-b2c82ab16e9a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.753s {{(pid=82865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:13:48 devstack cinder-volume[82865]: DEBUG oslo_concurrency.processutils [None req-a99e5f1a-9396-4cdd-82ac-b2c82ab16e9a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:13:48 devstack cinder-volume[82865]: DEBUG oslo_concurrency.processutils [None req-a99e5f1a-9396-4cdd-82ac-b2c82ab16e9a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=82865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:13:48 devstack cinder-volume[82865]: DEBUG oslo_concurrency.processutils [None req-a99e5f1a-9396-4cdd-82ac-b2c82ab16e9a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:13:48 devstack sudo[83684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 29 03:13:48 devstack sudo[83684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:13:48 devstack sudo[83684]: pam_unix(sudo:session): session closed for user root Jun 29 03:13:48 devstack cinder-volume[82865]: DEBUG oslo_concurrency.processutils [None req-a99e5f1a-9396-4cdd-82ac-b2c82ab16e9a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.749s {{(pid=82865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:13:48 devstack cinder-volume[82865]: INFO cinder.volume.drivers.lvm [None req-a99e5f1a-9396-4cdd-82ac-b2c82ab16e9a None None] Enabling LVM thin provisioning by default because a thin pool exists. Jun 29 03:13:49 devstack cinder-volume[82865]: DEBUG oslo_concurrency.processutils [None req-a99e5f1a-9396-4cdd-82ac-b2c82ab16e9a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:13:49 devstack cinder-volume[82865]: DEBUG oslo_concurrency.processutils [None req-a99e5f1a-9396-4cdd-82ac-b2c82ab16e9a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.027s {{(pid=82865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:13:49 devstack cinder-volume[82865]: DEBUG oslo_concurrency.processutils [None req-a99e5f1a-9396-4cdd-82ac-b2c82ab16e9a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:13:49 devstack sudo[83694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 29 03:13:49 devstack sudo[83694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:13:49 devstack sudo[83694]: pam_unix(sudo:session): session closed for user root Jun 29 03:13:49 devstack cinder-volume[82865]: DEBUG oslo_concurrency.processutils [None req-a99e5f1a-9396-4cdd-82ac-b2c82ab16e9a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.714s {{(pid=82865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:13:49 devstack cinder-volume[82865]: DEBUG cinder.volume.drivers.lvm [None req-a99e5f1a-9396-4cdd-82ac-b2c82ab16e9a None None] Updating volume stats {{(pid=82865) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 29 03:13:49 devstack cinder-volume[82865]: DEBUG oslo_concurrency.processutils [None req-a99e5f1a-9396-4cdd-82ac-b2c82ab16e9a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:13:49 devstack sudo[83811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 29 03:13:49 devstack sudo[83811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:13:49 devstack cinder-volume[82698]: DEBUG dbcounter [-] [82698] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=82698) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 29 03:13:50 devstack sudo[83811]: pam_unix(sudo:session): session closed for user root Jun 29 03:13:50 devstack cinder-volume[82865]: DEBUG oslo_concurrency.processutils [None req-a99e5f1a-9396-4cdd-82ac-b2c82ab16e9a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.666s {{(pid=82865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:13:50 devstack cinder-volume[82865]: DEBUG oslo_concurrency.processutils [None req-a99e5f1a-9396-4cdd-82ac-b2c82ab16e9a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:13:50 devstack sudo[83954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 29 03:13:50 devstack sudo[83954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:13:51 devstack sudo[83954]: pam_unix(sudo:session): session closed for user root Jun 29 03:13:51 devstack cinder-volume[82865]: DEBUG oslo_concurrency.processutils [None req-a99e5f1a-9396-4cdd-82ac-b2c82ab16e9a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.655s {{(pid=82865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:13:51 devstack cinder-volume[82865]: DEBUG oslo_concurrency.processutils [None req-a99e5f1a-9396-4cdd-82ac-b2c82ab16e9a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:13:51 devstack sudo[83957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 29 03:13:51 devstack sudo[83957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:13:51 devstack sudo[83957]: pam_unix(sudo:session): session closed for user root Jun 29 03:13:51 devstack cinder-volume[82865]: DEBUG oslo_concurrency.processutils [None req-a99e5f1a-9396-4cdd-82ac-b2c82ab16e9a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.626s {{(pid=82865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:13:51 devstack cinder-volume[82865]: DEBUG oslo_concurrency.processutils [None req-a99e5f1a-9396-4cdd-82ac-b2c82ab16e9a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:13:51 devstack sudo[83960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 29 03:13:51 devstack sudo[83960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:13:52 devstack sudo[83960]: pam_unix(sudo:session): session closed for user root Jun 29 03:13:52 devstack cinder-volume[82865]: DEBUG oslo_concurrency.processutils [None req-a99e5f1a-9396-4cdd-82ac-b2c82ab16e9a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.628s {{(pid=82865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:13:52 devstack cinder-volume[82865]: INFO cinder.volume.driver [None req-a99e5f1a-9396-4cdd-82ac-b2c82ab16e9a None None] Driver hasn't implemented _init_vendor_properties() Jun 29 03:13:52 devstack cinder-volume[82865]: DEBUG cinder.volume.driver [None req-a99e5f1a-9396-4cdd-82ac-b2c82ab16e9a None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82865) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jun 29 03:13:52 devstack cinder-volume[82865]: DEBUG oslo_db.sqlalchemy.engines [None req-a99e5f1a-9396-4cdd-82ac-b2c82ab16e9a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82865) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 29 03:13:52 devstack cinder-volume[82865]: DEBUG dbcounter [-] [82865] Writer thread running {{(pid=82865) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 29 03:13:52 devstack cinder-volume[82865]: DEBUG cinder.db.api [None req-a99e5f1a-9396-4cdd-82ac-b2c82ab16e9a None None] Building query based on filter {{(pid=82865) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jun 29 03:13:52 devstack cinder-volume[82865]: DEBUG cinder.image.image_utils [None req-a99e5f1a-9396-4cdd-82ac-b2c82ab16e9a None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=82865) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jun 29 03:13:52 devstack cinder-volume[82865]: INFO cinder.keymgr.migration [None req-6badeeb7-08d7-40c9-887c-be41d901bd11 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jun 29 03:13:52 devstack cinder-volume[82865]: DEBUG cinder.volume.drivers.lvm [None req-a99e5f1a-9396-4cdd-82ac-b2c82ab16e9a None None] Updating volume stats {{(pid=82865) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 29 03:13:52 devstack cinder-volume[82865]: DEBUG oslo_concurrency.processutils [None req-a99e5f1a-9396-4cdd-82ac-b2c82ab16e9a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:13:52 devstack sudo[83964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 29 03:13:52 devstack sudo[83964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:13:53 devstack sudo[83964]: pam_unix(sudo:session): session closed for user root Jun 29 03:13:53 devstack cinder-volume[82865]: DEBUG oslo_concurrency.processutils [None req-a99e5f1a-9396-4cdd-82ac-b2c82ab16e9a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.663s {{(pid=82865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:13:53 devstack cinder-volume[82865]: DEBUG oslo_concurrency.processutils [None req-a99e5f1a-9396-4cdd-82ac-b2c82ab16e9a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:13:53 devstack sudo[83971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 29 03:13:53 devstack sudo[83971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:13:53 devstack sudo[83971]: pam_unix(sudo:session): session closed for user root Jun 29 03:13:53 devstack cinder-volume[82865]: DEBUG oslo_concurrency.processutils [None req-a99e5f1a-9396-4cdd-82ac-b2c82ab16e9a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.657s {{(pid=82865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:13:53 devstack cinder-volume[82865]: DEBUG oslo_concurrency.processutils [None req-a99e5f1a-9396-4cdd-82ac-b2c82ab16e9a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:13:53 devstack sudo[83974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 29 03:13:53 devstack sudo[83974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:13:54 devstack sudo[83974]: pam_unix(sudo:session): session closed for user root Jun 29 03:13:54 devstack cinder-volume[82865]: DEBUG oslo_concurrency.processutils [None req-a99e5f1a-9396-4cdd-82ac-b2c82ab16e9a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.686s {{(pid=82865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:13:54 devstack cinder-volume[82865]: DEBUG oslo_concurrency.processutils [None req-a99e5f1a-9396-4cdd-82ac-b2c82ab16e9a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:13:54 devstack sudo[83977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 29 03:13:54 devstack sudo[83977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:13:55 devstack sudo[83977]: pam_unix(sudo:session): session closed for user root Jun 29 03:13:55 devstack cinder-volume[82865]: DEBUG oslo_concurrency.processutils [None req-a99e5f1a-9396-4cdd-82ac-b2c82ab16e9a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.718s {{(pid=82865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:13:55 devstack cinder-volume[82865]: DEBUG cinder.manager [None req-a99e5f1a-9396-4cdd-82ac-b2c82ab16e9a None None] Notifying Schedulers of capabilities ... {{(pid=82865) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:13:55 devstack cinder-volume[82865]: INFO cinder.volume.manager [None req-a99e5f1a-9396-4cdd-82ac-b2c82ab16e9a None None] Driver initialization completed successfully. Jun 29 03:13:55 devstack cinder-volume[82865]: INFO cinder.manager [None req-a99e5f1a-9396-4cdd-82ac-b2c82ab16e9a None None] Initiating service 2 cleanup Jun 29 03:13:55 devstack cinder-volume[82865]: INFO cinder.manager [None req-a99e5f1a-9396-4cdd-82ac-b2c82ab16e9a None None] Service 2 cleanup completed. Jun 29 03:13:55 devstack cinder-volume[82865]: DEBUG cinder.service [None req-a99e5f1a-9396-4cdd-82ac-b2c82ab16e9a None None] Creating RPC server for service cinder-volume {{(pid=82865) start /opt/stack/cinder/cinder/service.py:231}} Jun 29 03:13:55 devstack cinder-volume[82865]: DEBUG cinder.service [None req-a99e5f1a-9396-4cdd-82ac-b2c82ab16e9a None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=82865) start /opt/stack/cinder/cinder/service.py:237}} Jun 29 03:13:55 devstack cinder-volume[82865]: INFO cinder.volume.manager [None req-a99e5f1a-9396-4cdd-82ac-b2c82ab16e9a None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Jun 29 03:13:55 devstack cinder-volume[82865]: DEBUG cinder.volume.drivers.lvm [None req-a99e5f1a-9396-4cdd-82ac-b2c82ab16e9a None None] Updating volume stats {{(pid=82865) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 29 03:13:55 devstack cinder-volume[82865]: DEBUG oslo_concurrency.processutils [None req-a99e5f1a-9396-4cdd-82ac-b2c82ab16e9a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:13:55 devstack sudo[83981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 29 03:13:55 devstack sudo[83981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:13:56 devstack sudo[83981]: pam_unix(sudo:session): session closed for user root Jun 29 03:13:56 devstack cinder-volume[82865]: DEBUG oslo_concurrency.processutils [None req-a99e5f1a-9396-4cdd-82ac-b2c82ab16e9a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.693s {{(pid=82865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:13:56 devstack cinder-volume[82865]: DEBUG oslo_concurrency.processutils [None req-a99e5f1a-9396-4cdd-82ac-b2c82ab16e9a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:13:56 devstack sudo[83985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 29 03:13:56 devstack sudo[83985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:13:56 devstack sudo[83985]: pam_unix(sudo:session): session closed for user root Jun 29 03:13:56 devstack cinder-volume[82865]: DEBUG oslo_concurrency.processutils [None req-a99e5f1a-9396-4cdd-82ac-b2c82ab16e9a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.693s {{(pid=82865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:13:56 devstack cinder-volume[82865]: DEBUG oslo_concurrency.processutils [None req-a99e5f1a-9396-4cdd-82ac-b2c82ab16e9a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:13:56 devstack sudo[83988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 29 03:13:56 devstack sudo[83988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:13:57 devstack sudo[83988]: pam_unix(sudo:session): session closed for user root Jun 29 03:13:57 devstack cinder-volume[82865]: DEBUG oslo_concurrency.processutils [None req-a99e5f1a-9396-4cdd-82ac-b2c82ab16e9a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.652s {{(pid=82865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:13:57 devstack cinder-volume[82865]: DEBUG oslo_concurrency.processutils [None req-a99e5f1a-9396-4cdd-82ac-b2c82ab16e9a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:13:57 devstack sudo[84048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 29 03:13:57 devstack sudo[84048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:13:58 devstack sudo[84048]: pam_unix(sudo:session): session closed for user root Jun 29 03:13:58 devstack cinder-volume[82865]: DEBUG oslo_concurrency.processutils [None req-a99e5f1a-9396-4cdd-82ac-b2c82ab16e9a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.649s {{(pid=82865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:13:58 devstack cinder-volume[82865]: INFO cinder.volume.manager [None req-a99e5f1a-9396-4cdd-82ac-b2c82ab16e9a None None] Driver post RPC initialization completed successfully. Jun 29 03:14:08 devstack cinder-volume[82865]: DEBUG dbcounter [-] [82865] Writing DB stats cinder:SELECT=3 {{(pid=82865) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 29 03:14:08 devstack cinder-volume[82865]: DEBUG dbcounter [-] [82865] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=82865) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 29 03:14:24 devstack cinder-volume[82865]: DEBUG oslo_service.periodic_task [None req-fc2c734f-7a50-42bf-ac64-9da4220035f4 None None] Running periodic task VolumeManager._thread_info {{(pid=82865) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 29 03:14:24 devstack cinder-volume[82865]: DEBUG cinder.volume.manager [None req-fc2c734f-7a50-42bf-ac64-9da4220035f4 None None] thread count: 6 {{(pid=82865) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 29 03:14:24 devstack cinder-volume[82865]: DEBUG cinder.volume.manager [None req-fc2c734f-7a50-42bf-ac64-9da4220035f4 None None] thread info: [<_MainThread(MainThread, started 135873165635712)>, , , , , ] {{(pid=82865) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 29 03:15:24 devstack cinder-volume[82865]: DEBUG oslo_service.periodic_task [None req-fc2c734f-7a50-42bf-ac64-9da4220035f4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82865) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 29 03:15:24 devstack cinder-volume[82865]: DEBUG cinder.volume.drivers.lvm [None req-fc2c734f-7a50-42bf-ac64-9da4220035f4 None None] Updating volume stats {{(pid=82865) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 29 03:15:24 devstack cinder-volume[82865]: DEBUG oslo_concurrency.processutils [None req-fc2c734f-7a50-42bf-ac64-9da4220035f4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:15:24 devstack sudo[86382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 29 03:15:24 devstack sudo[86382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:15:24 devstack sudo[86382]: pam_unix(sudo:session): session closed for user root Jun 29 03:15:24 devstack cinder-volume[82865]: DEBUG oslo_concurrency.processutils [None req-fc2c734f-7a50-42bf-ac64-9da4220035f4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.720s {{(pid=82865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:15:24 devstack cinder-volume[82865]: DEBUG oslo_concurrency.processutils [None req-fc2c734f-7a50-42bf-ac64-9da4220035f4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:15:24 devstack sudo[86387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 29 03:15:24 devstack sudo[86387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:15:25 devstack sudo[86387]: pam_unix(sudo:session): session closed for user root Jun 29 03:15:25 devstack cinder-volume[82865]: DEBUG oslo_concurrency.processutils [None req-fc2c734f-7a50-42bf-ac64-9da4220035f4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.651s {{(pid=82865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:15:25 devstack cinder-volume[82865]: DEBUG oslo_concurrency.processutils [None req-fc2c734f-7a50-42bf-ac64-9da4220035f4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:15:25 devstack sudo[86499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 29 03:15:25 devstack sudo[86499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:15:26 devstack sudo[86499]: pam_unix(sudo:session): session closed for user root Jun 29 03:15:26 devstack cinder-volume[82865]: DEBUG oslo_concurrency.processutils [None req-fc2c734f-7a50-42bf-ac64-9da4220035f4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.652s {{(pid=82865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:15:26 devstack cinder-volume[82865]: DEBUG oslo_concurrency.processutils [None req-fc2c734f-7a50-42bf-ac64-9da4220035f4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:15:26 devstack sudo[86857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 29 03:15:26 devstack sudo[86857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:15:26 devstack sudo[86857]: pam_unix(sudo:session): session closed for user root Jun 29 03:15:26 devstack cinder-volume[82865]: DEBUG oslo_concurrency.processutils [None req-fc2c734f-7a50-42bf-ac64-9da4220035f4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.647s {{(pid=82865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:15:26 devstack cinder-volume[82865]: DEBUG cinder.manager [None req-fc2c734f-7a50-42bf-ac64-9da4220035f4 None None] Notifying Schedulers of capabilities ... {{(pid=82865) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:15:26 devstack cinder-volume[82865]: DEBUG oslo_service.periodic_task [None req-fc2c734f-7a50-42bf-ac64-9da4220035f4 None None] Running periodic task VolumeManager._thread_info {{(pid=82865) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 29 03:15:26 devstack cinder-volume[82865]: DEBUG cinder.volume.manager [None req-fc2c734f-7a50-42bf-ac64-9da4220035f4 None None] thread count: 6 {{(pid=82865) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 29 03:15:26 devstack cinder-volume[82865]: DEBUG cinder.volume.manager [None req-fc2c734f-7a50-42bf-ac64-9da4220035f4 None None] thread info: [<_MainThread(MainThread, started 135873165635712)>, , , , , ] {{(pid=82865) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 29 03:16:08 devstack cinder-volume[82865]: DEBUG dbcounter [-] [82865] Writing DB stats cinder:SELECT=1 {{(pid=82865) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 29 03:16:08 devstack cinder-volume[82865]: DEBUG dbcounter [-] [82865] Writing DB stats cinder:UPDATE=1 {{(pid=82865) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 29 03:16:24 devstack cinder-volume[82865]: DEBUG oslo_service.periodic_task [None req-fc2c734f-7a50-42bf-ac64-9da4220035f4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82865) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 29 03:16:24 devstack cinder-volume[82865]: DEBUG cinder.volume.drivers.lvm [None req-fc2c734f-7a50-42bf-ac64-9da4220035f4 None None] Updating volume stats {{(pid=82865) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 29 03:16:24 devstack cinder-volume[82865]: DEBUG oslo_concurrency.processutils [None req-fc2c734f-7a50-42bf-ac64-9da4220035f4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:16:24 devstack sudo[89239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 29 03:16:24 devstack sudo[89239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:16:24 devstack sudo[89239]: pam_unix(sudo:session): session closed for user root Jun 29 03:16:24 devstack cinder-volume[82865]: DEBUG oslo_concurrency.processutils [None req-fc2c734f-7a50-42bf-ac64-9da4220035f4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.674s {{(pid=82865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:16:24 devstack cinder-volume[82865]: DEBUG oslo_concurrency.processutils [None req-fc2c734f-7a50-42bf-ac64-9da4220035f4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:16:24 devstack sudo[89242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 29 03:16:24 devstack sudo[89242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:16:25 devstack sudo[89242]: pam_unix(sudo:session): session closed for user root Jun 29 03:16:25 devstack cinder-volume[82865]: DEBUG oslo_concurrency.processutils [None req-fc2c734f-7a50-42bf-ac64-9da4220035f4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.695s {{(pid=82865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:16:25 devstack cinder-volume[82865]: DEBUG oslo_concurrency.processutils [None req-fc2c734f-7a50-42bf-ac64-9da4220035f4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:16:25 devstack sudo[89245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 29 03:16:25 devstack sudo[89245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:16:26 devstack sudo[89245]: pam_unix(sudo:session): session closed for user root Jun 29 03:16:26 devstack cinder-volume[82865]: DEBUG oslo_concurrency.processutils [None req-fc2c734f-7a50-42bf-ac64-9da4220035f4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.629s {{(pid=82865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:16:26 devstack cinder-volume[82865]: DEBUG oslo_concurrency.processutils [None req-fc2c734f-7a50-42bf-ac64-9da4220035f4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:16:26 devstack sudo[89248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 29 03:16:26 devstack sudo[89248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:16:26 devstack sudo[89248]: pam_unix(sudo:session): session closed for user root Jun 29 03:16:26 devstack cinder-volume[82865]: DEBUG oslo_concurrency.processutils [None req-fc2c734f-7a50-42bf-ac64-9da4220035f4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.640s {{(pid=82865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:16:26 devstack cinder-volume[82865]: DEBUG cinder.manager [None req-fc2c734f-7a50-42bf-ac64-9da4220035f4 None None] Notifying Schedulers of capabilities ... {{(pid=82865) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:16:26 devstack cinder-volume[82865]: DEBUG oslo_service.periodic_task [None req-fc2c734f-7a50-42bf-ac64-9da4220035f4 None None] Running periodic task VolumeManager._thread_info {{(pid=82865) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 29 03:16:26 devstack cinder-volume[82865]: DEBUG cinder.volume.manager [None req-fc2c734f-7a50-42bf-ac64-9da4220035f4 None None] thread count: 6 {{(pid=82865) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 29 03:16:26 devstack cinder-volume[82865]: DEBUG cinder.volume.manager [None req-fc2c734f-7a50-42bf-ac64-9da4220035f4 None None] thread info: [<_MainThread(MainThread, started 135873165635712)>, , , , , ] {{(pid=82865) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 29 03:17:24 devstack cinder-volume[82865]: DEBUG oslo_service.periodic_task [None req-fc2c734f-7a50-42bf-ac64-9da4220035f4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82865) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 29 03:17:24 devstack cinder-volume[82865]: DEBUG cinder.volume.drivers.lvm [None req-fc2c734f-7a50-42bf-ac64-9da4220035f4 None None] Updating volume stats {{(pid=82865) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 29 03:17:24 devstack cinder-volume[82865]: DEBUG oslo_concurrency.processutils [None req-fc2c734f-7a50-42bf-ac64-9da4220035f4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:17:24 devstack sudo[91220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 29 03:17:24 devstack sudo[91220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:17:24 devstack sudo[91220]: pam_unix(sudo:session): session closed for user root Jun 29 03:17:24 devstack cinder-volume[82865]: DEBUG oslo_concurrency.processutils [None req-fc2c734f-7a50-42bf-ac64-9da4220035f4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.635s {{(pid=82865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:17:24 devstack cinder-volume[82865]: DEBUG oslo_concurrency.processutils [None req-fc2c734f-7a50-42bf-ac64-9da4220035f4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:17:24 devstack sudo[91235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 29 03:17:24 devstack sudo[91235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:17:25 devstack sudo[91235]: pam_unix(sudo:session): session closed for user root Jun 29 03:17:25 devstack cinder-volume[82865]: DEBUG oslo_concurrency.processutils [None req-fc2c734f-7a50-42bf-ac64-9da4220035f4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.657s {{(pid=82865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:17:25 devstack cinder-volume[82865]: DEBUG oslo_concurrency.processutils [None req-fc2c734f-7a50-42bf-ac64-9da4220035f4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:17:25 devstack sudo[91239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 29 03:17:25 devstack sudo[91239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:17:26 devstack sudo[91239]: pam_unix(sudo:session): session closed for user root Jun 29 03:17:26 devstack cinder-volume[82865]: DEBUG oslo_concurrency.processutils [None req-fc2c734f-7a50-42bf-ac64-9da4220035f4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.659s {{(pid=82865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:17:26 devstack cinder-volume[82865]: DEBUG oslo_concurrency.processutils [None req-fc2c734f-7a50-42bf-ac64-9da4220035f4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:17:26 devstack sudo[91254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 29 03:17:26 devstack sudo[91254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:17:26 devstack sudo[91254]: pam_unix(sudo:session): session closed for user root Jun 29 03:17:26 devstack cinder-volume[82865]: DEBUG oslo_concurrency.processutils [None req-fc2c734f-7a50-42bf-ac64-9da4220035f4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.662s {{(pid=82865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:17:26 devstack cinder-volume[82865]: DEBUG cinder.manager [None req-fc2c734f-7a50-42bf-ac64-9da4220035f4 None None] Notifying Schedulers of capabilities ... {{(pid=82865) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:17:26 devstack cinder-volume[82865]: DEBUG oslo_service.periodic_task [None req-fc2c734f-7a50-42bf-ac64-9da4220035f4 None None] Running periodic task VolumeManager._thread_info {{(pid=82865) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 29 03:17:26 devstack cinder-volume[82865]: DEBUG cinder.volume.manager [None req-fc2c734f-7a50-42bf-ac64-9da4220035f4 None None] thread count: 6 {{(pid=82865) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 29 03:17:26 devstack cinder-volume[82865]: DEBUG cinder.volume.manager [None req-fc2c734f-7a50-42bf-ac64-9da4220035f4 None None] thread info: [<_MainThread(MainThread, started 135873165635712)>, , , , , ] {{(pid=82865) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 29 03:18:08 devstack cinder-volume[82865]: DEBUG dbcounter [-] [82865] Writing DB stats cinder:SELECT=1 {{(pid=82865) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 29 03:18:08 devstack cinder-volume[82865]: DEBUG dbcounter [-] [82865] Writing DB stats cinder:UPDATE=1 {{(pid=82865) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 29 03:18:24 devstack cinder-volume[82865]: DEBUG oslo_service.periodic_task [None req-fc2c734f-7a50-42bf-ac64-9da4220035f4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82865) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 29 03:18:24 devstack cinder-volume[82865]: DEBUG cinder.volume.drivers.lvm [None req-fc2c734f-7a50-42bf-ac64-9da4220035f4 None None] Updating volume stats {{(pid=82865) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 29 03:18:24 devstack cinder-volume[82865]: DEBUG oslo_concurrency.processutils [None req-fc2c734f-7a50-42bf-ac64-9da4220035f4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:18:24 devstack sudo[92394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 29 03:18:24 devstack sudo[92394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:18:24 devstack sudo[92394]: pam_unix(sudo:session): session closed for user root Jun 29 03:18:24 devstack cinder-volume[82865]: DEBUG oslo_concurrency.processutils [None req-fc2c734f-7a50-42bf-ac64-9da4220035f4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.645s {{(pid=82865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:18:24 devstack cinder-volume[82865]: DEBUG oslo_concurrency.processutils [None req-fc2c734f-7a50-42bf-ac64-9da4220035f4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:18:24 devstack sudo[92425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 29 03:18:24 devstack sudo[92425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:18:25 devstack sudo[92425]: pam_unix(sudo:session): session closed for user root Jun 29 03:18:25 devstack cinder-volume[82865]: DEBUG oslo_concurrency.processutils [None req-fc2c734f-7a50-42bf-ac64-9da4220035f4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.612s {{(pid=82865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:18:25 devstack cinder-volume[82865]: DEBUG oslo_concurrency.processutils [None req-fc2c734f-7a50-42bf-ac64-9da4220035f4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:18:25 devstack sudo[92434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 29 03:18:25 devstack sudo[92434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:18:26 devstack sudo[92434]: pam_unix(sudo:session): session closed for user root Jun 29 03:18:26 devstack cinder-volume[82865]: DEBUG oslo_concurrency.processutils [None req-fc2c734f-7a50-42bf-ac64-9da4220035f4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.674s {{(pid=82865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:18:26 devstack cinder-volume[82865]: DEBUG oslo_concurrency.processutils [None req-fc2c734f-7a50-42bf-ac64-9da4220035f4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:18:26 devstack sudo[92437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 29 03:18:26 devstack sudo[92437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:18:26 devstack sudo[92437]: pam_unix(sudo:session): session closed for user root Jun 29 03:18:26 devstack cinder-volume[82865]: DEBUG oslo_concurrency.processutils [None req-fc2c734f-7a50-42bf-ac64-9da4220035f4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.685s {{(pid=82865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:18:26 devstack cinder-volume[82865]: DEBUG cinder.manager [None req-fc2c734f-7a50-42bf-ac64-9da4220035f4 None None] Notifying Schedulers of capabilities ... {{(pid=82865) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:18:43 devstack cinder-volume[82698]: INFO oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] Caught SIGTERM, stopping children Jun 29 03:18:43 devstack cinder-volume[82698]: DEBUG oslo_concurrency.lockutils [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] Acquiring lock "singleton_lock" {{(pid=82698) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 29 03:18:43 devstack cinder-volume[82698]: DEBUG oslo_concurrency.lockutils [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] Acquired lock "singleton_lock" {{(pid=82698) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 29 03:18:43 devstack cinder-volume[82698]: DEBUG oslo_concurrency.lockutils [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] Releasing lock "singleton_lock" {{(pid=82698) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 29 03:18:43 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] Stop services. {{(pid=82698) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jun 29 03:18:43 devstack cinder-volume[82698]: DEBUG oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] Killing children. {{(pid=82698) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jun 29 03:18:43 devstack cinder-volume[82698]: INFO oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] Waiting on 1 children to exit Jun 29 03:18:45 devstack cinder-volume[82865]: DEBUG oslo_concurrency.lockutils [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] Acquiring lock "singleton_lock" {{(pid=82865) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 29 03:18:45 devstack cinder-volume[82865]: DEBUG oslo_concurrency.lockutils [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] Acquired lock "singleton_lock" {{(pid=82865) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 29 03:18:45 devstack cinder-volume[82865]: DEBUG oslo_concurrency.lockutils [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] Releasing lock "singleton_lock" {{(pid=82865) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 29 03:18:45 devstack cinder-volume[82865]: WARNING amqp [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jun 29 03:18:45 devstack cinder-volume[82865]: WARNING amqp [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jun 29 03:18:45 devstack cinder-volume[82698]: INFO oslo_service.backend._eventlet.service [None req-b891c766-a298-4f4b-b8f4-ad7f3100b266 None None] Child 82865 exited with status 0 Jun 29 03:18:45 devstack cinder-volume[92972]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jun 29 03:18:45 devstack cinder-volume[92972]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jun 29 03:18:45 devstack cinder-volume[92972]: we strongly recommend against using it for new projects. Jun 29 03:18:45 devstack cinder-volume[92972]: If you are already using Eventlet, we recommend migrating to a different Jun 29 03:18:45 devstack cinder-volume[92972]: framework. For more detail see Jun 29 03:18:45 devstack cinder-volume[92972]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jun 29 03:18:45 devstack cinder-volume[92972]: import eventlet # noqa Jun 29 03:18:47 devstack cinder-volume[92972]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=92972) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 29 03:18:47 devstack cinder-volume[92972]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=92972) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 29 03:18:47 devstack cinder-volume[92972]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=92972) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 29 03:18:48 devstack cinder-volume[92972]: INFO dbcounter [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] Registered counter for database cinder Jun 29 03:18:48 devstack cinder-volume[92972]: DEBUG oslo_db.sqlalchemy.engines [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92972) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 29 03:18:48 devstack cinder-volume[92972]: DEBUG dbcounter [-] [92972] Writer thread running {{(pid=92972) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 29 03:18:48 devstack cinder-volume[92972]: INFO cinder.rpc [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jun 29 03:18:48 devstack cinder-volume[92972]: INFO cinder.rpc [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_db.sqlalchemy.engines [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92972) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 29 03:18:49 devstack cinder-volume[92972]: INFO cinder.volume.manager [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] Determined volume DB was empty at startup. Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG cinder.volume.manager [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] Cinder Volume DB check: vol_db_empty=True {{(pid=92972) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jun 29 03:18:49 devstack cinder-volume[92972]: INFO cinder.volume.manager [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] Service not found for updating active_backend_id, assuming default for driver init. Jun 29 03:18:49 devstack cinder-volume[92972]: WARNING stevedore.named [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jun 29 03:18:49 devstack cinder-volume[92972]: WARNING castellan.key_manager [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 29 03:18:49 devstack cinder-volume[92972]: WARNING cinder.keymgr.conf_key_mgr [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 29 03:18:49 devstack cinder-volume[92972]: INFO cinder.volume.manager [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] Image-volume cache disabled for host devstack@QuobyteHD. Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_db.sqlalchemy.engines [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92972) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 29 03:18:49 devstack cinder-volume[92972]: INFO oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] Starting 1 workers Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] Started child 93186 {{(pid=92972) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] Full set of CONF: {{(pid=92972) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] ******************************************************************************** {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] Configuration options gathered from: {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] ================================================================================ {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] allow_availability_zone_fallback = False {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] allow_compression_on_image_upload = False {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] allowed_direct_url_schemes = [] {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] api_rate_limit = True {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] auth_strategy = keystone {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] backend_availability_zone = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] backend_host = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] backend_stats_polling_interval = 60 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] backup_api_class = cinder.backup.api.API {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] backup_name_template = backup-%s {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] backup_use_same_host = False {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] backup_use_temp_snapshot = False {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] chap_password = **** {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] chap_username = {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:49 devstack cinder-volume[93186]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] cinder_internal_tenant_project_id = 56ade22bead1432aba8310729674884e {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] cinder_internal_tenant_user_id = 19d2196238ab40308b0a0e03860b214a {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] cluster = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] compression_format = gzip {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] compute_api_class = cinder.compute.nova.API {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] config_dir = [] {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] config_source = [] {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] control_exchange = openstack {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] debug = True {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] default_availability_zone = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] default_group_type = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] default_volume_type = QuobyteHD {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] disk_geometry = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] driver_client_cert = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] driver_client_cert_key = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] driver_data_namespace = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] driver_ssl_cert_path = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] driver_ssl_cert_verify = False {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] driver_use_ssl = False {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] enable_new_services = True {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] enable_unsupported_driver = False {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] enabled_backends = ['QuobyteHD'] {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] enforce_multipath_for_image_xfer = False {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] filter_function = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] glance_api_insecure = False {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] glance_api_servers = ['http://192.168.122.201/image'] {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] glance_api_ssl_compression = False {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] glance_ca_certificates_file = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] glance_catalog_info = image:glance:publicURL {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] glance_certfile = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] glance_keyfile = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] glance_num_retries = 3 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] glance_request_timeout = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] goodness_function = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] graceful_shutdown_timeout = 5 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] group_api_class = cinder.group.api.API {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] host = devstack {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] image_compress_on_upload = True {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] image_conversion_address_space_limit = 1 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] image_conversion_cpu_limit = 60 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] image_conversion_disable = False {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] image_upload_use_cinder_backend = False {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] image_upload_use_internal_tenant = False {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] image_volume_cache_enabled = False {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] image_volume_cache_max_count = 0 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] image_volume_cache_max_size_gb = 0 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] init_host_max_objects_retrieval = 0 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] instance_format = [instance: %(uuid)s] {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] iscsi_target_flags = {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] iscsi_write_cache = on {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] iser_helper = tgtadm {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:49 devstack cinder-volume[93186]: INFO cinder.volume.manager [None req-10f6ac95-7d19-419d-ac59-184128fa03e4 None None] Starting volume driver QuobyteDriver (1.1.14) Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] iser_ip_address = 192.168.122.201 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:49 devstack cinder-volume[93186]: DEBUG cinder.volume.drivers.remotefs [None req-10f6ac95-7d19-419d-ac59-184128fa03e4 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=93186) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] iser_port = 3260 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] log_color = False {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] log_config_append = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] log_dir = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] log_file = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] log_options = True {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] log_rotate_interval = 1 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] log_rotate_interval_type = days {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] log_rotation_type = none {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] max_age = 0 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] max_logfile_count = 30 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] max_logfile_size_mb = 200 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] max_over_subscription_ratio = 20.0 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] message_reap_interval = 86400 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] message_ttl = 2592000 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] migration_create_volume_timeout_secs = 300 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] monkey_patch = False {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] monkey_patch_modules = [] {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] my_ip = 192.168.122.201 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] no_snapshot_gb_quota = False {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] num_iser_scan_tries = 3 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] num_shell_tries = 3 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] num_volume_device_scan_tries = 3 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] nvmeof_conn_info_version = 1 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] nvmet_ns_id = 10 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] nvmet_port_id = 1 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] osapi_max_limit = 1000 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] osapi_volume_ext_list = [] {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] osapi_volume_listen = 0.0.0.0 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] osapi_volume_listen_port = 8776 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] osapi_volume_use_ssl = False {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] osapi_volume_workers = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] per_volume_size_limit = -1 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] periodic_fuzzy_delay = 60 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] periodic_interval = 60 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] project_id_regex = [0-9a-f\-]+ {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] public_endpoint = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] publish_errors = False {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] quota_backup_gigabytes = 1000 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] quota_backups = 10 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] quota_gigabytes = 1000 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] quota_groups = 10 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] quota_snapshots = 10 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] quota_volumes = 10 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] rate_limit_burst = 0 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] rate_limit_except_level = CRITICAL {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] rate_limit_interval = 0 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] reinit_driver_count = 3 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] replication_device = **** {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] report_discard_supported = False {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] report_interval = 120 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] reservation_clean_interval = 86400 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] reservation_expire = 86400 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] reserved_image_namespaces = [] {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] reserved_percentage = 0 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] rpc_response_timeout = 120 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] run_external_periodic_tasks = True {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] scst_target_driver = iscsi {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] scst_target_iqn_name = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] service_down_time = 720 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] shell_completion = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] snapshot_name_template = snapshot-%s {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] split_loggers = False {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] state_path = /opt/stack/data/cinder {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] storage_availability_zone = nova {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] storage_protocol = iSCSI {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] syslog_log_facility = LOG_USER {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] target_helper = lioadm {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] target_ip_address = 192.168.122.201 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] target_port = 3260 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:49 devstack cinder-volume[93186]: DEBUG cinder.volume.drivers.quobyte [None req-10f6ac95-7d19-419d-ac59-184128fa03e4 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=93186) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jun 29 03:18:49 devstack cinder-volume[93186]: WARNING cinder.volume.drivers.quobyte [None req-10f6ac95-7d19-419d-ac59-184128fa03e4 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jun 29 03:18:49 devstack cinder-volume[93186]: WARNING cinder.volume.drivers.quobyte [None req-10f6ac95-7d19-419d-ac59-184128fa03e4 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] target_protocol = iscsi {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:49 devstack cinder-volume[93186]: DEBUG oslo_concurrency.processutils [None req-10f6ac95-7d19-419d-ac59-184128fa03e4 None None] Running cmd (subprocess): mount.quobyte {{(pid=93186) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] target_secondary_ip_addresses = [] {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] trace_flags = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] transfer_api_class = cinder.transfer.api.API {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] transport_url = **** {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] until_refresh = 0 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] use_chap_auth = False {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] use_default_quota_class = True {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] use_journal = False {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] use_json = False {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] use_multipath_for_image_xfer = False {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] use_stderr = False {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] use_syslog = False {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] verify_glance_signatures = enabled {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] volume_api_class = cinder.volume.api.API {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] volume_backend_name = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] volume_clear = zero {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] volume_clear_ionice = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] volume_clear_size = 0 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] volume_copy_bps_limit = 0 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] volume_dd_blocksize = 1M {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] volume_name_template = volume-%s {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] volume_service_inithost_offload = False {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] volume_usage_audit_period = month {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] zoning_mode = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] oslo_concurrency.disable_process_locking = False {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] os_brick.lightos_discovery_client_address = localhost {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] os_brick.wait_mpath_device_interval = 1 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] keystone_authtoken.auth_section = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] keystone_authtoken.auth_type = password {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] keystone_authtoken.auth_version = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] keystone_authtoken.cache = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] keystone_authtoken.certfile = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] keystone_authtoken.delay_auth_decision = False {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] keystone_authtoken.http_connect_timeout = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] keystone_authtoken.include_service_catalog = True {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] keystone_authtoken.insecure = False {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] keystone_authtoken.interface = public {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] keystone_authtoken.keyfile = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] keystone_authtoken.memcache_password = {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] keystone_authtoken.memcache_secret_key = **** {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] keystone_authtoken.memcache_security_strategy = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] keystone_authtoken.memcache_username = {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] keystone_authtoken.region_name = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] keystone_authtoken.service_token_roles_required = True {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] keystone_authtoken.service_type = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] keystone_authtoken.token_cache_time = 300 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.201/identity {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] cache.backend = dogpile.cache.null {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] cache.backend_argument = **** {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] cache.backend_expiration_time = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] cache.config_prefix = cache.oslo {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] cache.debug_cache_backend = False {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] cache.enable_retry_client = False {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] cache.enable_socket_keepalive = False {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] cache.enabled = False {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] cache.expiration_time = 600 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] cache.hashclient_dead_timeout = 60.0 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] cache.hashclient_retry_attempts = 2 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] cache.hashclient_retry_timeout = 1.0 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] cache.memcache_dead_retry = 300 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] cache.memcache_pool_maxsize = 10 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] cache.memcache_pool_unused_timeout = 60 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] cache.memcache_sasl_enabled = False {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] cache.memcache_servers = ['localhost:11211'] {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] cache.password = **** {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] cache.proxies = [] {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] cache.redis_db = 0 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] cache.redis_sentinel_service_name = mymaster {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] cache.redis_server = localhost:6379 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] cache.retry_attempts = 2 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] cache.retry_delay = 0.0 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] cache.socket_keepalive_count = 1 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] cache.socket_keepalive_idle = 1 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] cache.socket_keepalive_interval = 1 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] cache.socket_timeout = 1.0 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] cache.tls_allowed_ciphers = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] cache.tls_cafile = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] cache.tls_certfile = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] cache.tls_enabled = False {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] cache.tls_keyfile = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] cache.username = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] coordination.backend_url = **** {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] database.asyncio_connection = **** {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] database.asyncio_slave_connection = **** {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] database.backend = sqlalchemy {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] database.connection = **** {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] database.connection_debug = 0 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] database.connection_parameters = {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] database.connection_recycle_time = 3600 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] database.connection_trace = False {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] database.db_inc_retry_interval = True {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] database.db_max_retries = 20 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] database.db_max_retry_interval = 10 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] database.db_retry_interval = 1 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] database.max_overflow = 50 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] database.max_pool_size = 5 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] database.max_retries = 10 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] database.mysql_sql_mode = TRADITIONAL {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] database.mysql_wsrep_sync_wait = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] database.pool_timeout = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] database.retry_interval = 10 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] database.slave_connection = **** {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] database.sqlite_synchronous = True {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] database.synchronous_reader = True {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] database.use_db_reconnect = False {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] oslo_messaging_metrics.metrics_process_name = {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] profiler.connection_string = messaging:// {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] profiler.enabled = False {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] profiler.es_doc_type = notification {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] profiler.es_scroll_size = 10000 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] profiler.es_scroll_time = 2m {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] profiler.filter_error_trace = False {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] profiler.hmac_keys = **** {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] profiler.sentinel_service_name = mymaster {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] profiler.socket_timeout = 0.1 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] profiler.trace_requests = False {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] profiler.trace_sqlalchemy = False {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] profiler_jaeger.process_tags = {} {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] profiler_jaeger.service_name_prefix = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] profiler_otlp.service_name_prefix = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] oslo_policy.enforce_new_defaults = False {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: WARNING oslo_config.cfg [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] oslo_policy.enforce_scope = False {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] oslo_policy.policy_default_rule = default {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] oslo_policy.policy_file = policy.yaml {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] oslo_policy.remote_timeout = 60.0 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] privsep_osbrick.capabilities = [21, 2] {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] privsep_osbrick.group = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] privsep_osbrick.helper_command = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] privsep_osbrick.log_daemon_traceback = False {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] privsep_osbrick.thread_pool_size = 4 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] privsep_osbrick.user = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] cinder_sys_admin.group = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] cinder_sys_admin.helper_command = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] cinder_sys_admin.user = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] service_user.auth_section = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] service_user.auth_type = password {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] service_user.cafile = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] service_user.certfile = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] service_user.collect_timing = False {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] service_user.insecure = False {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] service_user.keyfile = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] service_user.send_service_user_token = True {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] service_user.split_loggers = False {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] service_user.timeout = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] glance.auth_section = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] glance.auth_type = password {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] glance.certfile = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] glance.collect_timing = False {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] glance.insecure = False {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] glance.keyfile = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] glance.region_name = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] glance.split_loggers = False {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] glance.timeout = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] backend_defaults.backend_availability_zone = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] backend_defaults.chap_password = **** {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] backend_defaults.chap_username = {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] backend_defaults.disk_geometry = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] backend_defaults.driver_client_cert = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] backend_defaults.driver_client_cert_key = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] backend_defaults.driver_data_namespace = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] backend_defaults.driver_ssl_cert_path = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] backend_defaults.driver_use_ssl = False {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] backend_defaults.enable_unsupported_driver = False {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] backend_defaults.extra_capabilities = {} {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] backend_defaults.filter_function = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] backend_defaults.goodness_function = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] backend_defaults.image_volume_cache_enabled = False {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] backend_defaults.iscsi_target_flags = {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] backend_defaults.iscsi_write_cache = on {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] backend_defaults.iser_helper = tgtadm {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] backend_defaults.iser_ip_address = 192.168.122.201 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] backend_defaults.iser_port = 3260 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] backend_defaults.nas_host = {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] backend_defaults.nas_login = admin {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] backend_defaults.nas_mount_options = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] backend_defaults.nas_password = **** {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] backend_defaults.nas_private_key = {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] backend_defaults.nas_secure_file_operations = auto {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] backend_defaults.nas_share_path = {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] backend_defaults.nas_ssh_port = 22 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] backend_defaults.nas_volume_prov_type = thin {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] backend_defaults.num_shell_tries = 3 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] backend_defaults.nvmet_ns_id = 10 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] backend_defaults.nvmet_port_id = 1 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] backend_defaults.quobyte_client_cfg = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] backend_defaults.quobyte_volume_url = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] backend_defaults.replication_device = **** {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] backend_defaults.report_discard_supported = False {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] backend_defaults.reserved_percentage = 0 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] backend_defaults.scst_target_driver = iscsi {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] backend_defaults.scst_target_iqn_name = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] backend_defaults.storage_protocol = iSCSI {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] backend_defaults.target_helper = tgtadm {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] backend_defaults.target_ip_address = 192.168.122.201 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] backend_defaults.target_port = 3260 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] backend_defaults.target_protocol = iscsi {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] backend_defaults.trace_flags = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] backend_defaults.unique_fqdn_network = True {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] backend_defaults.use_chap_auth = False {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] backend_defaults.volume_backend_name = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] backend_defaults.volume_clear = zero {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] backend_defaults.volume_clear_ionice = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] backend_defaults.volume_clear_size = 0 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] oslo_reports.file_event_handler = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] oslo_reports.file_event_handler_interval = 1 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] oslo_reports.log_dir = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] QuobyteHD.backend_availability_zone = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] QuobyteHD.backend_host = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] QuobyteHD.chap_password = **** {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] QuobyteHD.chap_username = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] QuobyteHD.chiscsi_conf = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] QuobyteHD.disk_geometry = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] QuobyteHD.driver_client_cert = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] QuobyteHD.driver_client_cert_key = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] QuobyteHD.driver_data_namespace = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] QuobyteHD.driver_use_ssl = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] QuobyteHD.enable_unsupported_driver = True {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] QuobyteHD.extra_capabilities = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] QuobyteHD.filter_function = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] QuobyteHD.goodness_function = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack quobyte-client[93191]: Reading configuration file: /etc/quobyte/client.cfg Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] QuobyteHD.iscsi_target_flags = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] QuobyteHD.iscsi_write_cache = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] QuobyteHD.iser_helper = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] QuobyteHD.iser_ip_address = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack quobyte-client[93191]: Invalid parameters found, error: missing mount point. Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] QuobyteHD.iser_port = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] QuobyteHD.iser_target_prefix = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] QuobyteHD.nas_host = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] QuobyteHD.nas_login = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] QuobyteHD.nas_mount_options = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] QuobyteHD.nas_password = **** {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack quobyte-client[93191]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] QuobyteHD.nas_private_key = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] QuobyteHD.nas_secure_file_operations = false {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] QuobyteHD.nas_share_path = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] QuobyteHD.nas_ssh_port = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] QuobyteHD.nas_volume_prov_type = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] QuobyteHD.num_iser_scan_tries = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack quobyte-client[93191]: Failed to parse all commandline parameters, please use -h/--help to see available options. Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] QuobyteHD.num_shell_tries = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] QuobyteHD.nvmet_ns_id = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] QuobyteHD.nvmet_port_id = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] QuobyteHD.replication_device = **** {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] QuobyteHD.report_discard_supported = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] QuobyteHD.reserved_percentage = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] QuobyteHD.scst_target_driver = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] QuobyteHD.scst_target_iqn_name = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] QuobyteHD.storage_protocol = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] QuobyteHD.target_helper = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] QuobyteHD.target_ip_address = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] QuobyteHD.target_port = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] QuobyteHD.target_prefix = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] QuobyteHD.target_protocol = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] QuobyteHD.trace_flags = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] QuobyteHD.unique_fqdn_network = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] QuobyteHD.use_chap_auth = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] QuobyteHD.volume_clear = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] QuobyteHD.volume_clear_ionice = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] QuobyteHD.volume_clear_size = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] QuobyteHD.volume_dd_blocksize = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] QuobyteHD.volumes_dir = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] oslo_messaging_rabbit.hostname = devstack {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[93186]: DEBUG oslo_concurrency.processutils [None req-10f6ac95-7d19-419d-ac59-184128fa03e4 None None] CMD "mount.quobyte" returned: 1 in 0.146s {{(pid=93186) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[93186]: DEBUG oslo_concurrency.lockutils [None req-10f6ac95-7d19-419d-ac59-184128fa03e4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93186) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[93186]: DEBUG oslo_concurrency.lockutils [None req-10f6ac95-7d19-419d-ac59-184128fa03e4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93186) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:18:49 devstack cinder-volume[93186]: DEBUG cinder.volume.drivers.quobyte [None req-10f6ac95-7d19-419d-ac59-184128fa03e4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93186) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] oslo_messaging_rabbit.ssl = False {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[93186]: INFO cinder.volume.drivers.quobyte [None req-10f6ac95-7d19-419d-ac59-184128fa03e4 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f ... Jun 29 03:18:49 devstack cinder-volume[93186]: DEBUG oslo_concurrency.processutils [None req-10f6ac95-7d19-419d-ac59-184128fa03e4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf -c /etc/quobyte/client-cinder.cfg {{(pid=93186) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] oslo_messaging_rabbit.ssl_version = {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] oslo_messaging_notifications.driver = [] {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] oslo_messaging_notifications.retry = -1 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] oslo_messaging_notifications.transport_url = **** {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] key_manager.fixed_key = **** {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] barbican.barbican_api_version = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] barbican.barbican_endpoint = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] barbican.barbican_endpoint_type = public {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] barbican.barbican_region_name = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] barbican.cafile = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] barbican.certfile = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] barbican.collect_timing = False {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] barbican.insecure = False {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] barbican.keyfile = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] barbican.number_of_retries = 60 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] barbican.retry_delay = 1 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] barbican.send_service_user_token = False {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] barbican.split_loggers = False {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] barbican.timeout = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] barbican.verify_ssl = True {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] barbican.verify_ssl_path = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] barbican_service_user.auth_section = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] barbican_service_user.auth_type = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] barbican_service_user.cafile = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] barbican_service_user.certfile = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] barbican_service_user.collect_timing = False {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] barbican_service_user.insecure = False {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] barbican_service_user.keyfile = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] barbican_service_user.split_loggers = False {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] barbican_service_user.timeout = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] vault.approle_role_id = **** {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] vault.approle_secret_id = **** {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] vault.kv_mountpoint = secret {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] vault.kv_path = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] vault.kv_version = 2 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] vault.namespace = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] vault.root_token_id = **** {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] vault.ssl_ca_crt_file = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] vault.timeout = 60.0 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] vault.use_ssl = False {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:49 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] ******************************************************************************** {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jun 29 03:18:49 devstack sudo[93192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf -c /etc/quobyte/client-cinder.cfg Jun 29 03:18:49 devstack sudo[93192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:18:50 devstack sudo[93192]: pam_unix(sudo:session): session closed for user root Jun 29 03:18:50 devstack cinder-volume[93186]: DEBUG oslo_concurrency.processutils [None req-10f6ac95-7d19-419d-ac59-184128fa03e4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.825s {{(pid=93186) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:18:50 devstack cinder-volume[93186]: INFO cinder.volume.drivers.quobyte [None req-10f6ac95-7d19-419d-ac59-184128fa03e4 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f succeeded Jun 29 03:18:50 devstack cinder-volume[93186]: DEBUG cinder.volume.drivers.quobyte [None req-10f6ac95-7d19-419d-ac59-184128fa03e4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93186) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:18:50 devstack cinder-volume[93186]: DEBUG oslo_concurrency.lockutils [None req-10f6ac95-7d19-419d-ac59-184128fa03e4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.843s {{(pid=93186) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:18:50 devstack cinder-volume[93186]: DEBUG oslo_concurrency.processutils [None req-10f6ac95-7d19-419d-ac59-184128fa03e4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf {{(pid=93186) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:18:50 devstack sudo[93262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf Jun 29 03:18:50 devstack sudo[93262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:18:51 devstack sudo[93262]: pam_unix(sudo:session): session closed for user root Jun 29 03:18:51 devstack cinder-volume[93186]: DEBUG oslo_concurrency.processutils [None req-10f6ac95-7d19-419d-ac59-184128fa03e4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf" returned: 0 in 0.685s {{(pid=93186) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:18:51 devstack cinder-volume[93186]: INFO cinder.volume.driver [None req-10f6ac95-7d19-419d-ac59-184128fa03e4 None None] Driver hasn't implemented _init_vendor_properties() Jun 29 03:18:51 devstack cinder-volume[93186]: DEBUG cinder.volume.driver [None req-10f6ac95-7d19-419d-ac59-184128fa03e4 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.600440979004, 'free_capacity_gb': 1775.600440979004, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=93186) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jun 29 03:18:51 devstack cinder-volume[93186]: DEBUG oslo_db.sqlalchemy.engines [None req-10f6ac95-7d19-419d-ac59-184128fa03e4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93186) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 29 03:18:51 devstack cinder-volume[93186]: DEBUG dbcounter [-] [93186] Writer thread running {{(pid=93186) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 29 03:18:51 devstack cinder-volume[93186]: DEBUG cinder.db.api [None req-10f6ac95-7d19-419d-ac59-184128fa03e4 None None] Building query based on filter {{(pid=93186) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jun 29 03:18:51 devstack cinder-volume[93186]: DEBUG cinder.image.image_utils [None req-10f6ac95-7d19-419d-ac59-184128fa03e4 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=93186) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jun 29 03:18:51 devstack cinder-volume[93186]: INFO cinder.keymgr.migration [None req-c9b50f2d-7583-4cfa-8ff5-11fdf63f0ce2 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jun 29 03:18:51 devstack cinder-volume[93186]: DEBUG oslo_concurrency.lockutils [None req-10f6ac95-7d19-419d-ac59-184128fa03e4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93186) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:18:51 devstack cinder-volume[93186]: DEBUG oslo_concurrency.lockutils [None req-10f6ac95-7d19-419d-ac59-184128fa03e4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93186) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:18:51 devstack cinder-volume[93186]: DEBUG cinder.volume.drivers.quobyte [None req-10f6ac95-7d19-419d-ac59-184128fa03e4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93186) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:18:51 devstack cinder-volume[93186]: DEBUG cinder.volume.drivers.quobyte [None req-10f6ac95-7d19-419d-ac59-184128fa03e4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93186) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:18:51 devstack cinder-volume[93186]: DEBUG oslo_concurrency.lockutils [None req-10f6ac95-7d19-419d-ac59-184128fa03e4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93186) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:18:51 devstack cinder-volume[93186]: DEBUG oslo_concurrency.processutils [None req-10f6ac95-7d19-419d-ac59-184128fa03e4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf {{(pid=93186) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:18:51 devstack sudo[93291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf Jun 29 03:18:51 devstack sudo[93291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:18:52 devstack sudo[93291]: pam_unix(sudo:session): session closed for user root Jun 29 03:18:52 devstack cinder-volume[93186]: DEBUG oslo_concurrency.processutils [None req-10f6ac95-7d19-419d-ac59-184128fa03e4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf" returned: 0 in 0.937s {{(pid=93186) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:18:52 devstack cinder-volume[93186]: DEBUG cinder.manager [None req-10f6ac95-7d19-419d-ac59-184128fa03e4 None None] Notifying Schedulers of capabilities ... {{(pid=93186) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:18:52 devstack cinder-volume[93186]: INFO cinder.volume.manager [None req-10f6ac95-7d19-419d-ac59-184128fa03e4 None None] Driver initialization completed successfully. Jun 29 03:18:52 devstack cinder-volume[93186]: INFO cinder.manager [None req-10f6ac95-7d19-419d-ac59-184128fa03e4 None None] Initiating service 3 cleanup Jun 29 03:18:52 devstack cinder-volume[93186]: INFO cinder.manager [None req-10f6ac95-7d19-419d-ac59-184128fa03e4 None None] Service 3 cleanup completed. Jun 29 03:18:52 devstack cinder-volume[93186]: DEBUG cinder.service [None req-10f6ac95-7d19-419d-ac59-184128fa03e4 None None] Creating RPC server for service cinder-volume {{(pid=93186) start /opt/stack/cinder/cinder/service.py:231}} Jun 29 03:18:52 devstack cinder-volume[93186]: DEBUG cinder.service [None req-10f6ac95-7d19-419d-ac59-184128fa03e4 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=93186) start /opt/stack/cinder/cinder/service.py:237}} Jun 29 03:18:52 devstack cinder-volume[93186]: INFO cinder.volume.manager [None req-10f6ac95-7d19-419d-ac59-184128fa03e4 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jun 29 03:18:52 devstack cinder-volume[93186]: DEBUG oslo_concurrency.lockutils [None req-10f6ac95-7d19-419d-ac59-184128fa03e4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93186) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:18:52 devstack cinder-volume[93186]: DEBUG oslo_concurrency.lockutils [None req-10f6ac95-7d19-419d-ac59-184128fa03e4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93186) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:18:52 devstack cinder-volume[93186]: DEBUG cinder.volume.drivers.quobyte [None req-10f6ac95-7d19-419d-ac59-184128fa03e4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93186) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:18:52 devstack cinder-volume[93186]: DEBUG cinder.volume.drivers.quobyte [None req-10f6ac95-7d19-419d-ac59-184128fa03e4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93186) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:18:52 devstack cinder-volume[93186]: DEBUG oslo_concurrency.lockutils [None req-10f6ac95-7d19-419d-ac59-184128fa03e4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=93186) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:18:52 devstack cinder-volume[93186]: DEBUG oslo_concurrency.processutils [None req-10f6ac95-7d19-419d-ac59-184128fa03e4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf {{(pid=93186) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:18:52 devstack sudo[93385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf Jun 29 03:18:52 devstack sudo[93385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:18:53 devstack sudo[93385]: pam_unix(sudo:session): session closed for user root Jun 29 03:18:53 devstack cinder-volume[93186]: DEBUG oslo_concurrency.processutils [None req-10f6ac95-7d19-419d-ac59-184128fa03e4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf" returned: 0 in 1.336s {{(pid=93186) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:18:53 devstack cinder-volume[93186]: INFO cinder.volume.manager [None req-10f6ac95-7d19-419d-ac59-184128fa03e4 None None] Driver post RPC initialization completed successfully. Jun 29 03:18:53 devstack cinder-volume[92972]: INFO oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] Caught SIGTERM, stopping children Jun 29 03:18:53 devstack cinder-volume[92972]: DEBUG oslo_concurrency.lockutils [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] Acquiring lock "singleton_lock" {{(pid=92972) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 29 03:18:53 devstack cinder-volume[92972]: DEBUG oslo_concurrency.lockutils [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] Acquired lock "singleton_lock" {{(pid=92972) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 29 03:18:53 devstack cinder-volume[92972]: DEBUG oslo_concurrency.lockutils [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] Releasing lock "singleton_lock" {{(pid=92972) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 29 03:18:53 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] Stop services. {{(pid=92972) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jun 29 03:18:53 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] Killing children. {{(pid=92972) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jun 29 03:18:53 devstack cinder-volume[92972]: INFO oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] Waiting on 1 children to exit Jun 29 03:18:54 devstack cinder-volume[93186]: DEBUG oslo_concurrency.lockutils [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] Acquiring lock "singleton_lock" {{(pid=93186) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 29 03:18:54 devstack cinder-volume[93186]: DEBUG oslo_concurrency.lockutils [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] Acquired lock "singleton_lock" {{(pid=93186) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 29 03:18:54 devstack cinder-volume[93186]: DEBUG oslo_concurrency.lockutils [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] Releasing lock "singleton_lock" {{(pid=93186) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 29 03:18:54 devstack cinder-volume[93186]: WARNING amqp [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] Received method (60, 30) during closing channel 1. This method will be ignored Jun 29 03:18:54 devstack cinder-volume[93186]: WARNING amqp [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] Received method (60, 30) during closing channel 1. This method will be ignored Jun 29 03:18:54 devstack cinder-volume[92972]: INFO oslo_service.backend._eventlet.service [None req-6a49403c-15f9-45af-9ad6-e608c8c748bd None None] Child 93186 exited with status 0 Jun 29 03:18:55 devstack cinder-volume[93456]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jun 29 03:18:55 devstack cinder-volume[93456]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jun 29 03:18:55 devstack cinder-volume[93456]: we strongly recommend against using it for new projects. Jun 29 03:18:55 devstack cinder-volume[93456]: If you are already using Eventlet, we recommend migrating to a different Jun 29 03:18:55 devstack cinder-volume[93456]: framework. For more detail see Jun 29 03:18:55 devstack cinder-volume[93456]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jun 29 03:18:55 devstack cinder-volume[93456]: import eventlet # noqa Jun 29 03:18:57 devstack cinder-volume[93456]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=93456) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 29 03:18:57 devstack cinder-volume[93456]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=93456) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 29 03:18:57 devstack cinder-volume[93456]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=93456) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 29 03:18:57 devstack cinder-volume[93456]: INFO dbcounter [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] Registered counter for database cinder Jun 29 03:18:57 devstack cinder-volume[93456]: DEBUG oslo_db.sqlalchemy.engines [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93456) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG dbcounter [-] [93456] Writer thread running {{(pid=93456) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 29 03:18:58 devstack cinder-volume[93456]: INFO cinder.rpc [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jun 29 03:18:58 devstack cinder-volume[93456]: INFO cinder.rpc [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_db.sqlalchemy.engines [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93456) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 29 03:18:58 devstack cinder-volume[93456]: INFO cinder.volume.manager [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] Determined volume DB was empty at startup. Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG cinder.volume.manager [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=93456) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jun 29 03:18:58 devstack cinder-volume[93456]: WARNING stevedore.named [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jun 29 03:18:58 devstack cinder-volume[93456]: WARNING castellan.key_manager [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 29 03:18:58 devstack cinder-volume[93456]: WARNING cinder.keymgr.conf_key_mgr [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 29 03:18:58 devstack cinder-volume[93456]: INFO cinder.volume.manager [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] Image-volume cache disabled for host devstack@QuobyteHD. Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_db.sqlalchemy.engines [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93456) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 29 03:18:58 devstack cinder-volume[93456]: INFO oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] Starting 1 workers Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] Started child 93468 {{(pid=93456) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] Full set of CONF: {{(pid=93456) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] ******************************************************************************** {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jun 29 03:18:58 devstack cinder-volume[93468]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] Configuration options gathered from: {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] ================================================================================ {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] allow_availability_zone_fallback = False {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] allow_compression_on_image_upload = False {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] allowed_direct_url_schemes = [] {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] api_rate_limit = True {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] auth_strategy = keystone {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] backend_availability_zone = None {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] backend_host = None {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] backend_stats_polling_interval = 60 {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] backup_api_class = cinder.backup.api.API {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] backup_name_template = backup-%s {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] backup_use_same_host = False {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] backup_use_temp_snapshot = False {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] chap_password = **** {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] chap_username = {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] cinder_internal_tenant_project_id = 56ade22bead1432aba8310729674884e {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] cinder_internal_tenant_user_id = 19d2196238ab40308b0a0e03860b214a {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] cluster = None {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] compression_format = gzip {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] compute_api_class = cinder.compute.nova.API {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] config_dir = [] {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] config_source = [] {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] control_exchange = openstack {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] debug = True {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] default_availability_zone = None {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] default_group_type = None {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] default_volume_type = QuobyteHD {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] disk_geometry = None {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] driver_client_cert = None {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] driver_client_cert_key = None {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] driver_data_namespace = None {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] driver_ssl_cert_path = None {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] driver_ssl_cert_verify = False {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] driver_use_ssl = False {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] enable_new_services = True {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] enable_unsupported_driver = False {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] enabled_backends = ['QuobyteHD'] {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] enforce_multipath_for_image_xfer = False {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] filter_function = None {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] glance_api_insecure = False {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] glance_api_servers = ['http://192.168.122.201/image'] {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] glance_api_ssl_compression = False {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] glance_ca_certificates_file = None {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] glance_catalog_info = image:glance:publicURL {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] glance_certfile = None {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] glance_keyfile = None {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] glance_num_retries = 3 {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] glance_request_timeout = None {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] goodness_function = None {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] graceful_shutdown_timeout = 5 {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] group_api_class = cinder.group.api.API {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] host = devstack {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] image_compress_on_upload = True {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] image_conversion_address_space_limit = 1 {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] image_conversion_cpu_limit = 60 {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] image_conversion_disable = False {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] image_upload_use_cinder_backend = False {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] image_upload_use_internal_tenant = False {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] image_volume_cache_enabled = False {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] image_volume_cache_max_count = 0 {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] image_volume_cache_max_size_gb = 0 {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] init_host_max_objects_retrieval = 0 {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] instance_format = [instance: %(uuid)s] {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] iscsi_target_flags = {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] iscsi_write_cache = on {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] iser_helper = tgtadm {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] iser_ip_address = 192.168.122.201 {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] iser_port = 3260 {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] log_color = False {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] log_config_append = None {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] log_dir = None {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] log_file = None {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] log_options = True {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] log_rotate_interval = 1 {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] log_rotate_interval_type = days {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] log_rotation_type = none {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] max_age = 0 {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] max_logfile_count = 30 {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] max_logfile_size_mb = 200 {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] max_over_subscription_ratio = 20.0 {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] message_reap_interval = 86400 {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] message_ttl = 2592000 {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] migration_create_volume_timeout_secs = 300 {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:58 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-496abc7d-df7f-4102-95b7-1e3642374ec5 None None] Starting volume driver QuobyteDriver (1.1.14) Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] monkey_patch = False {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:58 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-496abc7d-df7f-4102-95b7-1e3642374ec5 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=93468) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] monkey_patch_modules = [] {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] my_ip = 192.168.122.201 {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] no_snapshot_gb_quota = False {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] num_iser_scan_tries = 3 {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] num_shell_tries = 3 {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] num_volume_device_scan_tries = 3 {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] nvmeof_conn_info_version = 1 {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] nvmet_ns_id = 10 {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] nvmet_port_id = 1 {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] osapi_max_limit = 1000 {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] osapi_volume_ext_list = [] {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] osapi_volume_listen = 0.0.0.0 {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] osapi_volume_listen_port = 8776 {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] osapi_volume_use_ssl = False {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] osapi_volume_workers = None {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] per_volume_size_limit = -1 {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] periodic_fuzzy_delay = 60 {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] periodic_interval = 60 {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] project_id_regex = [0-9a-f\-]+ {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] public_endpoint = None {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] publish_errors = False {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] quota_backup_gigabytes = 1000 {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] quota_backups = 10 {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] quota_gigabytes = 1000 {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] quota_groups = 10 {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] quota_snapshots = 10 {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] quota_volumes = 10 {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] rate_limit_burst = 0 {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] rate_limit_except_level = CRITICAL {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] rate_limit_interval = 0 {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] reinit_driver_count = 3 {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] replication_device = **** {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] report_discard_supported = False {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] report_interval = 120 {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] reservation_clean_interval = 86400 {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] reservation_expire = 86400 {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] reserved_image_namespaces = [] {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] reserved_percentage = 0 {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] rpc_response_timeout = 120 {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] run_external_periodic_tasks = True {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] scst_target_driver = iscsi {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] scst_target_iqn_name = None {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] service_down_time = 720 {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] shell_completion = None {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] snapshot_name_template = snapshot-%s {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] split_loggers = False {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] state_path = /opt/stack/data/cinder {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] storage_availability_zone = nova {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] storage_protocol = iSCSI {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] syslog_log_facility = LOG_USER {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] target_helper = lioadm {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] target_ip_address = 192.168.122.201 {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] target_port = 3260 {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] target_protocol = iscsi {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] target_secondary_ip_addresses = [] {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] trace_flags = None {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] transfer_api_class = cinder.transfer.api.API {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] transport_url = **** {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] until_refresh = 0 {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] use_chap_auth = False {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] use_default_quota_class = True {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] use_journal = False {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] use_json = False {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] use_multipath_for_image_xfer = False {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] use_stderr = False {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] use_syslog = False {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] verify_glance_signatures = enabled {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] volume_api_class = cinder.volume.api.API {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] volume_backend_name = None {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] volume_clear = zero {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] volume_clear_ionice = None {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] volume_clear_size = 0 {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] volume_copy_bps_limit = 0 {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] volume_dd_blocksize = 1M {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] volume_name_template = volume-%s {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] volume_service_inithost_offload = False {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] volume_usage_audit_period = month {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] zoning_mode = None {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] oslo_concurrency.disable_process_locking = False {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] keystone_authtoken.auth_section = None {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] keystone_authtoken.auth_type = password {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] keystone_authtoken.auth_version = None {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] keystone_authtoken.cache = None {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] keystone_authtoken.certfile = None {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] keystone_authtoken.delay_auth_decision = False {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] keystone_authtoken.http_connect_timeout = None {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] keystone_authtoken.include_service_catalog = True {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] keystone_authtoken.insecure = False {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] keystone_authtoken.interface = public {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] keystone_authtoken.keyfile = None {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] keystone_authtoken.memcache_password = {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] keystone_authtoken.memcache_username = {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] keystone_authtoken.region_name = None {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] keystone_authtoken.service_token_roles_required = True {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] keystone_authtoken.service_type = None {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] keystone_authtoken.token_cache_time = 300 {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.201/identity {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] cache.backend = dogpile.cache.null {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] cache.backend_argument = **** {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] cache.backend_expiration_time = None {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] cache.config_prefix = cache.oslo {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] cache.debug_cache_backend = False {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] cache.enable_retry_client = False {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] cache.enable_socket_keepalive = False {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] cache.enabled = False {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] cache.expiration_time = 600 {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] cache.hashclient_retry_attempts = 2 {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] cache.memcache_dead_retry = 300 {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] cache.memcache_pool_maxsize = 10 {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] cache.memcache_sasl_enabled = False {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] cache.password = **** {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] cache.proxies = [] {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] cache.redis_db = 0 {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] cache.redis_sentinel_service_name = mymaster {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] cache.redis_server = localhost:6379 {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] cache.retry_attempts = 2 {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] cache.retry_delay = 0.0 {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] cache.socket_keepalive_count = 1 {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] cache.socket_keepalive_idle = 1 {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] cache.socket_keepalive_interval = 1 {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] cache.socket_timeout = 1.0 {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] cache.tls_allowed_ciphers = None {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] cache.tls_cafile = None {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] cache.tls_certfile = None {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] cache.tls_enabled = False {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] cache.tls_keyfile = None {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] cache.username = None {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] coordination.backend_url = **** {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] database.asyncio_connection = **** {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] database.asyncio_slave_connection = **** {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] database.backend = sqlalchemy {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] database.connection = **** {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] database.connection_debug = 0 {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] database.connection_parameters = {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] database.connection_recycle_time = 3600 {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] database.connection_trace = False {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] database.db_inc_retry_interval = True {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] database.db_max_retries = 20 {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] database.db_max_retry_interval = 10 {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] database.db_retry_interval = 1 {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] database.max_overflow = 50 {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] database.max_pool_size = 5 {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] database.max_retries = 10 {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] database.mysql_wsrep_sync_wait = None {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] database.pool_timeout = None {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] database.retry_interval = 10 {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] database.slave_connection = **** {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] database.sqlite_synchronous = True {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] database.synchronous_reader = True {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] database.use_db_reconnect = False {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] profiler.connection_string = messaging:// {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] profiler.enabled = False {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] profiler.es_doc_type = notification {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] profiler.es_scroll_size = 10000 {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] profiler.es_scroll_time = 2m {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] profiler.filter_error_trace = False {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] profiler.hmac_keys = **** {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] profiler.sentinel_service_name = mymaster {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-496abc7d-df7f-4102-95b7-1e3642374ec5 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=93468) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jun 29 03:18:58 devstack cinder-volume[93468]: WARNING cinder.volume.drivers.quobyte [None req-496abc7d-df7f-4102-95b7-1e3642374ec5 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] profiler.socket_timeout = 0.1 {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93468]: WARNING cinder.volume.drivers.quobyte [None req-496abc7d-df7f-4102-95b7-1e3642374ec5 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] profiler.trace_requests = False {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] profiler.trace_sqlalchemy = False {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] profiler_jaeger.process_tags = {} {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] profiler_jaeger.service_name_prefix = None {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] profiler_otlp.service_name_prefix = None {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-496abc7d-df7f-4102-95b7-1e3642374ec5 None None] Running cmd (subprocess): mount.quobyte {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] oslo_policy.enforce_new_defaults = False {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: WARNING oslo_config.cfg [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] oslo_policy.enforce_scope = False {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] oslo_policy.policy_default_rule = default {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] oslo_policy.policy_file = policy.yaml {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] oslo_policy.remote_timeout = 60.0 {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] privsep_osbrick.group = None {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] privsep_osbrick.helper_command = None {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] privsep_osbrick.user = None {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] cinder_sys_admin.group = None {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] cinder_sys_admin.helper_command = None {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] cinder_sys_admin.user = None {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] service_user.auth_section = None {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] service_user.auth_type = password {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] service_user.cafile = None {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] service_user.certfile = None {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] service_user.collect_timing = False {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] service_user.insecure = False {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] service_user.keyfile = None {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] service_user.send_service_user_token = True {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] service_user.split_loggers = False {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] service_user.timeout = None {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] glance.auth_section = None {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] glance.auth_type = password {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] glance.certfile = None {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] glance.collect_timing = False {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] glance.insecure = False {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] glance.keyfile = None {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] glance.region_name = None {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] glance.split_loggers = False {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] glance.timeout = None {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] backend_defaults.backend_availability_zone = None {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] backend_defaults.chap_password = **** {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] backend_defaults.chap_username = {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] backend_defaults.disk_geometry = None {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] backend_defaults.driver_client_cert = None {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] backend_defaults.driver_client_cert_key = None {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] backend_defaults.driver_data_namespace = None {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] backend_defaults.driver_use_ssl = False {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] backend_defaults.enable_unsupported_driver = False {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] backend_defaults.extra_capabilities = {} {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] backend_defaults.filter_function = None {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] backend_defaults.goodness_function = None {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] backend_defaults.iscsi_target_flags = {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] backend_defaults.iscsi_write_cache = on {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] backend_defaults.iser_helper = tgtadm {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] backend_defaults.iser_ip_address = 192.168.122.201 {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] backend_defaults.iser_port = 3260 {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] backend_defaults.nas_host = {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] backend_defaults.nas_login = admin {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] backend_defaults.nas_mount_options = None {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] backend_defaults.nas_password = **** {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] backend_defaults.nas_private_key = {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] backend_defaults.nas_share_path = {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] backend_defaults.nas_ssh_port = 22 {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] backend_defaults.num_shell_tries = 3 {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] backend_defaults.nvmet_port_id = 1 {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] backend_defaults.quobyte_client_cfg = None {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] backend_defaults.quobyte_volume_url = None {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] backend_defaults.replication_device = **** {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] backend_defaults.report_discard_supported = False {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] backend_defaults.reserved_percentage = 0 {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] backend_defaults.scst_target_driver = iscsi {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] backend_defaults.scst_target_iqn_name = None {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] backend_defaults.storage_protocol = iSCSI {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] backend_defaults.target_helper = tgtadm {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] backend_defaults.target_ip_address = 192.168.122.201 {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] backend_defaults.target_port = 3260 {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] backend_defaults.target_protocol = iscsi {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] backend_defaults.trace_flags = None {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] backend_defaults.unique_fqdn_network = True {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] backend_defaults.use_chap_auth = False {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] backend_defaults.volume_backend_name = None {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] backend_defaults.volume_clear = zero {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] backend_defaults.volume_clear_ionice = None {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] backend_defaults.volume_clear_size = 0 {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] oslo_reports.file_event_handler = None {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] oslo_reports.log_dir = None {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] QuobyteHD.backend_availability_zone = None {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] QuobyteHD.backend_host = None {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] QuobyteHD.chap_password = **** {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] QuobyteHD.chap_username = None {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] QuobyteHD.chiscsi_conf = None {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] QuobyteHD.disk_geometry = None {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] QuobyteHD.driver_client_cert = None {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] QuobyteHD.driver_client_cert_key = None {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] QuobyteHD.driver_data_namespace = None {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] QuobyteHD.driver_use_ssl = None {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] QuobyteHD.extra_capabilities = None {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] QuobyteHD.filter_function = None {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] QuobyteHD.goodness_function = None {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] QuobyteHD.iscsi_target_flags = None {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] QuobyteHD.iscsi_write_cache = None {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] QuobyteHD.iser_helper = None {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] QuobyteHD.iser_ip_address = None {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] QuobyteHD.iser_port = None {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] QuobyteHD.iser_target_prefix = None {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] QuobyteHD.nas_host = None {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] QuobyteHD.nas_login = None {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] QuobyteHD.nas_mount_options = None {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] QuobyteHD.nas_password = **** {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] QuobyteHD.nas_private_key = None {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] QuobyteHD.nas_share_path = None {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] QuobyteHD.nas_ssh_port = None {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] QuobyteHD.num_shell_tries = None {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] QuobyteHD.nvmet_ns_id = None {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] QuobyteHD.nvmet_port_id = None {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] QuobyteHD.replication_device = **** {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] QuobyteHD.report_discard_supported = None {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] QuobyteHD.reserved_percentage = None {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] QuobyteHD.scst_target_driver = None {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] QuobyteHD.storage_protocol = None {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack quobyte-client[93469]: Reading configuration file: /etc/quobyte/client.cfg Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] QuobyteHD.target_helper = None {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] QuobyteHD.target_ip_address = None {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] QuobyteHD.target_port = None {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack quobyte-client[93469]: Invalid parameters found, error: missing mount point. Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] QuobyteHD.target_prefix = None {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] QuobyteHD.target_protocol = None {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] QuobyteHD.trace_flags = None {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] QuobyteHD.unique_fqdn_network = None {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack quobyte-client[93469]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] QuobyteHD.use_chap_auth = None {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack quobyte-client[93469]: Failed to parse all commandline parameters, please use -h/--help to see available options. Jun 29 03:18:58 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-496abc7d-df7f-4102-95b7-1e3642374ec5 None None] CMD "mount.quobyte" returned: 1 in 0.067s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-496abc7d-df7f-4102-95b7-1e3642374ec5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] QuobyteHD.volume_clear = None {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-496abc7d-df7f-4102-95b7-1e3642374ec5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] QuobyteHD.volume_clear_ionice = None {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-496abc7d-df7f-4102-95b7-1e3642374ec5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] QuobyteHD.volume_clear_size = None {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] QuobyteHD.volumes_dir = None {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-496abc7d-df7f-4102-95b7-1e3642374ec5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-496abc7d-df7f-4102-95b7-1e3642374ec5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-496abc7d-df7f-4102-95b7-1e3642374ec5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] oslo_messaging_rabbit.ssl = False {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] oslo_messaging_rabbit.ssl_version = {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] oslo_messaging_notifications.driver = [] {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] oslo_messaging_notifications.retry = -1 {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] oslo_messaging_notifications.transport_url = **** {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] key_manager.fixed_key = **** {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] barbican.barbican_api_version = None {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] barbican.barbican_endpoint = None {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] barbican.barbican_endpoint_type = public {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] barbican.barbican_region_name = None {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] barbican.cafile = None {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] barbican.certfile = None {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] barbican.collect_timing = False {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] barbican.insecure = False {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] barbican.keyfile = None {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] barbican.number_of_retries = 60 {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] barbican.retry_delay = 1 {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] barbican.send_service_user_token = False {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] barbican.split_loggers = False {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] barbican.timeout = None {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] barbican.verify_ssl = True {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] barbican.verify_ssl_path = None {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] barbican_service_user.auth_section = None {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] barbican_service_user.auth_type = None {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] barbican_service_user.cafile = None {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] barbican_service_user.certfile = None {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] barbican_service_user.collect_timing = False {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack sudo[93470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] barbican_service_user.insecure = False {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] barbican_service_user.keyfile = None {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] barbican_service_user.split_loggers = False {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] barbican_service_user.timeout = None {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] vault.approle_role_id = **** {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] vault.approle_secret_id = **** {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] vault.kv_mountpoint = secret {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack sudo[93470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] vault.kv_path = None {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] vault.kv_version = 2 {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] vault.namespace = None {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] vault.root_token_id = **** {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] vault.ssl_ca_crt_file = None {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] vault.timeout = 60.0 {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] vault.use_ssl = False {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 03:18:58 devstack cinder-volume[93456]: DEBUG oslo_service.backend._eventlet.service [None req-446620e0-dbdf-4d55-84b4-4666ba1a28d9 None None] ******************************************************************************** {{(pid=93456) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jun 29 03:18:59 devstack sudo[93470]: pam_unix(sudo:session): session closed for user root Jun 29 03:18:59 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-496abc7d-df7f-4102-95b7-1e3642374ec5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf" returned: 0 in 0.592s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:18:59 devstack cinder-volume[93468]: INFO cinder.volume.driver [None req-496abc7d-df7f-4102-95b7-1e3642374ec5 None None] Driver hasn't implemented _init_vendor_properties() Jun 29 03:18:59 devstack cinder-volume[93468]: DEBUG cinder.volume.driver [None req-496abc7d-df7f-4102-95b7-1e3642374ec5 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.668441772461, 'free_capacity_gb': 1775.668441772461, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=93468) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jun 29 03:18:59 devstack cinder-volume[93468]: DEBUG oslo_db.sqlalchemy.engines [None req-496abc7d-df7f-4102-95b7-1e3642374ec5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93468) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 29 03:18:59 devstack cinder-volume[93468]: DEBUG dbcounter [-] [93468] Writer thread running {{(pid=93468) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 29 03:18:59 devstack cinder-volume[93468]: DEBUG cinder.db.api [None req-496abc7d-df7f-4102-95b7-1e3642374ec5 None None] Building query based on filter {{(pid=93468) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jun 29 03:18:59 devstack cinder-volume[93468]: DEBUG cinder.image.image_utils [None req-496abc7d-df7f-4102-95b7-1e3642374ec5 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=93468) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jun 29 03:18:59 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-496abc7d-df7f-4102-95b7-1e3642374ec5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:18:59 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-496abc7d-df7f-4102-95b7-1e3642374ec5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:18:59 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-496abc7d-df7f-4102-95b7-1e3642374ec5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:18:59 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-496abc7d-df7f-4102-95b7-1e3642374ec5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:18:59 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-496abc7d-df7f-4102-95b7-1e3642374ec5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:18:59 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-496abc7d-df7f-4102-95b7-1e3642374ec5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:18:59 devstack cinder-volume[93468]: INFO cinder.keymgr.migration [None req-b140b6f2-0f32-4289-94f5-f6756af94849 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jun 29 03:18:59 devstack sudo[93486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf Jun 29 03:18:59 devstack sudo[93486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:19:00 devstack sudo[93486]: pam_unix(sudo:session): session closed for user root Jun 29 03:19:00 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-496abc7d-df7f-4102-95b7-1e3642374ec5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf" returned: 0 in 0.619s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:19:00 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-496abc7d-df7f-4102-95b7-1e3642374ec5 None None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:19:00 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-496abc7d-df7f-4102-95b7-1e3642374ec5 None None] Driver initialization completed successfully. Jun 29 03:19:00 devstack cinder-volume[93468]: INFO cinder.manager [None req-496abc7d-df7f-4102-95b7-1e3642374ec5 None None] Initiating service 3 cleanup Jun 29 03:19:00 devstack cinder-volume[93468]: INFO cinder.manager [None req-496abc7d-df7f-4102-95b7-1e3642374ec5 None None] Service 3 cleanup completed. Jun 29 03:19:00 devstack cinder-volume[93468]: DEBUG cinder.service [None req-496abc7d-df7f-4102-95b7-1e3642374ec5 None None] Creating RPC server for service cinder-volume {{(pid=93468) start /opt/stack/cinder/cinder/service.py:231}} Jun 29 03:19:00 devstack cinder-volume[93468]: DEBUG cinder.service [None req-496abc7d-df7f-4102-95b7-1e3642374ec5 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=93468) start /opt/stack/cinder/cinder/service.py:237}} Jun 29 03:19:00 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-496abc7d-df7f-4102-95b7-1e3642374ec5 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jun 29 03:19:00 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-496abc7d-df7f-4102-95b7-1e3642374ec5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:19:00 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-496abc7d-df7f-4102-95b7-1e3642374ec5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:19:00 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-496abc7d-df7f-4102-95b7-1e3642374ec5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:19:00 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-496abc7d-df7f-4102-95b7-1e3642374ec5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:19:00 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-496abc7d-df7f-4102-95b7-1e3642374ec5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:19:00 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-496abc7d-df7f-4102-95b7-1e3642374ec5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:19:00 devstack sudo[93506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf Jun 29 03:19:00 devstack sudo[93506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:19:00 devstack sudo[93506]: pam_unix(sudo:session): session closed for user root Jun 29 03:19:00 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-496abc7d-df7f-4102-95b7-1e3642374ec5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf" returned: 0 in 0.605s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:19:00 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-496abc7d-df7f-4102-95b7-1e3642374ec5 None None] Driver post RPC initialization completed successfully. Jun 29 03:19:08 devstack cinder-volume[93456]: DEBUG dbcounter [-] [93456] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=93456) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 29 03:19:10 devstack cinder-volume[93468]: DEBUG dbcounter [-] [93468] Writing DB stats cinder:SELECT=3 {{(pid=93468) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 29 03:19:10 devstack cinder-volume[93468]: DEBUG dbcounter [-] [93468] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=93468) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 29 03:19:11 devstack cinder-volume[93468]: DEBUG oslo_service.periodic_task [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Running periodic task VolumeManager._thread_info {{(pid=93468) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 29 03:19:11 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] thread count: 6 {{(pid=93468) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 29 03:19:11 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] thread info: [<_MainThread(MainThread, started 132331377287296)>, , , , , ] {{(pid=93468) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 29 03:20:11 devstack cinder-volume[93468]: DEBUG oslo_service.periodic_task [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93468) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 29 03:20:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:20:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:20:11 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:20:11 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:20:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:20:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:20:11 devstack sudo[93799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf Jun 29 03:20:11 devstack sudo[93799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:20:12 devstack sudo[93799]: pam_unix(sudo:session): session closed for user root Jun 29 03:20:12 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf" returned: 0 in 0.667s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:20:12 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:20:12 devstack cinder-volume[93468]: DEBUG oslo_service.periodic_task [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Running periodic task VolumeManager._thread_info {{(pid=93468) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 29 03:20:12 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] thread count: 6 {{(pid=93468) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 29 03:20:12 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] thread info: [<_MainThread(MainThread, started 132331377287296)>, , , , , ] {{(pid=93468) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 29 03:21:10 devstack cinder-volume[93468]: DEBUG dbcounter [-] [93468] Writing DB stats cinder:SELECT=1 {{(pid=93468) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 29 03:21:10 devstack cinder-volume[93468]: DEBUG dbcounter [-] [93468] Writing DB stats cinder:UPDATE=1 {{(pid=93468) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 29 03:21:11 devstack cinder-volume[93468]: DEBUG oslo_service.periodic_task [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93468) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 29 03:21:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:21:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:21:11 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:21:11 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:21:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:21:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:21:11 devstack sudo[94289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf Jun 29 03:21:11 devstack sudo[94289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:21:12 devstack sudo[94289]: pam_unix(sudo:session): session closed for user root Jun 29 03:21:12 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf" returned: 0 in 0.825s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:21:12 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:21:35 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-7844bbdb-8ac6-43b2-8ca9-285d021b4a5c tempest-DeleteServersTestJSON-1741860693 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:21:35 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-7844bbdb-8ac6-43b2-8ca9-285d021b4a5c tempest-DeleteServersTestJSON-1741860693 None] Flow 'volume_create_manager' (dcedac9a-76cb-40e1-b682-f9b7564d4193) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:21:35 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-7844bbdb-8ac6-43b2-8ca9-285d021b4a5c tempest-DeleteServersTestJSON-1741860693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0342cd06-d6a0-4090-b448-589e359a7736) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:21:35 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-7844bbdb-8ac6-43b2-8ca9-285d021b4a5c tempest-DeleteServersTestJSON-1741860693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0342cd06-d6a0-4090-b448-589e359a7736) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:21:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-786811575',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72fb81dc-569b-4f74-a2f5-b5d598bc5088,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e611dfb46cde4a138fb8d02d935e82ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:21:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:21:35Z,use_quota=True,user_id='f80c04546a93432fbd9b542bf3255771',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:21:35 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-7844bbdb-8ac6-43b2-8ca9-285d021b4a5c tempest-DeleteServersTestJSON-1741860693 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c780269f-52a6-4c99-abdf-00615eefa3d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:21:35 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-7844bbdb-8ac6-43b2-8ca9-285d021b4a5c tempest-DeleteServersTestJSON-1741860693 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c780269f-52a6-4c99-abdf-00615eefa3d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:21:35 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-7844bbdb-8ac6-43b2-8ca9-285d021b4a5c tempest-DeleteServersTestJSON-1741860693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (462fab91-876a-4150-9d76-bb740bf94883) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:21:35 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-7844bbdb-8ac6-43b2-8ca9-285d021b4a5c tempest-DeleteServersTestJSON-1741860693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (462fab91-876a-4150-9d76-bb740bf94883) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '72fb81dc-569b-4f74-a2f5-b5d598bc5088', 'volume_name': 'volume-72fb81dc-569b-4f74-a2f5-b5d598bc5088', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:21:35 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-7844bbdb-8ac6-43b2-8ca9-285d021b4a5c tempest-DeleteServersTestJSON-1741860693 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76f8b849-da4e-455b-906a-76a735ba8818) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:21:35 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-7844bbdb-8ac6-43b2-8ca9-285d021b4a5c tempest-DeleteServersTestJSON-1741860693 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76f8b849-da4e-455b-906a-76a735ba8818) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:21:35 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-7844bbdb-8ac6-43b2-8ca9-285d021b4a5c tempest-DeleteServersTestJSON-1741860693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (013d0636-b894-462c-990d-0af01e636e3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:21:35 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-7844bbdb-8ac6-43b2-8ca9-285d021b4a5c tempest-DeleteServersTestJSON-1741860693 None] Volume 72fb81dc-569b-4f74-a2f5-b5d598bc5088: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-72fb81dc-569b-4f74-a2f5-b5d598bc5088', 'volume_size': 1} Jun 29 03:21:35 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-7844bbdb-8ac6-43b2-8ca9-285d021b4a5c tempest-DeleteServersTestJSON-1741860693 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:21:35 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-7844bbdb-8ac6-43b2-8ca9-285d021b4a5c tempest-DeleteServersTestJSON-1741860693 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:21:35 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-7844bbdb-8ac6-43b2-8ca9-285d021b4a5c tempest-DeleteServersTestJSON-1741860693 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:21:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-786811575',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72fb81dc-569b-4f74-a2f5-b5d598bc5088,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e611dfb46cde4a138fb8d02d935e82ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:21:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:21:35Z,use_quota=True,user_id='f80c04546a93432fbd9b542bf3255771',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:21:35 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-7844bbdb-8ac6-43b2-8ca9-285d021b4a5c tempest-DeleteServersTestJSON-1741860693 None] Creating volume 72fb81dc-569b-4f74-a2f5-b5d598bc5088 {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:21:35 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-7844bbdb-8ac6-43b2-8ca9-285d021b4a5c tempest-DeleteServersTestJSON-1741860693 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:21:35 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-7844bbdb-8ac6-43b2-8ca9-285d021b4a5c tempest-DeleteServersTestJSON-1741860693 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:21:35 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-7844bbdb-8ac6-43b2-8ca9-285d021b4a5c tempest-DeleteServersTestJSON-1741860693 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:21:35 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-7844bbdb-8ac6-43b2-8ca9-285d021b4a5c tempest-DeleteServersTestJSON-1741860693 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:21:35 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-7844bbdb-8ac6-43b2-8ca9-285d021b4a5c tempest-DeleteServersTestJSON-1741860693 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.048s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:21:35 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-7844bbdb-8ac6-43b2-8ca9-285d021b4a5c tempest-DeleteServersTestJSON-1741860693 None] Selected osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:21:35 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-7844bbdb-8ac6-43b2-8ca9-285d021b4a5c tempest-DeleteServersTestJSON-1741860693 None] casted to osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f Jun 29 03:21:35 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-7844bbdb-8ac6-43b2-8ca9-285d021b4a5c tempest-DeleteServersTestJSON-1741860693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-72fb81dc-569b-4f74-a2f5-b5d598bc5088 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:21:36 devstack sudo[94576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-72fb81dc-569b-4f74-a2f5-b5d598bc5088 1073741824 Jun 29 03:21:36 devstack sudo[94576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:21:38 devstack sudo[94576]: pam_unix(sudo:session): session closed for user root Jun 29 03:21:38 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-7844bbdb-8ac6-43b2-8ca9-285d021b4a5c tempest-DeleteServersTestJSON-1741860693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-72fb81dc-569b-4f74-a2f5-b5d598bc5088 1073741824" returned: 0 in 2.485s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:21:38 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-7844bbdb-8ac6-43b2-8ca9-285d021b4a5c tempest-DeleteServersTestJSON-1741860693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-72fb81dc-569b-4f74-a2f5-b5d598bc5088 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:21:38 devstack sudo[94922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-72fb81dc-569b-4f74-a2f5-b5d598bc5088 Jun 29 03:21:38 devstack sudo[94922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:21:40 devstack sudo[94922]: pam_unix(sudo:session): session closed for user root Jun 29 03:21:40 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-7844bbdb-8ac6-43b2-8ca9-285d021b4a5c tempest-DeleteServersTestJSON-1741860693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-72fb81dc-569b-4f74-a2f5-b5d598bc5088" returned: 0 in 1.903s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:21:40 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-7844bbdb-8ac6-43b2-8ca9-285d021b4a5c tempest-DeleteServersTestJSON-1741860693 None] <== create_volume: return (4593ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:21:40 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-7844bbdb-8ac6-43b2-8ca9-285d021b4a5c tempest-DeleteServersTestJSON-1741860693 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 4.606s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:21:40 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-7844bbdb-8ac6-43b2-8ca9-285d021b4a5c tempest-DeleteServersTestJSON-1741860693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (013d0636-b894-462c-990d-0af01e636e3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72fb81dc-569b-4f74-a2f5-b5d598bc5088', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:21:40 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-7844bbdb-8ac6-43b2-8ca9-285d021b4a5c tempest-DeleteServersTestJSON-1741860693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6b06052-80f9-42bc-9741-b95bcef0e80a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:21:40 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-7844bbdb-8ac6-43b2-8ca9-285d021b4a5c tempest-DeleteServersTestJSON-1741860693 None] Volume volume-72fb81dc-569b-4f74-a2f5-b5d598bc5088 (72fb81dc-569b-4f74-a2f5-b5d598bc5088): created successfully Jun 29 03:21:40 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-7844bbdb-8ac6-43b2-8ca9-285d021b4a5c tempest-DeleteServersTestJSON-1741860693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6b06052-80f9-42bc-9741-b95bcef0e80a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:21:40 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-7844bbdb-8ac6-43b2-8ca9-285d021b4a5c tempest-DeleteServersTestJSON-1741860693 None] Flow 'volume_create_manager' (dcedac9a-76cb-40e1-b682-f9b7564d4193) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:21:40 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-7844bbdb-8ac6-43b2-8ca9-285d021b4a5c tempest-DeleteServersTestJSON-1741860693 None] Created volume successfully. Jun 29 03:21:49 devstack cinder-volume[93468]: WARNING py.warnings [req-17c4606d-5234-4d25-9165-cd9a05bf8d25 req-c66d1f96-5616-49a0-8bca-9412a9cb3848 tempest-DeleteServersTestJSON-1741860693 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volume_attachment". Apply join condition(s) between each element to resolve. Jun 29 03:21:49 devstack cinder-volume[93468]: .first() Jun 29 03:21:49 devstack cinder-volume[93468]: Jun 29 03:21:49 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [req-17c4606d-5234-4d25-9165-cd9a05bf8d25 req-c66d1f96-5616-49a0-8bca-9412a9cb3848 tempest-DeleteServersTestJSON-1741860693 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:21:49 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [req-17c4606d-5234-4d25-9165-cd9a05bf8d25 req-c66d1f96-5616-49a0-8bca-9412a9cb3848 tempest-DeleteServersTestJSON-1741860693 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:21:49 devstack cinder-volume[93468]: INFO oslo.privsep.daemon [req-17c4606d-5234-4d25-9165-cd9a05bf8d25 req-c66d1f96-5616-49a0-8bca-9412a9cb3848 tempest-DeleteServersTestJSON-1741860693 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmppjlpipyg/privsep.sock'] Jun 29 03:21:49 devstack sudo[95035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmppjlpipyg/privsep.sock Jun 29 03:21:49 devstack sudo[95035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:21:50 devstack cinder-volume[93468]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning: Jun 29 03:21:50 devstack cinder-volume[93468]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jun 29 03:21:50 devstack cinder-volume[93468]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jun 29 03:21:50 devstack cinder-volume[93468]: WARNING oslo.privsep.daemon [-] privsep log: Jun 29 03:21:50 devstack cinder-volume[93468]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jun 29 03:21:50 devstack cinder-volume[93468]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jun 29 03:21:50 devstack cinder-volume[93468]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jun 29 03:21:50 devstack cinder-volume[93468]: WARNING oslo.privsep.daemon [-] privsep log: Jun 29 03:21:50 devstack cinder-volume[93468]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet.patcher Jun 29 03:21:51 devstack cinder-volume[93468]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/importutils.py:77: EventletDeprecationWarning: Jun 29 03:21:51 devstack cinder-volume[93468]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jun 29 03:21:51 devstack cinder-volume[93468]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jun 29 03:21:51 devstack cinder-volume[93468]: WARNING oslo.privsep.daemon [-] privsep log: Jun 29 03:21:51 devstack cinder-volume[93468]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jun 29 03:21:51 devstack cinder-volume[93468]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jun 29 03:21:51 devstack cinder-volume[93468]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jun 29 03:21:51 devstack cinder-volume[93468]: WARNING oslo.privsep.daemon [-] privsep log: Jun 29 03:21:51 devstack cinder-volume[93468]: WARNING oslo.privsep.daemon [-] privsep log: __import__(import_str) Jun 29 03:21:52 devstack sudo[95035]: pam_unix(sudo:session): session closed for user root Jun 29 03:21:52 devstack cinder-volume[93468]: INFO oslo.privsep.daemon [req-17c4606d-5234-4d25-9165-cd9a05bf8d25 req-c66d1f96-5616-49a0-8bca-9412a9cb3848 tempest-DeleteServersTestJSON-1741860693 None] Spawned new privsep daemon via rootwrap Jun 29 03:21:52 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [req-17c4606d-5234-4d25-9165-cd9a05bf8d25 req-c66d1f96-5616-49a0-8bca-9412a9cb3848 tempest-DeleteServersTestJSON-1741860693 None] Accepted privsep connection to /tmp/tmppjlpipyg/privsep.sock {{(pid=93468) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Jun 29 03:21:52 devstack cinder-volume[93468]: INFO oslo.privsep.daemon [-] privsep daemon starting Jun 29 03:21:52 devstack cinder-volume[93468]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Jun 29 03:21:52 devstack cinder-volume[93468]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Jun 29 03:21:52 devstack cinder-volume[93468]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 95116 Jun 29 03:21:52 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[02196dc9-8d1a-435b-938e-32887d22f2d8]: (2,) {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:21:52 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c966f46-dce9-4bad-9b12-e9ccac761d10]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:21:52 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [req-17c4606d-5234-4d25-9165-cd9a05bf8d25 req-c66d1f96-5616-49a0-8bca-9412a9cb3848 tempest-DeleteServersTestJSON-1741860693 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-72fb81dc-569b-4f74-a2f5-b5d598bc5088 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:21:52 devstack sudo[95120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-72fb81dc-569b-4f74-a2f5-b5d598bc5088 Jun 29 03:21:52 devstack sudo[95120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:21:54 devstack sudo[95120]: pam_unix(sudo:session): session closed for user root Jun 29 03:21:54 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [req-17c4606d-5234-4d25-9165-cd9a05bf8d25 req-c66d1f96-5616-49a0-8bca-9412a9cb3848 tempest-DeleteServersTestJSON-1741860693 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-72fb81dc-569b-4f74-a2f5-b5d598bc5088" returned: 0 in 1.986s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:21:54 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [req-17c4606d-5234-4d25-9165-cd9a05bf8d25 req-c66d1f96-5616-49a0-8bca-9412a9cb3848 tempest-DeleteServersTestJSON-1741860693 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 5.317s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:21:54 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [req-17c4606d-5234-4d25-9165-cd9a05bf8d25 req-c66d1f96-5616-49a0-8bca-9412a9cb3848 tempest-DeleteServersTestJSON-1741860693 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f', 'name': 'volume-72fb81dc-569b-4f74-a2f5-b5d598bc5088', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '699611b7-79af-44a4-8f33-dcd6eb18955d', 'enforce_multipath': True} {{(pid=93468) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 29 03:21:54 devstack cinder-volume[93468]: INFO cinder.volume.manager [req-17c4606d-5234-4d25-9165-cd9a05bf8d25 req-c66d1f96-5616-49a0-8bca-9412a9cb3848 tempest-DeleteServersTestJSON-1741860693 None] attachment_update completed successfully. Jun 29 03:21:56 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-73c15a2f-51a3-4d67-8c7a-f1c0747c3658 tempest-VolumesAdminNegativeTest-1701291565 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:21:56 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-73c15a2f-51a3-4d67-8c7a-f1c0747c3658 tempest-VolumesAdminNegativeTest-1701291565 None] Flow 'volume_create_manager' (1ed6a660-f6d5-417d-bd64-771463b84d24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:21:56 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-73c15a2f-51a3-4d67-8c7a-f1c0747c3658 tempest-VolumesAdminNegativeTest-1701291565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d463ae2b-3bbc-45fb-a494-83ceaadfb329) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:21:57 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-73c15a2f-51a3-4d67-8c7a-f1c0747c3658 tempest-VolumesAdminNegativeTest-1701291565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d463ae2b-3bbc-45fb-a494-83ceaadfb329) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:21:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1897167559',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d7aceec-e66e-44c9-a1a8-402be32921d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='951befedb0d5448b9e48f7221ff7506d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:21:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:21:57Z,use_quota=True,user_id='3ff1bfd92de340e28fa2e345baa0c9c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:21:57 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-73c15a2f-51a3-4d67-8c7a-f1c0747c3658 tempest-VolumesAdminNegativeTest-1701291565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (755a71f5-4378-4c49-90a4-6d575bc713c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:21:57 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-73c15a2f-51a3-4d67-8c7a-f1c0747c3658 tempest-VolumesAdminNegativeTest-1701291565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (755a71f5-4378-4c49-90a4-6d575bc713c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:21:57 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-73c15a2f-51a3-4d67-8c7a-f1c0747c3658 tempest-VolumesAdminNegativeTest-1701291565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fac9312c-d8d3-4fac-be68-6de45b129d2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:21:57 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-73c15a2f-51a3-4d67-8c7a-f1c0747c3658 tempest-VolumesAdminNegativeTest-1701291565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fac9312c-d8d3-4fac-be68-6de45b129d2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d7aceec-e66e-44c9-a1a8-402be32921d2', 'volume_name': 'volume-3d7aceec-e66e-44c9-a1a8-402be32921d2', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:21:57 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-73c15a2f-51a3-4d67-8c7a-f1c0747c3658 tempest-VolumesAdminNegativeTest-1701291565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12812f82-9689-4958-9212-a80e9783c6b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:21:57 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-73c15a2f-51a3-4d67-8c7a-f1c0747c3658 tempest-VolumesAdminNegativeTest-1701291565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12812f82-9689-4958-9212-a80e9783c6b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:21:57 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-73c15a2f-51a3-4d67-8c7a-f1c0747c3658 tempest-VolumesAdminNegativeTest-1701291565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bcf4a1c8-9de0-4a40-b119-afdf476355bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:21:57 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-73c15a2f-51a3-4d67-8c7a-f1c0747c3658 tempest-VolumesAdminNegativeTest-1701291565 None] Volume 3d7aceec-e66e-44c9-a1a8-402be32921d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d7aceec-e66e-44c9-a1a8-402be32921d2', 'volume_size': 1} Jun 29 03:21:57 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-73c15a2f-51a3-4d67-8c7a-f1c0747c3658 tempest-VolumesAdminNegativeTest-1701291565 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:21:57 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-73c15a2f-51a3-4d67-8c7a-f1c0747c3658 tempest-VolumesAdminNegativeTest-1701291565 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:21:57 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-73c15a2f-51a3-4d67-8c7a-f1c0747c3658 tempest-VolumesAdminNegativeTest-1701291565 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:21:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1897167559',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d7aceec-e66e-44c9-a1a8-402be32921d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='951befedb0d5448b9e48f7221ff7506d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:21:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:21:57Z,use_quota=True,user_id='3ff1bfd92de340e28fa2e345baa0c9c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:21:57 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-73c15a2f-51a3-4d67-8c7a-f1c0747c3658 tempest-VolumesAdminNegativeTest-1701291565 None] Creating volume 3d7aceec-e66e-44c9-a1a8-402be32921d2 {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:21:57 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-73c15a2f-51a3-4d67-8c7a-f1c0747c3658 tempest-VolumesAdminNegativeTest-1701291565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:21:57 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-73c15a2f-51a3-4d67-8c7a-f1c0747c3658 tempest-VolumesAdminNegativeTest-1701291565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:21:57 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-73c15a2f-51a3-4d67-8c7a-f1c0747c3658 tempest-VolumesAdminNegativeTest-1701291565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:21:57 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-73c15a2f-51a3-4d67-8c7a-f1c0747c3658 tempest-VolumesAdminNegativeTest-1701291565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:21:57 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-73c15a2f-51a3-4d67-8c7a-f1c0747c3658 tempest-VolumesAdminNegativeTest-1701291565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:21:57 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-73c15a2f-51a3-4d67-8c7a-f1c0747c3658 tempest-VolumesAdminNegativeTest-1701291565 None] Selected osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:21:57 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-73c15a2f-51a3-4d67-8c7a-f1c0747c3658 tempest-VolumesAdminNegativeTest-1701291565 None] casted to osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f Jun 29 03:21:57 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-73c15a2f-51a3-4d67-8c7a-f1c0747c3658 tempest-VolumesAdminNegativeTest-1701291565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-3d7aceec-e66e-44c9-a1a8-402be32921d2 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:21:57 devstack sudo[95536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-3d7aceec-e66e-44c9-a1a8-402be32921d2 1073741824 Jun 29 03:21:57 devstack sudo[95536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:21:58 devstack sudo[95536]: pam_unix(sudo:session): session closed for user root Jun 29 03:21:58 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-73c15a2f-51a3-4d67-8c7a-f1c0747c3658 tempest-VolumesAdminNegativeTest-1701291565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-3d7aceec-e66e-44c9-a1a8-402be32921d2 1073741824" returned: 0 in 1.134s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:21:58 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-73c15a2f-51a3-4d67-8c7a-f1c0747c3658 tempest-VolumesAdminNegativeTest-1701291565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-3d7aceec-e66e-44c9-a1a8-402be32921d2 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:21:58 devstack sudo[95542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-3d7aceec-e66e-44c9-a1a8-402be32921d2 Jun 29 03:21:58 devstack sudo[95542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:21:58 devstack sudo[95542]: pam_unix(sudo:session): session closed for user root Jun 29 03:21:58 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-73c15a2f-51a3-4d67-8c7a-f1c0747c3658 tempest-VolumesAdminNegativeTest-1701291565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-3d7aceec-e66e-44c9-a1a8-402be32921d2" returned: 0 in 0.739s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:21:58 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-73c15a2f-51a3-4d67-8c7a-f1c0747c3658 tempest-VolumesAdminNegativeTest-1701291565 None] <== create_volume: return (1935ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:21:59 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-73c15a2f-51a3-4d67-8c7a-f1c0747c3658 tempest-VolumesAdminNegativeTest-1701291565 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.941s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:21:59 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-73c15a2f-51a3-4d67-8c7a-f1c0747c3658 tempest-VolumesAdminNegativeTest-1701291565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bcf4a1c8-9de0-4a40-b119-afdf476355bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d7aceec-e66e-44c9-a1a8-402be32921d2', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:21:59 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-73c15a2f-51a3-4d67-8c7a-f1c0747c3658 tempest-VolumesAdminNegativeTest-1701291565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07f55f5b-ccf7-43a4-83b0-9af3feb6ff45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:21:59 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-73c15a2f-51a3-4d67-8c7a-f1c0747c3658 tempest-VolumesAdminNegativeTest-1701291565 None] Volume volume-3d7aceec-e66e-44c9-a1a8-402be32921d2 (3d7aceec-e66e-44c9-a1a8-402be32921d2): created successfully Jun 29 03:21:59 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-73c15a2f-51a3-4d67-8c7a-f1c0747c3658 tempest-VolumesAdminNegativeTest-1701291565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07f55f5b-ccf7-43a4-83b0-9af3feb6ff45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:21:59 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-73c15a2f-51a3-4d67-8c7a-f1c0747c3658 tempest-VolumesAdminNegativeTest-1701291565 None] Flow 'volume_create_manager' (1ed6a660-f6d5-417d-bd64-771463b84d24) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:21:59 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-73c15a2f-51a3-4d67-8c7a-f1c0747c3658 tempest-VolumesAdminNegativeTest-1701291565 None] Created volume successfully. Jun 29 03:22:01 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-926c072b-9c98-41bf-ae69-3abcd99c0997 tempest-VolumesAdminNegativeTest-1701291565 None] Acquiring lock "cinder-3d7aceec-e66e-44c9-a1a8-402be32921d2-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:22:01 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-926c072b-9c98-41bf-ae69-3abcd99c0997 tempest-VolumesAdminNegativeTest-1701291565 None] Lock "cinder-3d7aceec-e66e-44c9-a1a8-402be32921d2-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:22:01 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-926c072b-9c98-41bf-ae69-3abcd99c0997 tempest-VolumesAdminNegativeTest-1701291565 None] Acquiring lock "cinder-quobyte-3d7aceec-e66e-44c9-a1a8-402be32921d2" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:22:01 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-926c072b-9c98-41bf-ae69-3abcd99c0997 tempest-VolumesAdminNegativeTest-1701291565 None] Lock "cinder-quobyte-3d7aceec-e66e-44c9-a1a8-402be32921d2" acquired by "delete_volume" :: waited 0.025s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:22:01 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7dc5b44-b317-4852-85aa-96464c89c340]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:22:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-926c072b-9c98-41bf-ae69-3abcd99c0997 tempest-VolumesAdminNegativeTest-1701291565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-3d7aceec-e66e-44c9-a1a8-402be32921d2 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:22:01 devstack sudo[95547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-3d7aceec-e66e-44c9-a1a8-402be32921d2 Jun 29 03:22:01 devstack sudo[95547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:22:02 devstack sudo[95547]: pam_unix(sudo:session): session closed for user root Jun 29 03:22:02 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-926c072b-9c98-41bf-ae69-3abcd99c0997 tempest-VolumesAdminNegativeTest-1701291565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-3d7aceec-e66e-44c9-a1a8-402be32921d2" returned: 0 in 1.574s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:22:02 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-926c072b-9c98-41bf-ae69-3abcd99c0997 tempest-VolumesAdminNegativeTest-1701291565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-3d7aceec-e66e-44c9-a1a8-402be32921d2 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:22:02 devstack sudo[95596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-3d7aceec-e66e-44c9-a1a8-402be32921d2 Jun 29 03:22:02 devstack sudo[95596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:22:03 devstack sudo[95596]: pam_unix(sudo:session): session closed for user root Jun 29 03:22:03 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-926c072b-9c98-41bf-ae69-3abcd99c0997 tempest-VolumesAdminNegativeTest-1701291565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-3d7aceec-e66e-44c9-a1a8-402be32921d2" returned: 0 in 1.149s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:22:03 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-926c072b-9c98-41bf-ae69-3abcd99c0997 tempest-VolumesAdminNegativeTest-1701291565 None] Lock "cinder-quobyte-3d7aceec-e66e-44c9-a1a8-402be32921d2" released by "delete_volume" :: held 2.801s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:22:03 devstack cinder-volume[93468]: WARNING cinder.quota [None req-926c072b-9c98-41bf-ae69-3abcd99c0997 tempest-VolumesAdminNegativeTest-1701291565 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jun 29 03:22:03 devstack cinder-volume[93468]: WARNING cinder.quota [None req-926c072b-9c98-41bf-ae69-3abcd99c0997 tempest-VolumesAdminNegativeTest-1701291565 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jun 29 03:22:04 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-926c072b-9c98-41bf-ae69-3abcd99c0997 tempest-VolumesAdminNegativeTest-1701291565 None] Created reservations ['07dbb396-2099-44a6-af4c-439e071742a6', '7931d02f-47dd-45a6-ace9-8324308a25f2', '9df8107e-db9d-4aa7-bcd0-aec8954cd5cc', '47b6d5ff-fa3e-42b2-bfe9-873456c55e25'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:22:04 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-926c072b-9c98-41bf-ae69-3abcd99c0997 tempest-VolumesAdminNegativeTest-1701291565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:22:04 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-926c072b-9c98-41bf-ae69-3abcd99c0997 tempest-VolumesAdminNegativeTest-1701291565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:22:04 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-926c072b-9c98-41bf-ae69-3abcd99c0997 tempest-VolumesAdminNegativeTest-1701291565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:22:04 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-926c072b-9c98-41bf-ae69-3abcd99c0997 tempest-VolumesAdminNegativeTest-1701291565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:22:04 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-926c072b-9c98-41bf-ae69-3abcd99c0997 tempest-VolumesAdminNegativeTest-1701291565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:22:04 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-926c072b-9c98-41bf-ae69-3abcd99c0997 tempest-VolumesAdminNegativeTest-1701291565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:22:04 devstack sudo[95627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf Jun 29 03:22:04 devstack sudo[95627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:22:05 devstack cinder-volume[93468]: INFO cinder.volume.manager [req-a87222ea-184b-4e7a-a612-2e39ec7da155 req-2b9cf276-e04f-4928-bacb-50ef37ffb1d2 tempest-DeleteServersTestJSON-1741860693 None] Terminate volume connection completed successfully. Jun 29 03:22:05 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [req-a87222ea-184b-4e7a-a612-2e39ec7da155 req-2b9cf276-e04f-4928-bacb-50ef37ffb1d2 tempest-DeleteServersTestJSON-1741860693 None] Deleting attachment 699611b7-79af-44a4-8f33-dcd6eb18955d. {{(pid=93468) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 29 03:22:05 devstack sudo[95627]: pam_unix(sudo:session): session closed for user root Jun 29 03:22:05 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-926c072b-9c98-41bf-ae69-3abcd99c0997 tempest-VolumesAdminNegativeTest-1701291565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf" returned: 0 in 1.391s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:22:05 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-926c072b-9c98-41bf-ae69-3abcd99c0997 tempest-VolumesAdminNegativeTest-1701291565 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:22:05 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-926c072b-9c98-41bf-ae69-3abcd99c0997 tempest-VolumesAdminNegativeTest-1701291565 None] Deleted volume successfully. Jun 29 03:22:05 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-926c072b-9c98-41bf-ae69-3abcd99c0997 tempest-VolumesAdminNegativeTest-1701291565 None] Lock "cinder-3d7aceec-e66e-44c9-a1a8-402be32921d2-delete_volume" released by "delete_volume" :: held 4.678s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:22:06 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0da8a96-08dd-4074-952b-224a3250e161 tempest-ServerActionsTestOtherA-77222760 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:22:06 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-e0da8a96-08dd-4074-952b-224a3250e161 tempest-ServerActionsTestOtherA-77222760 None] Flow 'volume_create_manager' (8abe6b1f-437d-4a56-bbc8-b234ff9e528e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:22:06 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-e0da8a96-08dd-4074-952b-224a3250e161 tempest-ServerActionsTestOtherA-77222760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc99eae4-09f5-4981-af32-4a497f453463) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:22:06 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-e0da8a96-08dd-4074-952b-224a3250e161 tempest-ServerActionsTestOtherA-77222760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc99eae4-09f5-4981-af32-4a497f453463) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:22:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1957188610',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d235420-f06b-4b17-bb1f-8025e81a6d95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89109789eb1c4ede802b01ac73b1ad8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:22:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:22:07Z,use_quota=True,user_id='356bcca5df06409aa1f29c5f03e912ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:22:06 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-e0da8a96-08dd-4074-952b-224a3250e161 tempest-ServerActionsTestOtherA-77222760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b98ae650-2f47-45ff-a9bc-ed8c583ed0ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:22:06 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-e0da8a96-08dd-4074-952b-224a3250e161 tempest-ServerActionsTestOtherA-77222760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b98ae650-2f47-45ff-a9bc-ed8c583ed0ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:22:06 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-e0da8a96-08dd-4074-952b-224a3250e161 tempest-ServerActionsTestOtherA-77222760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d190c8bb-f859-45ce-8343-6d2b2fccaa81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:22:06 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-e0da8a96-08dd-4074-952b-224a3250e161 tempest-ServerActionsTestOtherA-77222760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d190c8bb-f859-45ce-8343-6d2b2fccaa81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d235420-f06b-4b17-bb1f-8025e81a6d95', 'volume_name': 'volume-5d235420-f06b-4b17-bb1f-8025e81a6d95', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:22:06 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-e0da8a96-08dd-4074-952b-224a3250e161 tempest-ServerActionsTestOtherA-77222760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c10b264e-034e-45dd-818e-510b3fe9160d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:22:06 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-e0da8a96-08dd-4074-952b-224a3250e161 tempest-ServerActionsTestOtherA-77222760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c10b264e-034e-45dd-818e-510b3fe9160d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:22:06 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-e0da8a96-08dd-4074-952b-224a3250e161 tempest-ServerActionsTestOtherA-77222760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a5f0830-fa63-4b83-aa34-1d9e82636e2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:22:06 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-e0da8a96-08dd-4074-952b-224a3250e161 tempest-ServerActionsTestOtherA-77222760 None] Volume 5d235420-f06b-4b17-bb1f-8025e81a6d95: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d235420-f06b-4b17-bb1f-8025e81a6d95', 'volume_size': 1} Jun 29 03:22:06 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-e0da8a96-08dd-4074-952b-224a3250e161 tempest-ServerActionsTestOtherA-77222760 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:22:06 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-e0da8a96-08dd-4074-952b-224a3250e161 tempest-ServerActionsTestOtherA-77222760 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:22:06 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-e0da8a96-08dd-4074-952b-224a3250e161 tempest-ServerActionsTestOtherA-77222760 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:22:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1957188610',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d235420-f06b-4b17-bb1f-8025e81a6d95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89109789eb1c4ede802b01ac73b1ad8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:22:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:22:07Z,use_quota=True,user_id='356bcca5df06409aa1f29c5f03e912ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:22:06 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-e0da8a96-08dd-4074-952b-224a3250e161 tempest-ServerActionsTestOtherA-77222760 None] Creating volume 5d235420-f06b-4b17-bb1f-8025e81a6d95 {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:22:06 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-e0da8a96-08dd-4074-952b-224a3250e161 tempest-ServerActionsTestOtherA-77222760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:22:06 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-e0da8a96-08dd-4074-952b-224a3250e161 tempest-ServerActionsTestOtherA-77222760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:22:06 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-e0da8a96-08dd-4074-952b-224a3250e161 tempest-ServerActionsTestOtherA-77222760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:22:06 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-e0da8a96-08dd-4074-952b-224a3250e161 tempest-ServerActionsTestOtherA-77222760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:22:06 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-e0da8a96-08dd-4074-952b-224a3250e161 tempest-ServerActionsTestOtherA-77222760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:22:06 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-e0da8a96-08dd-4074-952b-224a3250e161 tempest-ServerActionsTestOtherA-77222760 None] Selected osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:22:06 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-e0da8a96-08dd-4074-952b-224a3250e161 tempest-ServerActionsTestOtherA-77222760 None] casted to osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f Jun 29 03:22:06 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-e0da8a96-08dd-4074-952b-224a3250e161 tempest-ServerActionsTestOtherA-77222760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-5d235420-f06b-4b17-bb1f-8025e81a6d95 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:22:06 devstack sudo[95708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-5d235420-f06b-4b17-bb1f-8025e81a6d95 1073741824 Jun 29 03:22:06 devstack sudo[95708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:22:08 devstack sudo[95708]: pam_unix(sudo:session): session closed for user root Jun 29 03:22:08 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-e0da8a96-08dd-4074-952b-224a3250e161 tempest-ServerActionsTestOtherA-77222760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-5d235420-f06b-4b17-bb1f-8025e81a6d95 1073741824" returned: 0 in 1.266s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:22:08 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-e0da8a96-08dd-4074-952b-224a3250e161 tempest-ServerActionsTestOtherA-77222760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-5d235420-f06b-4b17-bb1f-8025e81a6d95 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:22:08 devstack sudo[95716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-5d235420-f06b-4b17-bb1f-8025e81a6d95 Jun 29 03:22:08 devstack sudo[95716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:22:08 devstack sudo[95716]: pam_unix(sudo:session): session closed for user root Jun 29 03:22:08 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-e0da8a96-08dd-4074-952b-224a3250e161 tempest-ServerActionsTestOtherA-77222760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-5d235420-f06b-4b17-bb1f-8025e81a6d95" returned: 0 in 0.732s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:22:08 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-e0da8a96-08dd-4074-952b-224a3250e161 tempest-ServerActionsTestOtherA-77222760 None] <== create_volume: return (2058ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:22:08 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-e0da8a96-08dd-4074-952b-224a3250e161 tempest-ServerActionsTestOtherA-77222760 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.061s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:22:08 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-e0da8a96-08dd-4074-952b-224a3250e161 tempest-ServerActionsTestOtherA-77222760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a5f0830-fa63-4b83-aa34-1d9e82636e2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d235420-f06b-4b17-bb1f-8025e81a6d95', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:22:08 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-e0da8a96-08dd-4074-952b-224a3250e161 tempest-ServerActionsTestOtherA-77222760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fe3be66-e2d1-459e-aebc-0c11b7073003) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:22:08 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-e0da8a96-08dd-4074-952b-224a3250e161 tempest-ServerActionsTestOtherA-77222760 None] Volume volume-5d235420-f06b-4b17-bb1f-8025e81a6d95 (5d235420-f06b-4b17-bb1f-8025e81a6d95): created successfully Jun 29 03:22:08 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-e0da8a96-08dd-4074-952b-224a3250e161 tempest-ServerActionsTestOtherA-77222760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fe3be66-e2d1-459e-aebc-0c11b7073003) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:22:08 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-e0da8a96-08dd-4074-952b-224a3250e161 tempest-ServerActionsTestOtherA-77222760 None] Flow 'volume_create_manager' (8abe6b1f-437d-4a56-bbc8-b234ff9e528e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:22:08 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-e0da8a96-08dd-4074-952b-224a3250e161 tempest-ServerActionsTestOtherA-77222760 None] Created volume successfully. Jun 29 03:22:11 devstack cinder-volume[93468]: DEBUG oslo_service.periodic_task [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93468) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 29 03:22:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:22:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:22:11 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:22:11 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:22:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:22:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:22:11 devstack sudo[95722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf Jun 29 03:22:11 devstack sudo[95722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:22:12 devstack sudo[95722]: pam_unix(sudo:session): session closed for user root Jun 29 03:22:12 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf" returned: 0 in 0.733s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:22:12 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:22:12 devstack cinder-volume[93468]: DEBUG oslo_service.periodic_task [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Running periodic task VolumeManager._thread_info {{(pid=93468) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 29 03:22:12 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] thread count: 8 {{(pid=93468) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 29 03:22:12 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] thread info: [<_MainThread(MainThread, started 132331377287296)>, , , , , , , ] {{(pid=93468) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 29 03:22:13 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-5ec2f4eb-64b9-4419-870f-fb52dc6dad78 tempest-DeleteServersTestJSON-1741860693 None] Acquiring lock "cinder-72fb81dc-569b-4f74-a2f5-b5d598bc5088-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:22:13 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-5ec2f4eb-64b9-4419-870f-fb52dc6dad78 tempest-DeleteServersTestJSON-1741860693 None] Lock "cinder-72fb81dc-569b-4f74-a2f5-b5d598bc5088-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:22:13 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-5ec2f4eb-64b9-4419-870f-fb52dc6dad78 tempest-DeleteServersTestJSON-1741860693 None] Acquiring lock "cinder-quobyte-72fb81dc-569b-4f74-a2f5-b5d598bc5088" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:22:13 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-5ec2f4eb-64b9-4419-870f-fb52dc6dad78 tempest-DeleteServersTestJSON-1741860693 None] Lock "cinder-quobyte-72fb81dc-569b-4f74-a2f5-b5d598bc5088" acquired by "delete_volume" :: waited 0.024s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:22:13 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[fde6b1ef-2ab2-444e-bb06-c2ed7be79dce]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:22:13 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-5ec2f4eb-64b9-4419-870f-fb52dc6dad78 tempest-DeleteServersTestJSON-1741860693 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-72fb81dc-569b-4f74-a2f5-b5d598bc5088 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:22:13 devstack sudo[95731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-72fb81dc-569b-4f74-a2f5-b5d598bc5088 Jun 29 03:22:13 devstack sudo[95731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:22:14 devstack sudo[95731]: pam_unix(sudo:session): session closed for user root Jun 29 03:22:14 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-5ec2f4eb-64b9-4419-870f-fb52dc6dad78 tempest-DeleteServersTestJSON-1741860693 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-72fb81dc-569b-4f74-a2f5-b5d598bc5088" returned: 0 in 1.001s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:22:14 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-5ec2f4eb-64b9-4419-870f-fb52dc6dad78 tempest-DeleteServersTestJSON-1741860693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-72fb81dc-569b-4f74-a2f5-b5d598bc5088 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:22:14 devstack sudo[95740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-72fb81dc-569b-4f74-a2f5-b5d598bc5088 Jun 29 03:22:14 devstack sudo[95740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:22:14 devstack sudo[95740]: pam_unix(sudo:session): session closed for user root Jun 29 03:22:14 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-5ec2f4eb-64b9-4419-870f-fb52dc6dad78 tempest-DeleteServersTestJSON-1741860693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-72fb81dc-569b-4f74-a2f5-b5d598bc5088" returned: 0 in 0.723s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:22:14 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-5ec2f4eb-64b9-4419-870f-fb52dc6dad78 tempest-DeleteServersTestJSON-1741860693 None] Lock "cinder-quobyte-72fb81dc-569b-4f74-a2f5-b5d598bc5088" released by "delete_volume" :: held 1.774s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:22:14 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-5ec2f4eb-64b9-4419-870f-fb52dc6dad78 tempest-DeleteServersTestJSON-1741860693 None] Created reservations ['62795476-6144-4515-9461-6961672b0182', 'caaa5a26-98d2-4855-aa35-287518969ccf', '3be8758c-13a3-49b8-81d9-6f919c8c399d', 'e2a3cb67-6532-4db4-94df-39c4d22a49ef'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:22:15 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-5ec2f4eb-64b9-4419-870f-fb52dc6dad78 tempest-DeleteServersTestJSON-1741860693 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:22:15 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-5ec2f4eb-64b9-4419-870f-fb52dc6dad78 tempest-DeleteServersTestJSON-1741860693 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:22:15 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-5ec2f4eb-64b9-4419-870f-fb52dc6dad78 tempest-DeleteServersTestJSON-1741860693 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:22:15 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-5ec2f4eb-64b9-4419-870f-fb52dc6dad78 tempest-DeleteServersTestJSON-1741860693 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:22:15 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-5ec2f4eb-64b9-4419-870f-fb52dc6dad78 tempest-DeleteServersTestJSON-1741860693 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:22:15 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-5ec2f4eb-64b9-4419-870f-fb52dc6dad78 tempest-DeleteServersTestJSON-1741860693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:22:15 devstack sudo[95743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf Jun 29 03:22:15 devstack sudo[95743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:22:15 devstack sudo[95743]: pam_unix(sudo:session): session closed for user root Jun 29 03:22:15 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-5ec2f4eb-64b9-4419-870f-fb52dc6dad78 tempest-DeleteServersTestJSON-1741860693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf" returned: 0 in 0.776s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:22:15 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-5ec2f4eb-64b9-4419-870f-fb52dc6dad78 tempest-DeleteServersTestJSON-1741860693 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:22:15 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-5ec2f4eb-64b9-4419-870f-fb52dc6dad78 tempest-DeleteServersTestJSON-1741860693 None] Deleted volume successfully. Jun 29 03:22:15 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-5ec2f4eb-64b9-4419-870f-fb52dc6dad78 tempest-DeleteServersTestJSON-1741860693 None] Lock "cinder-72fb81dc-569b-4f74-a2f5-b5d598bc5088-delete_volume" released by "delete_volume" :: held 2.828s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:22:25 devstack cinder-volume[93468]: DEBUG dbcounter [-] [93468] Writing DB stats cinder:SELECT=23,cinder:UPDATE=24,cinder:DELETE=3,cinder:INSERT=3 {{(pid=93468) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 29 03:22:25 devstack cinder-volume[93468]: DEBUG dbcounter [-] [93468] Writing DB stats cinder:SELECT=22,cinder:UPDATE=29,cinder:INSERT=8,cinder:DELETE=2 {{(pid=93468) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 29 03:23:03 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [req-32a49321-52b7-4dcf-a138-8b44458ca05f req-516518f4-9c51-4921-932c-4510e0777aad tempest-ServerActionsTestOtherA-77222760 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:23:03 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [req-32a49321-52b7-4dcf-a138-8b44458ca05f req-516518f4-9c51-4921-932c-4510e0777aad tempest-ServerActionsTestOtherA-77222760 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:23:03 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[e67b3d2c-238e-4b80-bf8e-50ec1a2ef3fd]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:23:03 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [req-32a49321-52b7-4dcf-a138-8b44458ca05f req-516518f4-9c51-4921-932c-4510e0777aad tempest-ServerActionsTestOtherA-77222760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-5d235420-f06b-4b17-bb1f-8025e81a6d95 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:23:03 devstack sudo[96194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-5d235420-f06b-4b17-bb1f-8025e81a6d95 Jun 29 03:23:03 devstack sudo[96194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:23:04 devstack sudo[96194]: pam_unix(sudo:session): session closed for user root Jun 29 03:23:04 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [req-32a49321-52b7-4dcf-a138-8b44458ca05f req-516518f4-9c51-4921-932c-4510e0777aad tempest-ServerActionsTestOtherA-77222760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-5d235420-f06b-4b17-bb1f-8025e81a6d95" returned: 0 in 1.154s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:23:04 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [req-32a49321-52b7-4dcf-a138-8b44458ca05f req-516518f4-9c51-4921-932c-4510e0777aad tempest-ServerActionsTestOtherA-77222760 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.196s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:23:04 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [req-32a49321-52b7-4dcf-a138-8b44458ca05f req-516518f4-9c51-4921-932c-4510e0777aad tempest-ServerActionsTestOtherA-77222760 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f', 'name': 'volume-5d235420-f06b-4b17-bb1f-8025e81a6d95', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2912f1a6-ea94-4959-bed0-f8e27ca5a911', 'enforce_multipath': True} {{(pid=93468) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 29 03:23:05 devstack cinder-volume[93468]: INFO cinder.volume.manager [req-32a49321-52b7-4dcf-a138-8b44458ca05f req-516518f4-9c51-4921-932c-4510e0777aad tempest-ServerActionsTestOtherA-77222760 None] attachment_update completed successfully. Jun 29 03:23:09 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ec76e8f-1c4a-456c-8432-26042913d50d tempest-AttachVolumeNegativeTest-1677376095 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:23:09 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-9ec76e8f-1c4a-456c-8432-26042913d50d tempest-AttachVolumeNegativeTest-1677376095 None] Flow 'volume_create_manager' (216fd198-3dfd-405b-8eb6-fd0d0e97fec8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:23:09 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-9ec76e8f-1c4a-456c-8432-26042913d50d tempest-AttachVolumeNegativeTest-1677376095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d5af367-577a-4a28-85a1-6d9806991506) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:23:09 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-9ec76e8f-1c4a-456c-8432-26042913d50d tempest-AttachVolumeNegativeTest-1677376095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d5af367-577a-4a28-85a1-6d9806991506) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:23:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1751254724',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87e0d255-c9c7-4f0b-a7bc-bf7f83fcbc8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3526e51fa339415f81fd93e4f6eb79d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:23:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:23:10Z,use_quota=True,user_id='c63530b326234dd7a6d67b641079d8b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:23:09 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-9ec76e8f-1c4a-456c-8432-26042913d50d tempest-AttachVolumeNegativeTest-1677376095 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4751df27-d941-432d-9603-0fc2c33f38f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:23:09 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-9ec76e8f-1c4a-456c-8432-26042913d50d tempest-AttachVolumeNegativeTest-1677376095 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4751df27-d941-432d-9603-0fc2c33f38f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:23:09 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-9ec76e8f-1c4a-456c-8432-26042913d50d tempest-AttachVolumeNegativeTest-1677376095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4082df7-a7f2-4a87-9cd7-d67ad6c1e835) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:23:09 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-9ec76e8f-1c4a-456c-8432-26042913d50d tempest-AttachVolumeNegativeTest-1677376095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4082df7-a7f2-4a87-9cd7-d67ad6c1e835) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '87e0d255-c9c7-4f0b-a7bc-bf7f83fcbc8a', 'volume_name': 'volume-87e0d255-c9c7-4f0b-a7bc-bf7f83fcbc8a', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:23:09 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-9ec76e8f-1c4a-456c-8432-26042913d50d tempest-AttachVolumeNegativeTest-1677376095 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96074341-0880-48fa-8aed-a71c9bb24692) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:23:09 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-9ec76e8f-1c4a-456c-8432-26042913d50d tempest-AttachVolumeNegativeTest-1677376095 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96074341-0880-48fa-8aed-a71c9bb24692) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:23:09 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-9ec76e8f-1c4a-456c-8432-26042913d50d tempest-AttachVolumeNegativeTest-1677376095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (427e66d8-4da8-4a75-aaf2-f85e238a78a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:23:09 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-9ec76e8f-1c4a-456c-8432-26042913d50d tempest-AttachVolumeNegativeTest-1677376095 None] Volume 87e0d255-c9c7-4f0b-a7bc-bf7f83fcbc8a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-87e0d255-c9c7-4f0b-a7bc-bf7f83fcbc8a', 'volume_size': 1} Jun 29 03:23:09 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-9ec76e8f-1c4a-456c-8432-26042913d50d tempest-AttachVolumeNegativeTest-1677376095 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:23:09 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-9ec76e8f-1c4a-456c-8432-26042913d50d tempest-AttachVolumeNegativeTest-1677376095 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:23:09 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-9ec76e8f-1c4a-456c-8432-26042913d50d tempest-AttachVolumeNegativeTest-1677376095 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:23:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1751254724',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87e0d255-c9c7-4f0b-a7bc-bf7f83fcbc8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3526e51fa339415f81fd93e4f6eb79d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:23:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:23:10Z,use_quota=True,user_id='c63530b326234dd7a6d67b641079d8b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:23:09 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-9ec76e8f-1c4a-456c-8432-26042913d50d tempest-AttachVolumeNegativeTest-1677376095 None] Creating volume 87e0d255-c9c7-4f0b-a7bc-bf7f83fcbc8a {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:23:09 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-9ec76e8f-1c4a-456c-8432-26042913d50d tempest-AttachVolumeNegativeTest-1677376095 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:23:09 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-9ec76e8f-1c4a-456c-8432-26042913d50d tempest-AttachVolumeNegativeTest-1677376095 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:23:09 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-9ec76e8f-1c4a-456c-8432-26042913d50d tempest-AttachVolumeNegativeTest-1677376095 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:23:10 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-9ec76e8f-1c4a-456c-8432-26042913d50d tempest-AttachVolumeNegativeTest-1677376095 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:23:10 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-9ec76e8f-1c4a-456c-8432-26042913d50d tempest-AttachVolumeNegativeTest-1677376095 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.039s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:23:10 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-9ec76e8f-1c4a-456c-8432-26042913d50d tempest-AttachVolumeNegativeTest-1677376095 None] Selected osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:23:10 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-9ec76e8f-1c4a-456c-8432-26042913d50d tempest-AttachVolumeNegativeTest-1677376095 None] casted to osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f Jun 29 03:23:10 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-9ec76e8f-1c4a-456c-8432-26042913d50d tempest-AttachVolumeNegativeTest-1677376095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-87e0d255-c9c7-4f0b-a7bc-bf7f83fcbc8a 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:23:10 devstack sudo[96621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-87e0d255-c9c7-4f0b-a7bc-bf7f83fcbc8a 1073741824 Jun 29 03:23:10 devstack sudo[96621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:23:11 devstack sudo[96621]: pam_unix(sudo:session): session closed for user root Jun 29 03:23:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-9ec76e8f-1c4a-456c-8432-26042913d50d tempest-AttachVolumeNegativeTest-1677376095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-87e0d255-c9c7-4f0b-a7bc-bf7f83fcbc8a 1073741824" returned: 0 in 1.378s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:23:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-9ec76e8f-1c4a-456c-8432-26042913d50d tempest-AttachVolumeNegativeTest-1677376095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-87e0d255-c9c7-4f0b-a7bc-bf7f83fcbc8a {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:23:11 devstack sudo[96634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-87e0d255-c9c7-4f0b-a7bc-bf7f83fcbc8a Jun 29 03:23:11 devstack sudo[96634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:23:11 devstack cinder-volume[93468]: DEBUG oslo_service.periodic_task [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93468) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 29 03:23:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:23:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:23:11 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:23:11 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:23:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:23:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:23:11 devstack sudo[96637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf Jun 29 03:23:11 devstack sudo[96637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:23:13 devstack sudo[96634]: pam_unix(sudo:session): session closed for user root Jun 29 03:23:13 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-9ec76e8f-1c4a-456c-8432-26042913d50d tempest-AttachVolumeNegativeTest-1677376095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-87e0d255-c9c7-4f0b-a7bc-bf7f83fcbc8a" returned: 0 in 1.693s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:23:13 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-9ec76e8f-1c4a-456c-8432-26042913d50d tempest-AttachVolumeNegativeTest-1677376095 None] <== create_volume: return (3175ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:23:13 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-9ec76e8f-1c4a-456c-8432-26042913d50d tempest-AttachVolumeNegativeTest-1677376095 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.190s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:23:13 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-9ec76e8f-1c4a-456c-8432-26042913d50d tempest-AttachVolumeNegativeTest-1677376095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (427e66d8-4da8-4a75-aaf2-f85e238a78a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87e0d255-c9c7-4f0b-a7bc-bf7f83fcbc8a', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:23:13 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-9ec76e8f-1c4a-456c-8432-26042913d50d tempest-AttachVolumeNegativeTest-1677376095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbd13e78-ec13-4bcf-8355-46e93489c077) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:23:13 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-9ec76e8f-1c4a-456c-8432-26042913d50d tempest-AttachVolumeNegativeTest-1677376095 None] Volume volume-87e0d255-c9c7-4f0b-a7bc-bf7f83fcbc8a (87e0d255-c9c7-4f0b-a7bc-bf7f83fcbc8a): created successfully Jun 29 03:23:13 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-9ec76e8f-1c4a-456c-8432-26042913d50d tempest-AttachVolumeNegativeTest-1677376095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbd13e78-ec13-4bcf-8355-46e93489c077) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:23:13 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-9ec76e8f-1c4a-456c-8432-26042913d50d tempest-AttachVolumeNegativeTest-1677376095 None] Flow 'volume_create_manager' (216fd198-3dfd-405b-8eb6-fd0d0e97fec8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:23:13 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-9ec76e8f-1c4a-456c-8432-26042913d50d tempest-AttachVolumeNegativeTest-1677376095 None] Created volume successfully. Jun 29 03:23:13 devstack sudo[96637]: pam_unix(sudo:session): session closed for user root Jun 29 03:23:13 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf" returned: 0 in 1.650s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:23:13 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:23:13 devstack cinder-volume[93468]: DEBUG oslo_service.periodic_task [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Running periodic task VolumeManager._thread_info {{(pid=93468) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 29 03:23:13 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] thread count: 8 {{(pid=93468) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 29 03:23:13 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] thread info: [<_MainThread(MainThread, started 132331377287296)>, , , , , , , ] {{(pid=93468) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 29 03:23:15 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-04666c6e-1ea5-49cc-a0b9-ae58d65c4dd1 tempest-TaggedAttachmentsTest-1111590977 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:23:15 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-04666c6e-1ea5-49cc-a0b9-ae58d65c4dd1 tempest-TaggedAttachmentsTest-1111590977 None] Flow 'volume_create_manager' (9cb68632-5119-449c-bbe1-11f98433ecab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:23:15 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-04666c6e-1ea5-49cc-a0b9-ae58d65c4dd1 tempest-TaggedAttachmentsTest-1111590977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f45e236-c355-4570-b218-a01b5795f651) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:23:15 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-04666c6e-1ea5-49cc-a0b9-ae58d65c4dd1 tempest-TaggedAttachmentsTest-1111590977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f45e236-c355-4570-b218-a01b5795f651) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:23:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1939170595',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03b77915-7a48-45f3-b920-2b33a28ee8ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1541d28ebe0447279bb52ee124431b80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:23:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:23:15Z,use_quota=True,user_id='bd5ebe0bec1b4952a959549bb362b109',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:23:15 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-04666c6e-1ea5-49cc-a0b9-ae58d65c4dd1 tempest-TaggedAttachmentsTest-1111590977 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80b19602-7c00-43da-809e-61afc5cf2ff7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:23:15 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-04666c6e-1ea5-49cc-a0b9-ae58d65c4dd1 tempest-TaggedAttachmentsTest-1111590977 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80b19602-7c00-43da-809e-61afc5cf2ff7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:23:15 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-04666c6e-1ea5-49cc-a0b9-ae58d65c4dd1 tempest-TaggedAttachmentsTest-1111590977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8d7b9b7-ccbd-4663-981a-d405723d3bee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:23:15 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-04666c6e-1ea5-49cc-a0b9-ae58d65c4dd1 tempest-TaggedAttachmentsTest-1111590977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8d7b9b7-ccbd-4663-981a-d405723d3bee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '03b77915-7a48-45f3-b920-2b33a28ee8ae', 'volume_name': 'volume-03b77915-7a48-45f3-b920-2b33a28ee8ae', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:23:15 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-04666c6e-1ea5-49cc-a0b9-ae58d65c4dd1 tempest-TaggedAttachmentsTest-1111590977 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3cb101a9-a560-4f88-b6cc-5c734498db14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:23:15 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-04666c6e-1ea5-49cc-a0b9-ae58d65c4dd1 tempest-TaggedAttachmentsTest-1111590977 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3cb101a9-a560-4f88-b6cc-5c734498db14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:23:15 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-04666c6e-1ea5-49cc-a0b9-ae58d65c4dd1 tempest-TaggedAttachmentsTest-1111590977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd528737-0b11-4160-be2e-243406dfeb87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:23:15 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-04666c6e-1ea5-49cc-a0b9-ae58d65c4dd1 tempest-TaggedAttachmentsTest-1111590977 None] Volume 03b77915-7a48-45f3-b920-2b33a28ee8ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-03b77915-7a48-45f3-b920-2b33a28ee8ae', 'volume_size': 1} Jun 29 03:23:15 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-04666c6e-1ea5-49cc-a0b9-ae58d65c4dd1 tempest-TaggedAttachmentsTest-1111590977 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:23:15 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-04666c6e-1ea5-49cc-a0b9-ae58d65c4dd1 tempest-TaggedAttachmentsTest-1111590977 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:23:15 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-04666c6e-1ea5-49cc-a0b9-ae58d65c4dd1 tempest-TaggedAttachmentsTest-1111590977 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:23:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1939170595',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03b77915-7a48-45f3-b920-2b33a28ee8ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1541d28ebe0447279bb52ee124431b80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:23:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:23:15Z,use_quota=True,user_id='bd5ebe0bec1b4952a959549bb362b109',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:23:15 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-04666c6e-1ea5-49cc-a0b9-ae58d65c4dd1 tempest-TaggedAttachmentsTest-1111590977 None] Creating volume 03b77915-7a48-45f3-b920-2b33a28ee8ae {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:23:15 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-04666c6e-1ea5-49cc-a0b9-ae58d65c4dd1 tempest-TaggedAttachmentsTest-1111590977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:23:15 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-04666c6e-1ea5-49cc-a0b9-ae58d65c4dd1 tempest-TaggedAttachmentsTest-1111590977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:23:15 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-04666c6e-1ea5-49cc-a0b9-ae58d65c4dd1 tempest-TaggedAttachmentsTest-1111590977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:23:15 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-04666c6e-1ea5-49cc-a0b9-ae58d65c4dd1 tempest-TaggedAttachmentsTest-1111590977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:23:15 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-04666c6e-1ea5-49cc-a0b9-ae58d65c4dd1 tempest-TaggedAttachmentsTest-1111590977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:23:15 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-04666c6e-1ea5-49cc-a0b9-ae58d65c4dd1 tempest-TaggedAttachmentsTest-1111590977 None] Selected osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:23:15 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-04666c6e-1ea5-49cc-a0b9-ae58d65c4dd1 tempest-TaggedAttachmentsTest-1111590977 None] casted to osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f Jun 29 03:23:15 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-04666c6e-1ea5-49cc-a0b9-ae58d65c4dd1 tempest-TaggedAttachmentsTest-1111590977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-03b77915-7a48-45f3-b920-2b33a28ee8ae 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:23:15 devstack sudo[96671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-03b77915-7a48-45f3-b920-2b33a28ee8ae 1073741824 Jun 29 03:23:15 devstack sudo[96671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:23:16 devstack cinder-volume[93468]: INFO cinder.volume.manager [req-cbd40a58-4111-4d14-bdab-045805f61eaa req-8d851b6d-33d7-4c06-9f21-37ee3d600ffa tempest-ServerActionsTestOtherA-77222760 None] Terminate volume connection completed successfully. Jun 29 03:23:16 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [req-cbd40a58-4111-4d14-bdab-045805f61eaa req-8d851b6d-33d7-4c06-9f21-37ee3d600ffa tempest-ServerActionsTestOtherA-77222760 None] Deleting attachment 2912f1a6-ea94-4959-bed0-f8e27ca5a911. {{(pid=93468) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 29 03:23:16 devstack sudo[96671]: pam_unix(sudo:session): session closed for user root Jun 29 03:23:16 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-04666c6e-1ea5-49cc-a0b9-ae58d65c4dd1 tempest-TaggedAttachmentsTest-1111590977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-03b77915-7a48-45f3-b920-2b33a28ee8ae 1073741824" returned: 0 in 1.387s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:23:16 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-04666c6e-1ea5-49cc-a0b9-ae58d65c4dd1 tempest-TaggedAttachmentsTest-1111590977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-03b77915-7a48-45f3-b920-2b33a28ee8ae {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:23:16 devstack sudo[96728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-03b77915-7a48-45f3-b920-2b33a28ee8ae Jun 29 03:23:16 devstack sudo[96728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:23:17 devstack sudo[96728]: pam_unix(sudo:session): session closed for user root Jun 29 03:23:17 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-04666c6e-1ea5-49cc-a0b9-ae58d65c4dd1 tempest-TaggedAttachmentsTest-1111590977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-03b77915-7a48-45f3-b920-2b33a28ee8ae" returned: 0 in 0.779s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:23:17 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-04666c6e-1ea5-49cc-a0b9-ae58d65c4dd1 tempest-TaggedAttachmentsTest-1111590977 None] <== create_volume: return (2227ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:23:17 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-04666c6e-1ea5-49cc-a0b9-ae58d65c4dd1 tempest-TaggedAttachmentsTest-1111590977 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.230s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:23:17 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-04666c6e-1ea5-49cc-a0b9-ae58d65c4dd1 tempest-TaggedAttachmentsTest-1111590977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd528737-0b11-4160-be2e-243406dfeb87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03b77915-7a48-45f3-b920-2b33a28ee8ae', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:23:17 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-04666c6e-1ea5-49cc-a0b9-ae58d65c4dd1 tempest-TaggedAttachmentsTest-1111590977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5c6f0f9-c497-43c6-8a35-7f49905e60c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:23:17 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-04666c6e-1ea5-49cc-a0b9-ae58d65c4dd1 tempest-TaggedAttachmentsTest-1111590977 None] Volume volume-03b77915-7a48-45f3-b920-2b33a28ee8ae (03b77915-7a48-45f3-b920-2b33a28ee8ae): created successfully Jun 29 03:23:17 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-04666c6e-1ea5-49cc-a0b9-ae58d65c4dd1 tempest-TaggedAttachmentsTest-1111590977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5c6f0f9-c497-43c6-8a35-7f49905e60c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:23:17 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-04666c6e-1ea5-49cc-a0b9-ae58d65c4dd1 tempest-TaggedAttachmentsTest-1111590977 None] Flow 'volume_create_manager' (9cb68632-5119-449c-bbe1-11f98433ecab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:23:17 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-04666c6e-1ea5-49cc-a0b9-ae58d65c4dd1 tempest-TaggedAttachmentsTest-1111590977 None] Created volume successfully. Jun 29 03:23:17 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [req-fff5ffb2-3fae-4cfd-88fe-0baaa723e12e req-58da4170-4998-40bd-b58a-dcbfe1293fa6 tempest-AttachVolumeNegativeTest-1677376095 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:23:17 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [req-fff5ffb2-3fae-4cfd-88fe-0baaa723e12e req-58da4170-4998-40bd-b58a-dcbfe1293fa6 tempest-AttachVolumeNegativeTest-1677376095 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:23:17 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[496c2188-0ba9-47d0-b004-8a944c3cfd56]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:23:17 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [req-fff5ffb2-3fae-4cfd-88fe-0baaa723e12e req-58da4170-4998-40bd-b58a-dcbfe1293fa6 tempest-AttachVolumeNegativeTest-1677376095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-87e0d255-c9c7-4f0b-a7bc-bf7f83fcbc8a {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:23:17 devstack sudo[96743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-87e0d255-c9c7-4f0b-a7bc-bf7f83fcbc8a Jun 29 03:23:17 devstack sudo[96743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:23:18 devstack sudo[96743]: pam_unix(sudo:session): session closed for user root Jun 29 03:23:18 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [req-fff5ffb2-3fae-4cfd-88fe-0baaa723e12e req-58da4170-4998-40bd-b58a-dcbfe1293fa6 tempest-AttachVolumeNegativeTest-1677376095 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-87e0d255-c9c7-4f0b-a7bc-bf7f83fcbc8a" returned: 0 in 0.919s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:23:18 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [req-cbd40a58-4111-4d14-bdab-045805f61eaa req-214fa133-e026-4e38-988a-c72967d98244 tempest-ServerActionsTestOtherA-77222760 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:23:18 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [req-fff5ffb2-3fae-4cfd-88fe-0baaa723e12e req-58da4170-4998-40bd-b58a-dcbfe1293fa6 tempest-AttachVolumeNegativeTest-1677376095 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.937s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:23:18 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [req-cbd40a58-4111-4d14-bdab-045805f61eaa req-214fa133-e026-4e38-988a-c72967d98244 tempest-ServerActionsTestOtherA-77222760 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:23:18 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[24d9e9ba-80a9-45aa-bc99-f6b90394b1a6]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:23:18 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [req-cbd40a58-4111-4d14-bdab-045805f61eaa req-214fa133-e026-4e38-988a-c72967d98244 tempest-ServerActionsTestOtherA-77222760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-5d235420-f06b-4b17-bb1f-8025e81a6d95 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:23:18 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [req-fff5ffb2-3fae-4cfd-88fe-0baaa723e12e req-58da4170-4998-40bd-b58a-dcbfe1293fa6 tempest-AttachVolumeNegativeTest-1677376095 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f', 'name': 'volume-87e0d255-c9c7-4f0b-a7bc-bf7f83fcbc8a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6ac2520c-11ac-448b-ba11-79a2c655faea', 'enforce_multipath': True} {{(pid=93468) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 29 03:23:18 devstack cinder-volume[93468]: INFO cinder.volume.manager [req-fff5ffb2-3fae-4cfd-88fe-0baaa723e12e req-58da4170-4998-40bd-b58a-dcbfe1293fa6 tempest-AttachVolumeNegativeTest-1677376095 None] attachment_update completed successfully. Jun 29 03:23:18 devstack sudo[96772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-5d235420-f06b-4b17-bb1f-8025e81a6d95 Jun 29 03:23:18 devstack sudo[96772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:23:19 devstack sudo[96772]: pam_unix(sudo:session): session closed for user root Jun 29 03:23:19 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [req-cbd40a58-4111-4d14-bdab-045805f61eaa req-214fa133-e026-4e38-988a-c72967d98244 tempest-ServerActionsTestOtherA-77222760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-5d235420-f06b-4b17-bb1f-8025e81a6d95" returned: 0 in 0.865s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:23:19 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [req-cbd40a58-4111-4d14-bdab-045805f61eaa req-214fa133-e026-4e38-988a-c72967d98244 tempest-ServerActionsTestOtherA-77222760 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.890s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:23:19 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [req-cbd40a58-4111-4d14-bdab-045805f61eaa req-214fa133-e026-4e38-988a-c72967d98244 tempest-ServerActionsTestOtherA-77222760 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f', 'name': 'volume-5d235420-f06b-4b17-bb1f-8025e81a6d95', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7ccb0b8e-4a38-4ff6-9355-8f0050a19968', 'enforce_multipath': True} {{(pid=93468) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 29 03:23:19 devstack cinder-volume[93468]: INFO cinder.volume.manager [req-cbd40a58-4111-4d14-bdab-045805f61eaa req-214fa133-e026-4e38-988a-c72967d98244 tempest-ServerActionsTestOtherA-77222760 None] attachment_update completed successfully. Jun 29 03:23:29 devstack cinder-volume[93468]: DEBUG dbcounter [-] [93468] Writing DB stats cinder:SELECT=26,cinder:UPDATE=10,cinder:INSERT=1,cinder:DELETE=2 {{(pid=93468) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 29 03:23:29 devstack cinder-volume[93468]: DEBUG dbcounter [-] [93468] Writing DB stats cinder:UPDATE=12,cinder:SELECT=18,cinder:INSERT=1 {{(pid=93468) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 29 03:23:32 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-5152644b-035d-47bb-8c0c-6c4b4feb3d9f tempest-AttachVolumeShelveTestJSON-650046129 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:23:32 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-5152644b-035d-47bb-8c0c-6c4b4feb3d9f tempest-AttachVolumeShelveTestJSON-650046129 None] Flow 'volume_create_manager' (3356d223-bf2c-43e9-9a47-f0df2a3259f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:23:32 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-5152644b-035d-47bb-8c0c-6c4b4feb3d9f tempest-AttachVolumeShelveTestJSON-650046129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f6133ce-29b4-4f8f-b2d2-f47f572d4fdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:23:32 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-5152644b-035d-47bb-8c0c-6c4b4feb3d9f tempest-AttachVolumeShelveTestJSON-650046129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f6133ce-29b4-4f8f-b2d2-f47f572d4fdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:23:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1398614341',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ef242e9-34b2-4a85-afc3-17ad90746cc4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1586ad9027b0484ba1ff5dafa58b939d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:23:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:23:32Z,use_quota=True,user_id='1b1e8f2771eb4e31ba1a899f01e0bc5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:23:32 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-5152644b-035d-47bb-8c0c-6c4b4feb3d9f tempest-AttachVolumeShelveTestJSON-650046129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59377cc1-8188-489a-94d2-181208b0da7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:23:32 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-5152644b-035d-47bb-8c0c-6c4b4feb3d9f tempest-AttachVolumeShelveTestJSON-650046129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59377cc1-8188-489a-94d2-181208b0da7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:23:32 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-5152644b-035d-47bb-8c0c-6c4b4feb3d9f tempest-AttachVolumeShelveTestJSON-650046129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82c57e78-00e8-4704-a6c3-5fc9c0d99b11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:23:32 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-5152644b-035d-47bb-8c0c-6c4b4feb3d9f tempest-AttachVolumeShelveTestJSON-650046129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82c57e78-00e8-4704-a6c3-5fc9c0d99b11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2ef242e9-34b2-4a85-afc3-17ad90746cc4', 'volume_name': 'volume-2ef242e9-34b2-4a85-afc3-17ad90746cc4', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:23:32 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-5152644b-035d-47bb-8c0c-6c4b4feb3d9f tempest-AttachVolumeShelveTestJSON-650046129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6abf4e8-cf2c-4891-a475-d933ca49854e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:23:32 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-5152644b-035d-47bb-8c0c-6c4b4feb3d9f tempest-AttachVolumeShelveTestJSON-650046129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6abf4e8-cf2c-4891-a475-d933ca49854e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:23:32 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-5152644b-035d-47bb-8c0c-6c4b4feb3d9f tempest-AttachVolumeShelveTestJSON-650046129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d09b41a8-f1d3-40ad-a11f-32f3ebab3bc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:23:32 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-5152644b-035d-47bb-8c0c-6c4b4feb3d9f tempest-AttachVolumeShelveTestJSON-650046129 None] Volume 2ef242e9-34b2-4a85-afc3-17ad90746cc4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2ef242e9-34b2-4a85-afc3-17ad90746cc4', 'volume_size': 1} Jun 29 03:23:32 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-5152644b-035d-47bb-8c0c-6c4b4feb3d9f tempest-AttachVolumeShelveTestJSON-650046129 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:23:32 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-5152644b-035d-47bb-8c0c-6c4b4feb3d9f tempest-AttachVolumeShelveTestJSON-650046129 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:23:32 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-5152644b-035d-47bb-8c0c-6c4b4feb3d9f tempest-AttachVolumeShelveTestJSON-650046129 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:23:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1398614341',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ef242e9-34b2-4a85-afc3-17ad90746cc4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1586ad9027b0484ba1ff5dafa58b939d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:23:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:23:32Z,use_quota=True,user_id='1b1e8f2771eb4e31ba1a899f01e0bc5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:23:32 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-5152644b-035d-47bb-8c0c-6c4b4feb3d9f tempest-AttachVolumeShelveTestJSON-650046129 None] Creating volume 2ef242e9-34b2-4a85-afc3-17ad90746cc4 {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:23:32 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-5152644b-035d-47bb-8c0c-6c4b4feb3d9f tempest-AttachVolumeShelveTestJSON-650046129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:23:32 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-5152644b-035d-47bb-8c0c-6c4b4feb3d9f tempest-AttachVolumeShelveTestJSON-650046129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:23:32 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-5152644b-035d-47bb-8c0c-6c4b4feb3d9f tempest-AttachVolumeShelveTestJSON-650046129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:23:32 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-5152644b-035d-47bb-8c0c-6c4b4feb3d9f tempest-AttachVolumeShelveTestJSON-650046129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:23:32 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-5152644b-035d-47bb-8c0c-6c4b4feb3d9f tempest-AttachVolumeShelveTestJSON-650046129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:23:32 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-5152644b-035d-47bb-8c0c-6c4b4feb3d9f tempest-AttachVolumeShelveTestJSON-650046129 None] Selected osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:23:32 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-5152644b-035d-47bb-8c0c-6c4b4feb3d9f tempest-AttachVolumeShelveTestJSON-650046129 None] casted to osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f Jun 29 03:23:32 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-5152644b-035d-47bb-8c0c-6c4b4feb3d9f tempest-AttachVolumeShelveTestJSON-650046129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-2ef242e9-34b2-4a85-afc3-17ad90746cc4 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:23:32 devstack sudo[97282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-2ef242e9-34b2-4a85-afc3-17ad90746cc4 1073741824 Jun 29 03:23:32 devstack sudo[97282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:23:33 devstack sudo[97282]: pam_unix(sudo:session): session closed for user root Jun 29 03:23:33 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-5152644b-035d-47bb-8c0c-6c4b4feb3d9f tempest-AttachVolumeShelveTestJSON-650046129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-2ef242e9-34b2-4a85-afc3-17ad90746cc4 1073741824" returned: 0 in 0.930s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:23:33 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-5152644b-035d-47bb-8c0c-6c4b4feb3d9f tempest-AttachVolumeShelveTestJSON-650046129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-2ef242e9-34b2-4a85-afc3-17ad90746cc4 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:23:33 devstack sudo[97292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-2ef242e9-34b2-4a85-afc3-17ad90746cc4 Jun 29 03:23:33 devstack sudo[97292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:23:34 devstack sudo[97292]: pam_unix(sudo:session): session closed for user root Jun 29 03:23:34 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-5152644b-035d-47bb-8c0c-6c4b4feb3d9f tempest-AttachVolumeShelveTestJSON-650046129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-2ef242e9-34b2-4a85-afc3-17ad90746cc4" returned: 0 in 0.929s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:23:34 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-5152644b-035d-47bb-8c0c-6c4b4feb3d9f tempest-AttachVolumeShelveTestJSON-650046129 None] <== create_volume: return (1908ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:23:34 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-5152644b-035d-47bb-8c0c-6c4b4feb3d9f tempest-AttachVolumeShelveTestJSON-650046129 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.910s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:23:34 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-5152644b-035d-47bb-8c0c-6c4b4feb3d9f tempest-AttachVolumeShelveTestJSON-650046129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d09b41a8-f1d3-40ad-a11f-32f3ebab3bc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ef242e9-34b2-4a85-afc3-17ad90746cc4', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:23:34 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-5152644b-035d-47bb-8c0c-6c4b4feb3d9f tempest-AttachVolumeShelveTestJSON-650046129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7726edd1-1b09-42c4-bbd8-33d6d553b041) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:23:34 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-5152644b-035d-47bb-8c0c-6c4b4feb3d9f tempest-AttachVolumeShelveTestJSON-650046129 None] Volume volume-2ef242e9-34b2-4a85-afc3-17ad90746cc4 (2ef242e9-34b2-4a85-afc3-17ad90746cc4): created successfully Jun 29 03:23:34 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-5152644b-035d-47bb-8c0c-6c4b4feb3d9f tempest-AttachVolumeShelveTestJSON-650046129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7726edd1-1b09-42c4-bbd8-33d6d553b041) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:23:34 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-5152644b-035d-47bb-8c0c-6c4b4feb3d9f tempest-AttachVolumeShelveTestJSON-650046129 None] Flow 'volume_create_manager' (3356d223-bf2c-43e9-9a47-f0df2a3259f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:23:34 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-5152644b-035d-47bb-8c0c-6c4b4feb3d9f tempest-AttachVolumeShelveTestJSON-650046129 None] Created volume successfully. Jun 29 03:23:44 devstack cinder-volume[93468]: DEBUG dbcounter [-] [93468] Writing DB stats cinder:SELECT=3,cinder:UPDATE=3,cinder:INSERT=1 {{(pid=93468) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 29 03:23:44 devstack cinder-volume[93468]: DEBUG dbcounter [-] [93468] Writing DB stats cinder:UPDATE=3,cinder:SELECT=1,cinder:DELETE=1 {{(pid=93468) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 29 03:23:54 devstack cinder-volume[93468]: INFO cinder.volume.manager [req-8f210f95-535a-441f-899d-b1bc9b2566a3 req-f4251b46-e66c-4e2b-b520-9f825d11a840 tempest-ServerActionsTestOtherA-77222760 None] Terminate volume connection completed successfully. Jun 29 03:23:54 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [req-8f210f95-535a-441f-899d-b1bc9b2566a3 req-f4251b46-e66c-4e2b-b520-9f825d11a840 tempest-ServerActionsTestOtherA-77222760 None] Deleting attachment 7ccb0b8e-4a38-4ff6-9355-8f0050a19968. {{(pid=93468) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 29 03:23:54 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [req-231a4a7b-4910-4a74-a8ae-5a3a7ed35b8e req-e00e10ff-b347-4f83-86a3-0442419bacac tempest-AttachVolumeShelveTestJSON-650046129 None] No connector for attachment ef920ec3-d823-4fba-b0e1-2804eb1c6920; skipping storage backend terminate_connection call. {{(pid=93468) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Jun 29 03:23:54 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [req-231a4a7b-4910-4a74-a8ae-5a3a7ed35b8e req-e00e10ff-b347-4f83-86a3-0442419bacac tempest-AttachVolumeShelveTestJSON-650046129 None] Deleting attachment ef920ec3-d823-4fba-b0e1-2804eb1c6920. {{(pid=93468) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 29 03:24:04 devstack cinder-volume[93468]: DEBUG dbcounter [-] [93468] Writing DB stats cinder:SELECT=1 {{(pid=93468) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 29 03:24:04 devstack cinder-volume[93468]: DEBUG dbcounter [-] [93468] Writing DB stats cinder:SELECT=3 {{(pid=93468) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 29 03:24:06 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-3d0c2eb6-0473-4d13-8484-5f8cba858573 tempest-ServerActionsTestOtherA-77222760 None] Acquiring lock "cinder-5d235420-f06b-4b17-bb1f-8025e81a6d95-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:24:06 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-3d0c2eb6-0473-4d13-8484-5f8cba858573 tempest-ServerActionsTestOtherA-77222760 None] Lock "cinder-5d235420-f06b-4b17-bb1f-8025e81a6d95-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:24:06 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-3d0c2eb6-0473-4d13-8484-5f8cba858573 tempest-ServerActionsTestOtherA-77222760 None] Acquiring lock "cinder-quobyte-5d235420-f06b-4b17-bb1f-8025e81a6d95" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:24:06 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-3d0c2eb6-0473-4d13-8484-5f8cba858573 tempest-ServerActionsTestOtherA-77222760 None] Lock "cinder-quobyte-5d235420-f06b-4b17-bb1f-8025e81a6d95" acquired by "delete_volume" :: waited 0.034s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:24:06 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[aba2d1a5-cd01-417a-b7ed-b44d75cdf2bb]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:24:06 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-3d0c2eb6-0473-4d13-8484-5f8cba858573 tempest-ServerActionsTestOtherA-77222760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-5d235420-f06b-4b17-bb1f-8025e81a6d95 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:24:07 devstack sudo[97777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-5d235420-f06b-4b17-bb1f-8025e81a6d95 Jun 29 03:24:07 devstack sudo[97777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:24:08 devstack sudo[97777]: pam_unix(sudo:session): session closed for user root Jun 29 03:24:08 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-3d0c2eb6-0473-4d13-8484-5f8cba858573 tempest-ServerActionsTestOtherA-77222760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-5d235420-f06b-4b17-bb1f-8025e81a6d95" returned: 0 in 1.255s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:24:08 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-3d0c2eb6-0473-4d13-8484-5f8cba858573 tempest-ServerActionsTestOtherA-77222760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-5d235420-f06b-4b17-bb1f-8025e81a6d95 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:24:08 devstack sudo[97798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-5d235420-f06b-4b17-bb1f-8025e81a6d95 Jun 29 03:24:08 devstack sudo[97798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:24:08 devstack sudo[97798]: pam_unix(sudo:session): session closed for user root Jun 29 03:24:08 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-3d0c2eb6-0473-4d13-8484-5f8cba858573 tempest-ServerActionsTestOtherA-77222760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-5d235420-f06b-4b17-bb1f-8025e81a6d95" returned: 0 in 0.851s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:24:08 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-3d0c2eb6-0473-4d13-8484-5f8cba858573 tempest-ServerActionsTestOtherA-77222760 None] Lock "cinder-quobyte-5d235420-f06b-4b17-bb1f-8025e81a6d95" released by "delete_volume" :: held 2.209s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:24:09 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-3d0c2eb6-0473-4d13-8484-5f8cba858573 tempest-ServerActionsTestOtherA-77222760 None] Created reservations ['f075b3b0-aabb-4351-8d13-99c8d580c39f', '383f0577-78d0-4f09-acbe-43dc1077e789', 'e5e452ea-dcd8-4a99-852f-d6ae934d1cd9', '16249cd1-5669-4384-a8c7-d9795ed043f5'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:24:09 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-3d0c2eb6-0473-4d13-8484-5f8cba858573 tempest-ServerActionsTestOtherA-77222760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:24:09 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-3d0c2eb6-0473-4d13-8484-5f8cba858573 tempest-ServerActionsTestOtherA-77222760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:24:09 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-3d0c2eb6-0473-4d13-8484-5f8cba858573 tempest-ServerActionsTestOtherA-77222760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:24:09 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-3d0c2eb6-0473-4d13-8484-5f8cba858573 tempest-ServerActionsTestOtherA-77222760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:24:09 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-3d0c2eb6-0473-4d13-8484-5f8cba858573 tempest-ServerActionsTestOtherA-77222760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:24:09 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-3d0c2eb6-0473-4d13-8484-5f8cba858573 tempest-ServerActionsTestOtherA-77222760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:24:09 devstack sudo[97815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf Jun 29 03:24:09 devstack sudo[97815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:24:09 devstack sudo[97815]: pam_unix(sudo:session): session closed for user root Jun 29 03:24:09 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-3d0c2eb6-0473-4d13-8484-5f8cba858573 tempest-ServerActionsTestOtherA-77222760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf" returned: 0 in 0.703s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:24:09 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-3d0c2eb6-0473-4d13-8484-5f8cba858573 tempest-ServerActionsTestOtherA-77222760 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:24:09 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-3d0c2eb6-0473-4d13-8484-5f8cba858573 tempest-ServerActionsTestOtherA-77222760 None] Deleted volume successfully. Jun 29 03:24:09 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-3d0c2eb6-0473-4d13-8484-5f8cba858573 tempest-ServerActionsTestOtherA-77222760 None] Lock "cinder-5d235420-f06b-4b17-bb1f-8025e81a6d95-delete_volume" released by "delete_volume" :: held 3.235s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:24:11 devstack cinder-volume[93468]: DEBUG oslo_service.periodic_task [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93468) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 29 03:24:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:24:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:24:11 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:24:11 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:24:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:24:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:24:11 devstack sudo[97919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf Jun 29 03:24:11 devstack sudo[97919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:24:13 devstack sudo[97919]: pam_unix(sudo:session): session closed for user root Jun 29 03:24:13 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf" returned: 0 in 1.514s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:24:13 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:24:13 devstack cinder-volume[93468]: DEBUG oslo_service.periodic_task [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Running periodic task VolumeManager._thread_info {{(pid=93468) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 29 03:24:13 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] thread count: 8 {{(pid=93468) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 29 03:24:13 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] thread info: [<_MainThread(MainThread, started 132331377287296)>, , , , , , , ] {{(pid=93468) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 29 03:24:19 devstack cinder-volume[93468]: DEBUG dbcounter [-] [93468] Writing DB stats cinder:UPDATE=7,cinder:SELECT=6,cinder:INSERT=1 {{(pid=93468) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 29 03:24:19 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [req-3b5a5859-28b0-41b6-bf9d-d6857380674d req-ea12bf75-0806-4056-9d40-35e19f7216a0 tempest-TaggedAttachmentsTest-1111590977 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:24:19 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [req-3b5a5859-28b0-41b6-bf9d-d6857380674d req-ea12bf75-0806-4056-9d40-35e19f7216a0 tempest-TaggedAttachmentsTest-1111590977 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:24:19 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b1bbe4f-a8cf-4ec6-a664-90a625d06eeb]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:24:19 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [req-3b5a5859-28b0-41b6-bf9d-d6857380674d req-ea12bf75-0806-4056-9d40-35e19f7216a0 tempest-TaggedAttachmentsTest-1111590977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-03b77915-7a48-45f3-b920-2b33a28ee8ae {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:24:19 devstack sudo[98120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-03b77915-7a48-45f3-b920-2b33a28ee8ae Jun 29 03:24:19 devstack sudo[98120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:24:20 devstack sudo[98120]: pam_unix(sudo:session): session closed for user root Jun 29 03:24:20 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [req-3b5a5859-28b0-41b6-bf9d-d6857380674d req-ea12bf75-0806-4056-9d40-35e19f7216a0 tempest-TaggedAttachmentsTest-1111590977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-03b77915-7a48-45f3-b920-2b33a28ee8ae" returned: 0 in 0.942s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:24:20 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [req-3b5a5859-28b0-41b6-bf9d-d6857380674d req-ea12bf75-0806-4056-9d40-35e19f7216a0 tempest-TaggedAttachmentsTest-1111590977 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.973s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:24:20 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [req-3b5a5859-28b0-41b6-bf9d-d6857380674d req-ea12bf75-0806-4056-9d40-35e19f7216a0 tempest-TaggedAttachmentsTest-1111590977 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f', 'name': 'volume-03b77915-7a48-45f3-b920-2b33a28ee8ae', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f9d46e97-4c5f-4e1b-81db-784bb80b2ca3', 'enforce_multipath': True} {{(pid=93468) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 29 03:24:20 devstack cinder-volume[93468]: INFO cinder.volume.manager [req-3b5a5859-28b0-41b6-bf9d-d6857380674d req-ea12bf75-0806-4056-9d40-35e19f7216a0 tempest-TaggedAttachmentsTest-1111590977 None] attachment_update completed successfully. Jun 29 03:24:22 devstack cinder-volume[93468]: INFO cinder.volume.manager [req-fe79550f-7f7e-489d-b0aa-e2667f148cce req-b0a1a7c8-6a78-4946-976a-8af60d57b25a tempest-AttachVolumeNegativeTest-1677376095 None] Terminate volume connection completed successfully. Jun 29 03:24:22 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [req-fe79550f-7f7e-489d-b0aa-e2667f148cce req-b0a1a7c8-6a78-4946-976a-8af60d57b25a tempest-AttachVolumeNegativeTest-1677376095 None] Deleting attachment 6ac2520c-11ac-448b-ba11-79a2c655faea. {{(pid=93468) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 29 03:24:28 devstack cinder-volume[93468]: INFO cinder.volume.manager [req-28622df9-1c82-4063-94fd-5e80a8d7afe2 req-9ee9abb6-093a-4fac-8f17-8af1bdafe80c tempest-TaggedAttachmentsTest-1111590977 None] Terminate volume connection completed successfully. Jun 29 03:24:28 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [req-28622df9-1c82-4063-94fd-5e80a8d7afe2 req-9ee9abb6-093a-4fac-8f17-8af1bdafe80c tempest-TaggedAttachmentsTest-1111590977 None] Deleting attachment f9d46e97-4c5f-4e1b-81db-784bb80b2ca3. {{(pid=93468) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 29 03:24:38 devstack cinder-volume[93468]: DEBUG dbcounter [-] [93468] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=93468) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 29 03:24:38 devstack cinder-volume[93468]: DEBUG dbcounter [-] [93468] Writing DB stats cinder:SELECT=13,cinder:INSERT=3,cinder:UPDATE=11,cinder:DELETE=1 {{(pid=93468) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 29 03:24:51 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-506f666f-49b3-41b6-ba95-2190ecd56923 tempest-TaggedAttachmentsTest-1111590977 None] Acquiring lock "cinder-03b77915-7a48-45f3-b920-2b33a28ee8ae-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:24:51 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-506f666f-49b3-41b6-ba95-2190ecd56923 tempest-TaggedAttachmentsTest-1111590977 None] Lock "cinder-03b77915-7a48-45f3-b920-2b33a28ee8ae-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:24:51 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-506f666f-49b3-41b6-ba95-2190ecd56923 tempest-TaggedAttachmentsTest-1111590977 None] Acquiring lock "cinder-quobyte-03b77915-7a48-45f3-b920-2b33a28ee8ae" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:24:51 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-506f666f-49b3-41b6-ba95-2190ecd56923 tempest-TaggedAttachmentsTest-1111590977 None] Lock "cinder-quobyte-03b77915-7a48-45f3-b920-2b33a28ee8ae" acquired by "delete_volume" :: waited 0.029s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:24:51 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[06a5b79a-37e8-4e24-a993-4bedbe20fa98]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:24:51 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-506f666f-49b3-41b6-ba95-2190ecd56923 tempest-TaggedAttachmentsTest-1111590977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-03b77915-7a48-45f3-b920-2b33a28ee8ae {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:24:51 devstack sudo[98427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-03b77915-7a48-45f3-b920-2b33a28ee8ae Jun 29 03:24:51 devstack sudo[98427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:24:52 devstack sudo[98427]: pam_unix(sudo:session): session closed for user root Jun 29 03:24:52 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-506f666f-49b3-41b6-ba95-2190ecd56923 tempest-TaggedAttachmentsTest-1111590977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-03b77915-7a48-45f3-b920-2b33a28ee8ae" returned: 0 in 1.450s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:24:52 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-506f666f-49b3-41b6-ba95-2190ecd56923 tempest-TaggedAttachmentsTest-1111590977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-03b77915-7a48-45f3-b920-2b33a28ee8ae {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:24:52 devstack sudo[98495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-03b77915-7a48-45f3-b920-2b33a28ee8ae Jun 29 03:24:52 devstack sudo[98495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:24:54 devstack sudo[98495]: pam_unix(sudo:session): session closed for user root Jun 29 03:24:54 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-506f666f-49b3-41b6-ba95-2190ecd56923 tempest-TaggedAttachmentsTest-1111590977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-03b77915-7a48-45f3-b920-2b33a28ee8ae" returned: 0 in 1.327s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:24:54 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-506f666f-49b3-41b6-ba95-2190ecd56923 tempest-TaggedAttachmentsTest-1111590977 None] Lock "cinder-quobyte-03b77915-7a48-45f3-b920-2b33a28ee8ae" released by "delete_volume" :: held 2.868s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:24:54 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-506f666f-49b3-41b6-ba95-2190ecd56923 tempest-TaggedAttachmentsTest-1111590977 None] Created reservations ['94f50b8d-cd43-4f55-a9b0-973da5c7ae98', 'e820c28e-2c0b-4ed4-af8b-0745fe2cf79e', '40da35f2-7500-49d4-8ea8-6aff54915987', 'd2867315-bf74-4f5a-b6c6-44e093c9756a'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:24:54 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-506f666f-49b3-41b6-ba95-2190ecd56923 tempest-TaggedAttachmentsTest-1111590977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:24:54 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-506f666f-49b3-41b6-ba95-2190ecd56923 tempest-TaggedAttachmentsTest-1111590977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:24:54 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-506f666f-49b3-41b6-ba95-2190ecd56923 tempest-TaggedAttachmentsTest-1111590977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:24:54 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-506f666f-49b3-41b6-ba95-2190ecd56923 tempest-TaggedAttachmentsTest-1111590977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:24:54 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-506f666f-49b3-41b6-ba95-2190ecd56923 tempest-TaggedAttachmentsTest-1111590977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:24:54 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-506f666f-49b3-41b6-ba95-2190ecd56923 tempest-TaggedAttachmentsTest-1111590977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:24:54 devstack sudo[98533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf Jun 29 03:24:54 devstack sudo[98533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:24:55 devstack sudo[98533]: pam_unix(sudo:session): session closed for user root Jun 29 03:24:55 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-506f666f-49b3-41b6-ba95-2190ecd56923 tempest-TaggedAttachmentsTest-1111590977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf" returned: 0 in 1.036s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:24:55 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-506f666f-49b3-41b6-ba95-2190ecd56923 tempest-TaggedAttachmentsTest-1111590977 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:24:55 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-506f666f-49b3-41b6-ba95-2190ecd56923 tempest-TaggedAttachmentsTest-1111590977 None] Deleted volume successfully. Jun 29 03:24:55 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-506f666f-49b3-41b6-ba95-2190ecd56923 tempest-TaggedAttachmentsTest-1111590977 None] Lock "cinder-03b77915-7a48-45f3-b920-2b33a28ee8ae-delete_volume" released by "delete_volume" :: held 4.316s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:24:56 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-d38b2052-fcf1-4fcd-b1a0-3b5a9d6b78d1 tempest-AttachVolumeShelveTestJSON-650046129 None] Acquiring lock "cinder-2ef242e9-34b2-4a85-afc3-17ad90746cc4-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:24:56 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-d38b2052-fcf1-4fcd-b1a0-3b5a9d6b78d1 tempest-AttachVolumeShelveTestJSON-650046129 None] Lock "cinder-2ef242e9-34b2-4a85-afc3-17ad90746cc4-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:24:56 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-d38b2052-fcf1-4fcd-b1a0-3b5a9d6b78d1 tempest-AttachVolumeShelveTestJSON-650046129 None] Acquiring lock "cinder-quobyte-2ef242e9-34b2-4a85-afc3-17ad90746cc4" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:24:56 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-d38b2052-fcf1-4fcd-b1a0-3b5a9d6b78d1 tempest-AttachVolumeShelveTestJSON-650046129 None] Lock "cinder-quobyte-2ef242e9-34b2-4a85-afc3-17ad90746cc4" acquired by "delete_volume" :: waited 0.030s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:24:56 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bdc7391-13f6-4abf-babc-8c53a11714fb]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:24:56 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d38b2052-fcf1-4fcd-b1a0-3b5a9d6b78d1 tempest-AttachVolumeShelveTestJSON-650046129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-2ef242e9-34b2-4a85-afc3-17ad90746cc4 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:24:56 devstack sudo[98540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-2ef242e9-34b2-4a85-afc3-17ad90746cc4 Jun 29 03:24:56 devstack sudo[98540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:24:57 devstack sudo[98540]: pam_unix(sudo:session): session closed for user root Jun 29 03:24:57 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d38b2052-fcf1-4fcd-b1a0-3b5a9d6b78d1 tempest-AttachVolumeShelveTestJSON-650046129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-2ef242e9-34b2-4a85-afc3-17ad90746cc4" returned: 0 in 1.222s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:24:57 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d38b2052-fcf1-4fcd-b1a0-3b5a9d6b78d1 tempest-AttachVolumeShelveTestJSON-650046129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-2ef242e9-34b2-4a85-afc3-17ad90746cc4 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:24:57 devstack sudo[98557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-2ef242e9-34b2-4a85-afc3-17ad90746cc4 Jun 29 03:24:57 devstack sudo[98557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:24:58 devstack sudo[98557]: pam_unix(sudo:session): session closed for user root Jun 29 03:24:59 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d38b2052-fcf1-4fcd-b1a0-3b5a9d6b78d1 tempest-AttachVolumeShelveTestJSON-650046129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-2ef242e9-34b2-4a85-afc3-17ad90746cc4" returned: 0 in 1.571s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:24:59 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-d38b2052-fcf1-4fcd-b1a0-3b5a9d6b78d1 tempest-AttachVolumeShelveTestJSON-650046129 None] Lock "cinder-quobyte-2ef242e9-34b2-4a85-afc3-17ad90746cc4" released by "delete_volume" :: held 2.906s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:24:59 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-d38b2052-fcf1-4fcd-b1a0-3b5a9d6b78d1 tempest-AttachVolumeShelveTestJSON-650046129 None] Created reservations ['37185872-169e-4c92-86a2-40425d9d35e0', '9d0ebe78-de53-4271-afd0-dcfd29b0016a', 'db5a16be-da9c-408e-800a-9ab8dd652c01', '83957c0f-be26-45f4-b74d-16f3abf59ffe'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:24:59 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-d38b2052-fcf1-4fcd-b1a0-3b5a9d6b78d1 tempest-AttachVolumeShelveTestJSON-650046129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:24:59 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-d38b2052-fcf1-4fcd-b1a0-3b5a9d6b78d1 tempest-AttachVolumeShelveTestJSON-650046129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:24:59 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-d38b2052-fcf1-4fcd-b1a0-3b5a9d6b78d1 tempest-AttachVolumeShelveTestJSON-650046129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:24:59 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-d38b2052-fcf1-4fcd-b1a0-3b5a9d6b78d1 tempest-AttachVolumeShelveTestJSON-650046129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:24:59 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-d38b2052-fcf1-4fcd-b1a0-3b5a9d6b78d1 tempest-AttachVolumeShelveTestJSON-650046129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:24:59 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d38b2052-fcf1-4fcd-b1a0-3b5a9d6b78d1 tempest-AttachVolumeShelveTestJSON-650046129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:24:59 devstack sudo[98627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf Jun 29 03:24:59 devstack sudo[98627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:25:00 devstack sudo[98627]: pam_unix(sudo:session): session closed for user root Jun 29 03:25:00 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d38b2052-fcf1-4fcd-b1a0-3b5a9d6b78d1 tempest-AttachVolumeShelveTestJSON-650046129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf" returned: 0 in 1.368s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:25:00 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-d38b2052-fcf1-4fcd-b1a0-3b5a9d6b78d1 tempest-AttachVolumeShelveTestJSON-650046129 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:25:00 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-d38b2052-fcf1-4fcd-b1a0-3b5a9d6b78d1 tempest-AttachVolumeShelveTestJSON-650046129 None] Deleted volume successfully. Jun 29 03:25:00 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-d38b2052-fcf1-4fcd-b1a0-3b5a9d6b78d1 tempest-AttachVolumeShelveTestJSON-650046129 None] Lock "cinder-2ef242e9-34b2-4a85-afc3-17ad90746cc4-delete_volume" released by "delete_volume" :: held 4.739s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:25:10 devstack cinder-volume[93468]: DEBUG dbcounter [-] [93468] Writing DB stats cinder:SELECT=9,cinder:INSERT=3,cinder:UPDATE=17,cinder:DELETE=1 {{(pid=93468) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 29 03:25:10 devstack cinder-volume[93468]: DEBUG dbcounter [-] [93468] Writing DB stats cinder:SELECT=12,cinder:UPDATE=16,cinder:INSERT=5,cinder:DELETE=1 {{(pid=93468) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 29 03:25:11 devstack cinder-volume[93468]: DEBUG oslo_service.periodic_task [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93468) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 29 03:25:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:25:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:25:11 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:25:11 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:25:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:25:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:25:11 devstack sudo[99095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf Jun 29 03:25:11 devstack sudo[99095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:25:13 devstack sudo[99095]: pam_unix(sudo:session): session closed for user root Jun 29 03:25:13 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf" returned: 0 in 1.238s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:25:13 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:25:13 devstack cinder-volume[93468]: DEBUG oslo_service.periodic_task [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Running periodic task VolumeManager._thread_info {{(pid=93468) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 29 03:25:13 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] thread count: 8 {{(pid=93468) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 29 03:25:13 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] thread info: [<_MainThread(MainThread, started 132331377287296)>, , , , , , , ] {{(pid=93468) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 29 03:25:16 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [req-848b58f6-bfb5-4e1d-9e12-5a5aa1fa42f4 req-d16692f1-6428-4d39-8668-37e0c0e83c46 tempest-VolumesSnapshotsTestJSON-1967771929 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:25:16 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [req-848b58f6-bfb5-4e1d-9e12-5a5aa1fa42f4 req-d16692f1-6428-4d39-8668-37e0c0e83c46 tempest-VolumesSnapshotsTestJSON-1967771929 None] Flow 'volume_create_manager' (b936b635-1f2b-4268-8ab3-7f33ed9550bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:25:16 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [req-848b58f6-bfb5-4e1d-9e12-5a5aa1fa42f4 req-d16692f1-6428-4d39-8668-37e0c0e83c46 tempest-VolumesSnapshotsTestJSON-1967771929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e66691b-e051-480d-afcd-dfeb585a723d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:25:16 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [req-848b58f6-bfb5-4e1d-9e12-5a5aa1fa42f4 req-d16692f1-6428-4d39-8668-37e0c0e83c46 tempest-VolumesSnapshotsTestJSON-1967771929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e66691b-e051-480d-afcd-dfeb585a723d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:25:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-226720204',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39c5ee29-4550-47e9-87eb-9a7de6841551,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3844e0efd2245d982ddc2c4e875f330',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:25:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:25:16Z,use_quota=True,user_id='46de90e9c319446c91e124f2b6583dbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:25:16 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [req-848b58f6-bfb5-4e1d-9e12-5a5aa1fa42f4 req-d16692f1-6428-4d39-8668-37e0c0e83c46 tempest-VolumesSnapshotsTestJSON-1967771929 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6aa10e96-dd1e-4621-9db4-34414275baf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:25:16 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [req-848b58f6-bfb5-4e1d-9e12-5a5aa1fa42f4 req-d16692f1-6428-4d39-8668-37e0c0e83c46 tempest-VolumesSnapshotsTestJSON-1967771929 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6aa10e96-dd1e-4621-9db4-34414275baf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:25:16 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [req-848b58f6-bfb5-4e1d-9e12-5a5aa1fa42f4 req-d16692f1-6428-4d39-8668-37e0c0e83c46 tempest-VolumesSnapshotsTestJSON-1967771929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79b080f4-6a55-43ce-ba82-1d1040bea5f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:25:16 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [req-848b58f6-bfb5-4e1d-9e12-5a5aa1fa42f4 req-d16692f1-6428-4d39-8668-37e0c0e83c46 tempest-VolumesSnapshotsTestJSON-1967771929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79b080f4-6a55-43ce-ba82-1d1040bea5f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '39c5ee29-4550-47e9-87eb-9a7de6841551', 'volume_name': 'volume-39c5ee29-4550-47e9-87eb-9a7de6841551', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:25:16 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [req-848b58f6-bfb5-4e1d-9e12-5a5aa1fa42f4 req-d16692f1-6428-4d39-8668-37e0c0e83c46 tempest-VolumesSnapshotsTestJSON-1967771929 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dea8b0fa-a267-4a65-8eff-cb5fd639b577) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:25:16 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [req-848b58f6-bfb5-4e1d-9e12-5a5aa1fa42f4 req-d16692f1-6428-4d39-8668-37e0c0e83c46 tempest-VolumesSnapshotsTestJSON-1967771929 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dea8b0fa-a267-4a65-8eff-cb5fd639b577) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:25:16 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [req-848b58f6-bfb5-4e1d-9e12-5a5aa1fa42f4 req-d16692f1-6428-4d39-8668-37e0c0e83c46 tempest-VolumesSnapshotsTestJSON-1967771929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44ce03ff-5d00-4bb7-b1be-2e32776afb6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:25:16 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [req-848b58f6-bfb5-4e1d-9e12-5a5aa1fa42f4 req-d16692f1-6428-4d39-8668-37e0c0e83c46 tempest-VolumesSnapshotsTestJSON-1967771929 None] Volume 39c5ee29-4550-47e9-87eb-9a7de6841551: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-39c5ee29-4550-47e9-87eb-9a7de6841551', 'volume_size': 1} Jun 29 03:25:16 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [req-848b58f6-bfb5-4e1d-9e12-5a5aa1fa42f4 req-d16692f1-6428-4d39-8668-37e0c0e83c46 tempest-VolumesSnapshotsTestJSON-1967771929 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:25:16 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [req-848b58f6-bfb5-4e1d-9e12-5a5aa1fa42f4 req-d16692f1-6428-4d39-8668-37e0c0e83c46 tempest-VolumesSnapshotsTestJSON-1967771929 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:25:16 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [req-848b58f6-bfb5-4e1d-9e12-5a5aa1fa42f4 req-d16692f1-6428-4d39-8668-37e0c0e83c46 tempest-VolumesSnapshotsTestJSON-1967771929 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:25:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-226720204',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39c5ee29-4550-47e9-87eb-9a7de6841551,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3844e0efd2245d982ddc2c4e875f330',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:25:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:25:16Z,use_quota=True,user_id='46de90e9c319446c91e124f2b6583dbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:25:16 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [req-848b58f6-bfb5-4e1d-9e12-5a5aa1fa42f4 req-d16692f1-6428-4d39-8668-37e0c0e83c46 tempest-VolumesSnapshotsTestJSON-1967771929 None] Creating volume 39c5ee29-4550-47e9-87eb-9a7de6841551 {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:25:16 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [req-848b58f6-bfb5-4e1d-9e12-5a5aa1fa42f4 req-d16692f1-6428-4d39-8668-37e0c0e83c46 tempest-VolumesSnapshotsTestJSON-1967771929 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:25:16 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [req-848b58f6-bfb5-4e1d-9e12-5a5aa1fa42f4 req-d16692f1-6428-4d39-8668-37e0c0e83c46 tempest-VolumesSnapshotsTestJSON-1967771929 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:25:16 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [req-848b58f6-bfb5-4e1d-9e12-5a5aa1fa42f4 req-d16692f1-6428-4d39-8668-37e0c0e83c46 tempest-VolumesSnapshotsTestJSON-1967771929 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:25:16 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [req-848b58f6-bfb5-4e1d-9e12-5a5aa1fa42f4 req-d16692f1-6428-4d39-8668-37e0c0e83c46 tempest-VolumesSnapshotsTestJSON-1967771929 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:25:16 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [req-848b58f6-bfb5-4e1d-9e12-5a5aa1fa42f4 req-d16692f1-6428-4d39-8668-37e0c0e83c46 tempest-VolumesSnapshotsTestJSON-1967771929 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:25:16 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [req-848b58f6-bfb5-4e1d-9e12-5a5aa1fa42f4 req-d16692f1-6428-4d39-8668-37e0c0e83c46 tempest-VolumesSnapshotsTestJSON-1967771929 None] Selected osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:25:16 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [req-848b58f6-bfb5-4e1d-9e12-5a5aa1fa42f4 req-d16692f1-6428-4d39-8668-37e0c0e83c46 tempest-VolumesSnapshotsTestJSON-1967771929 None] casted to osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f Jun 29 03:25:16 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [req-848b58f6-bfb5-4e1d-9e12-5a5aa1fa42f4 req-d16692f1-6428-4d39-8668-37e0c0e83c46 tempest-VolumesSnapshotsTestJSON-1967771929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-39c5ee29-4550-47e9-87eb-9a7de6841551 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:25:16 devstack sudo[99138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-39c5ee29-4550-47e9-87eb-9a7de6841551 1073741824 Jun 29 03:25:16 devstack sudo[99138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:25:17 devstack sudo[99138]: pam_unix(sudo:session): session closed for user root Jun 29 03:25:17 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [req-848b58f6-bfb5-4e1d-9e12-5a5aa1fa42f4 req-d16692f1-6428-4d39-8668-37e0c0e83c46 tempest-VolumesSnapshotsTestJSON-1967771929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-39c5ee29-4550-47e9-87eb-9a7de6841551 1073741824" returned: 0 in 1.225s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:25:17 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [req-848b58f6-bfb5-4e1d-9e12-5a5aa1fa42f4 req-d16692f1-6428-4d39-8668-37e0c0e83c46 tempest-VolumesSnapshotsTestJSON-1967771929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-39c5ee29-4550-47e9-87eb-9a7de6841551 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:25:18 devstack sudo[99228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-39c5ee29-4550-47e9-87eb-9a7de6841551 Jun 29 03:25:18 devstack sudo[99228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:25:19 devstack sudo[99228]: pam_unix(sudo:session): session closed for user root Jun 29 03:25:19 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [req-848b58f6-bfb5-4e1d-9e12-5a5aa1fa42f4 req-d16692f1-6428-4d39-8668-37e0c0e83c46 tempest-VolumesSnapshotsTestJSON-1967771929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-39c5ee29-4550-47e9-87eb-9a7de6841551" returned: 0 in 1.110s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:25:19 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [req-848b58f6-bfb5-4e1d-9e12-5a5aa1fa42f4 req-d16692f1-6428-4d39-8668-37e0c0e83c46 tempest-VolumesSnapshotsTestJSON-1967771929 None] <== create_volume: return (2434ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:25:19 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [req-848b58f6-bfb5-4e1d-9e12-5a5aa1fa42f4 req-d16692f1-6428-4d39-8668-37e0c0e83c46 tempest-VolumesSnapshotsTestJSON-1967771929 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.438s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:25:19 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [req-848b58f6-bfb5-4e1d-9e12-5a5aa1fa42f4 req-d16692f1-6428-4d39-8668-37e0c0e83c46 tempest-VolumesSnapshotsTestJSON-1967771929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44ce03ff-5d00-4bb7-b1be-2e32776afb6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-39c5ee29-4550-47e9-87eb-9a7de6841551', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:25:19 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [req-848b58f6-bfb5-4e1d-9e12-5a5aa1fa42f4 req-d16692f1-6428-4d39-8668-37e0c0e83c46 tempest-VolumesSnapshotsTestJSON-1967771929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff6e92c7-ef56-426a-84ba-e2f29a27764a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:25:19 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [req-848b58f6-bfb5-4e1d-9e12-5a5aa1fa42f4 req-d16692f1-6428-4d39-8668-37e0c0e83c46 tempest-VolumesSnapshotsTestJSON-1967771929 None] Volume volume-39c5ee29-4550-47e9-87eb-9a7de6841551 (39c5ee29-4550-47e9-87eb-9a7de6841551): created successfully Jun 29 03:25:19 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [req-848b58f6-bfb5-4e1d-9e12-5a5aa1fa42f4 req-d16692f1-6428-4d39-8668-37e0c0e83c46 tempest-VolumesSnapshotsTestJSON-1967771929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff6e92c7-ef56-426a-84ba-e2f29a27764a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:25:19 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [req-848b58f6-bfb5-4e1d-9e12-5a5aa1fa42f4 req-d16692f1-6428-4d39-8668-37e0c0e83c46 tempest-VolumesSnapshotsTestJSON-1967771929 None] Flow 'volume_create_manager' (b936b635-1f2b-4268-8ab3-7f33ed9550bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:25:19 devstack cinder-volume[93468]: INFO cinder.volume.manager [req-848b58f6-bfb5-4e1d-9e12-5a5aa1fa42f4 req-d16692f1-6428-4d39-8668-37e0c0e83c46 tempest-VolumesSnapshotsTestJSON-1967771929 None] Created volume successfully. Jun 29 03:25:20 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [req-3de6d6ae-5b67-486e-a2a3-e07a7a8cf63a req-1f1a6fe6-93a8-46ca-b794-5f2bbaad8042 tempest-VolumesSnapshotsTestJSON-1967771929 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:25:20 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [req-3de6d6ae-5b67-486e-a2a3-e07a7a8cf63a req-1f1a6fe6-93a8-46ca-b794-5f2bbaad8042 tempest-VolumesSnapshotsTestJSON-1967771929 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:25:20 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [req-3de6d6ae-5b67-486e-a2a3-e07a7a8cf63a req-1f1a6fe6-93a8-46ca-b794-5f2bbaad8042 tempest-VolumesSnapshotsTestJSON-1967771929 None] Creating offline snapshot d8b8527c-1c9b-4f66-b164-904ada3206c9 of volume 39c5ee29-4550-47e9-87eb-9a7de6841551 {{(pid=93468) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 29 03:25:20 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5ac45e9-2ad0-46a7-be94-c965bf070265]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:25:20 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [req-3de6d6ae-5b67-486e-a2a3-e07a7a8cf63a req-1f1a6fe6-93a8-46ca-b794-5f2bbaad8042 tempest-VolumesSnapshotsTestJSON-1967771929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-39c5ee29-4550-47e9-87eb-9a7de6841551 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:25:20 devstack sudo[99276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-39c5ee29-4550-47e9-87eb-9a7de6841551 Jun 29 03:25:20 devstack sudo[99276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:25:20 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-fa861e7a-b00b-42f9-8785-ed1a9238ac3d tempest-BackendsCapabilitiesAdminTestsJSON-351261926 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.668441772461, 'free_capacity_gb': 1775.668441772461, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=93468) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jun 29 03:25:20 devstack sudo[99276]: pam_unix(sudo:session): session closed for user root Jun 29 03:25:20 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [req-3de6d6ae-5b67-486e-a2a3-e07a7a8cf63a req-1f1a6fe6-93a8-46ca-b794-5f2bbaad8042 tempest-VolumesSnapshotsTestJSON-1967771929 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-39c5ee29-4550-47e9-87eb-9a7de6841551" returned: 0 in 0.803s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:25:20 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [req-3de6d6ae-5b67-486e-a2a3-e07a7a8cf63a req-1f1a6fe6-93a8-46ca-b794-5f2bbaad8042 tempest-VolumesSnapshotsTestJSON-1967771929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-39c5ee29-4550-47e9-87eb-9a7de6841551,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-39c5ee29-4550-47e9-87eb-9a7de6841551.d8b8527c-1c9b-4f66-b164-904ada3206c9 1G {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:25:21 devstack sudo[99282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-39c5ee29-4550-47e9-87eb-9a7de6841551,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-39c5ee29-4550-47e9-87eb-9a7de6841551.d8b8527c-1c9b-4f66-b164-904ada3206c9 1G Jun 29 03:25:21 devstack sudo[99282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:25:21 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-846c57b2-00fb-4b72-bf05-7c516c6d8ba1 tempest-BackendsCapabilitiesAdminTestsJSON-351261926 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.668441772461, 'free_capacity_gb': 1775.668441772461, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=93468) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jun 29 03:25:21 devstack sudo[99282]: pam_unix(sudo:session): session closed for user root Jun 29 03:25:21 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [req-3de6d6ae-5b67-486e-a2a3-e07a7a8cf63a req-1f1a6fe6-93a8-46ca-b794-5f2bbaad8042 tempest-VolumesSnapshotsTestJSON-1967771929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-39c5ee29-4550-47e9-87eb-9a7de6841551,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-39c5ee29-4550-47e9-87eb-9a7de6841551.d8b8527c-1c9b-4f66-b164-904ada3206c9 1G" returned: 0 in 0.806s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:25:21 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [req-3de6d6ae-5b67-486e-a2a3-e07a7a8cf63a req-1f1a6fe6-93a8-46ca-b794-5f2bbaad8042 tempest-VolumesSnapshotsTestJSON-1967771929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-39c5ee29-4550-47e9-87eb-9a7de6841551 -F qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-39c5ee29-4550-47e9-87eb-9a7de6841551.d8b8527c-1c9b-4f66-b164-904ada3206c9 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:25:21 devstack sudo[99288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-39c5ee29-4550-47e9-87eb-9a7de6841551 -F qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-39c5ee29-4550-47e9-87eb-9a7de6841551.d8b8527c-1c9b-4f66-b164-904ada3206c9 Jun 29 03:25:21 devstack sudo[99288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:25:22 devstack sudo[99288]: pam_unix(sudo:session): session closed for user root Jun 29 03:25:22 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [req-3de6d6ae-5b67-486e-a2a3-e07a7a8cf63a req-1f1a6fe6-93a8-46ca-b794-5f2bbaad8042 tempest-VolumesSnapshotsTestJSON-1967771929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-39c5ee29-4550-47e9-87eb-9a7de6841551 -F qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-39c5ee29-4550-47e9-87eb-9a7de6841551.d8b8527c-1c9b-4f66-b164-904ada3206c9" returned: 0 in 0.719s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:25:22 devstack cinder-volume[93468]: WARNING cinder.volume.drivers.remotefs [req-3de6d6ae-5b67-486e-a2a3-e07a7a8cf63a req-1f1a6fe6-93a8-46ca-b794-5f2bbaad8042 tempest-VolumesSnapshotsTestJSON-1967771929 None] /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-39c5ee29-4550-47e9-87eb-9a7de6841551.d8b8527c-1c9b-4f66-b164-904ada3206c9 is being set with open permissions: ugo+rw Jun 29 03:25:22 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [req-3de6d6ae-5b67-486e-a2a3-e07a7a8cf63a req-1f1a6fe6-93a8-46ca-b794-5f2bbaad8042 tempest-VolumesSnapshotsTestJSON-1967771929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-39c5ee29-4550-47e9-87eb-9a7de6841551.d8b8527c-1c9b-4f66-b164-904ada3206c9 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:25:22 devstack sudo[99295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-39c5ee29-4550-47e9-87eb-9a7de6841551.d8b8527c-1c9b-4f66-b164-904ada3206c9 Jun 29 03:25:22 devstack sudo[99295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:25:23 devstack sudo[99295]: pam_unix(sudo:session): session closed for user root Jun 29 03:25:23 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [req-3de6d6ae-5b67-486e-a2a3-e07a7a8cf63a req-1f1a6fe6-93a8-46ca-b794-5f2bbaad8042 tempest-VolumesSnapshotsTestJSON-1967771929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-39c5ee29-4550-47e9-87eb-9a7de6841551.d8b8527c-1c9b-4f66-b164-904ada3206c9" returned: 0 in 0.943s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:25:23 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [req-3de6d6ae-5b67-486e-a2a3-e07a7a8cf63a req-1f1a6fe6-93a8-46ca-b794-5f2bbaad8042 tempest-VolumesSnapshotsTestJSON-1967771929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-39c5ee29-4550-47e9-87eb-9a7de6841551.info {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:25:23 devstack sudo[99300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-39c5ee29-4550-47e9-87eb-9a7de6841551.info Jun 29 03:25:23 devstack sudo[99300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:25:24 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-f90a6279-f408-4df7-a1c9-308d63dd6539 tempest-AttachVolumeNegativeTest-1677376095 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:25:24 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-f90a6279-f408-4df7-a1c9-308d63dd6539 tempest-AttachVolumeNegativeTest-1677376095 None] Flow 'volume_create_manager' (ca6edcce-b0a7-49fb-8705-6b5022c259b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:25:24 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-f90a6279-f408-4df7-a1c9-308d63dd6539 tempest-AttachVolumeNegativeTest-1677376095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3d934d4-4aff-4cd8-90a2-0f088fae4866) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:25:24 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-f90a6279-f408-4df7-a1c9-308d63dd6539 tempest-AttachVolumeNegativeTest-1677376095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3d934d4-4aff-4cd8-90a2-0f088fae4866) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:25:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-70154662',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7395aef1-1102-446b-bae4-20b004eb5c30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3526e51fa339415f81fd93e4f6eb79d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:25:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:25:24Z,use_quota=True,user_id='c63530b326234dd7a6d67b641079d8b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:25:24 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-f90a6279-f408-4df7-a1c9-308d63dd6539 tempest-AttachVolumeNegativeTest-1677376095 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37495b8f-c52a-4757-8d32-cbc308ac7bba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:25:24 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-f90a6279-f408-4df7-a1c9-308d63dd6539 tempest-AttachVolumeNegativeTest-1677376095 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37495b8f-c52a-4757-8d32-cbc308ac7bba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:25:24 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-f90a6279-f408-4df7-a1c9-308d63dd6539 tempest-AttachVolumeNegativeTest-1677376095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54e835e0-33c5-4296-a130-d6f4ddc77fe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:25:24 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-f90a6279-f408-4df7-a1c9-308d63dd6539 tempest-AttachVolumeNegativeTest-1677376095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54e835e0-33c5-4296-a130-d6f4ddc77fe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7395aef1-1102-446b-bae4-20b004eb5c30', 'volume_name': 'volume-7395aef1-1102-446b-bae4-20b004eb5c30', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:25:24 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-f90a6279-f408-4df7-a1c9-308d63dd6539 tempest-AttachVolumeNegativeTest-1677376095 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97658f10-4519-4281-bef1-929c3099a5e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:25:24 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-f90a6279-f408-4df7-a1c9-308d63dd6539 tempest-AttachVolumeNegativeTest-1677376095 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97658f10-4519-4281-bef1-929c3099a5e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:25:24 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-f90a6279-f408-4df7-a1c9-308d63dd6539 tempest-AttachVolumeNegativeTest-1677376095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c52fbdbd-0616-4d3a-9a7c-a014a38729a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:25:24 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-f90a6279-f408-4df7-a1c9-308d63dd6539 tempest-AttachVolumeNegativeTest-1677376095 None] Volume 7395aef1-1102-446b-bae4-20b004eb5c30: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7395aef1-1102-446b-bae4-20b004eb5c30', 'volume_size': 1} Jun 29 03:25:24 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-f90a6279-f408-4df7-a1c9-308d63dd6539 tempest-AttachVolumeNegativeTest-1677376095 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:25:24 devstack sudo[99300]: pam_unix(sudo:session): session closed for user root Jun 29 03:25:24 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [req-3de6d6ae-5b67-486e-a2a3-e07a7a8cf63a req-1f1a6fe6-93a8-46ca-b794-5f2bbaad8042 tempest-VolumesSnapshotsTestJSON-1967771929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-39c5ee29-4550-47e9-87eb-9a7de6841551.info" returned: 0 in 1.049s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:25:24 devstack cinder-volume[93468]: WARNING cinder.volume.drivers.remotefs [req-3de6d6ae-5b67-486e-a2a3-e07a7a8cf63a req-1f1a6fe6-93a8-46ca-b794-5f2bbaad8042 tempest-VolumesSnapshotsTestJSON-1967771929 None] /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-39c5ee29-4550-47e9-87eb-9a7de6841551.info is being set with open permissions: ugo+rw Jun 29 03:25:24 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [req-3de6d6ae-5b67-486e-a2a3-e07a7a8cf63a req-1f1a6fe6-93a8-46ca-b794-5f2bbaad8042 tempest-VolumesSnapshotsTestJSON-1967771929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-39c5ee29-4550-47e9-87eb-9a7de6841551.info {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:25:24 devstack sudo[99323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-39c5ee29-4550-47e9-87eb-9a7de6841551.info Jun 29 03:25:24 devstack sudo[99323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:25:25 devstack sudo[99323]: pam_unix(sudo:session): session closed for user root Jun 29 03:25:25 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [req-3de6d6ae-5b67-486e-a2a3-e07a7a8cf63a req-1f1a6fe6-93a8-46ca-b794-5f2bbaad8042 tempest-VolumesSnapshotsTestJSON-1967771929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-39c5ee29-4550-47e9-87eb-9a7de6841551.info" returned: 0 in 1.168s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:25:25 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [req-3de6d6ae-5b67-486e-a2a3-e07a7a8cf63a req-1f1a6fe6-93a8-46ca-b794-5f2bbaad8042 tempest-VolumesSnapshotsTestJSON-1967771929 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.629s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:25:25 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-f90a6279-f408-4df7-a1c9-308d63dd6539 tempest-AttachVolumeNegativeTest-1677376095 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.685s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:25:25 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-f90a6279-f408-4df7-a1c9-308d63dd6539 tempest-AttachVolumeNegativeTest-1677376095 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:25:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-70154662',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7395aef1-1102-446b-bae4-20b004eb5c30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3526e51fa339415f81fd93e4f6eb79d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:25:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:25:24Z,use_quota=True,user_id='c63530b326234dd7a6d67b641079d8b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:25:25 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-f90a6279-f408-4df7-a1c9-308d63dd6539 tempest-AttachVolumeNegativeTest-1677376095 None] Creating volume 7395aef1-1102-446b-bae4-20b004eb5c30 {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:25:25 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-f90a6279-f408-4df7-a1c9-308d63dd6539 tempest-AttachVolumeNegativeTest-1677376095 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:25:25 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-f90a6279-f408-4df7-a1c9-308d63dd6539 tempest-AttachVolumeNegativeTest-1677376095 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:25:25 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-f90a6279-f408-4df7-a1c9-308d63dd6539 tempest-AttachVolumeNegativeTest-1677376095 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:25:25 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-f90a6279-f408-4df7-a1c9-308d63dd6539 tempest-AttachVolumeNegativeTest-1677376095 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:25:25 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-f90a6279-f408-4df7-a1c9-308d63dd6539 tempest-AttachVolumeNegativeTest-1677376095 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:25:25 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-f90a6279-f408-4df7-a1c9-308d63dd6539 tempest-AttachVolumeNegativeTest-1677376095 None] Selected osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:25:25 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-f90a6279-f408-4df7-a1c9-308d63dd6539 tempest-AttachVolumeNegativeTest-1677376095 None] casted to osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f Jun 29 03:25:25 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-f90a6279-f408-4df7-a1c9-308d63dd6539 tempest-AttachVolumeNegativeTest-1677376095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-7395aef1-1102-446b-bae4-20b004eb5c30 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:25:25 devstack sudo[99368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-7395aef1-1102-446b-bae4-20b004eb5c30 1073741824 Jun 29 03:25:25 devstack sudo[99368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:25:25 devstack cinder-volume[93468]: INFO cinder.volume.manager [req-3de6d6ae-5b67-486e-a2a3-e07a7a8cf63a req-1f1a6fe6-93a8-46ca-b794-5f2bbaad8042 tempest-VolumesSnapshotsTestJSON-1967771929 None] Create snapshot completed successfully Jun 29 03:25:26 devstack cinder-volume[93468]: DEBUG cinder.coordination [req-37cc9842-6b14-4afc-a725-11fa4b05d243 req-55cf53b2-c764-4e7a-b9d4-3bddc2b26f14 tempest-VolumesSnapshotsTestJSON-1967771929 None] Acquiring lock "cinder-d8b8527c-1c9b-4f66-b164-904ada3206c9-delete_snapshot" by "delete_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:25:26 devstack cinder-volume[93468]: DEBUG cinder.coordination [req-37cc9842-6b14-4afc-a725-11fa4b05d243 req-55cf53b2-c764-4e7a-b9d4-3bddc2b26f14 tempest-VolumesSnapshotsTestJSON-1967771929 None] Lock "cinder-d8b8527c-1c9b-4f66-b164-904ada3206c9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:25:26 devstack cinder-volume[93468]: DEBUG cinder.coordination [req-37cc9842-6b14-4afc-a725-11fa4b05d243 req-55cf53b2-c764-4e7a-b9d4-3bddc2b26f14 tempest-VolumesSnapshotsTestJSON-1967771929 None] Acquiring lock "cinder-quobyte-39c5ee29-4550-47e9-87eb-9a7de6841551" by "delete_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:25:26 devstack cinder-volume[93468]: DEBUG cinder.coordination [req-37cc9842-6b14-4afc-a725-11fa4b05d243 req-55cf53b2-c764-4e7a-b9d4-3bddc2b26f14 tempest-VolumesSnapshotsTestJSON-1967771929 None] Lock "cinder-quobyte-39c5ee29-4550-47e9-87eb-9a7de6841551" acquired by "delete_snapshot" :: waited 0.026s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:25:26 devstack cinder-volume[93468]: DEBUG cinder.coordination [req-37cc9842-6b14-4afc-a725-11fa4b05d243 req-55cf53b2-c764-4e7a-b9d4-3bddc2b26f14 tempest-VolumesSnapshotsTestJSON-1967771929 None] Acquiring lock "cinder-quobyte-d8b8527c-1c9b-4f66-b164-904ada3206c9" by "_delete_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:25:26 devstack cinder-volume[93468]: DEBUG cinder.coordination [req-37cc9842-6b14-4afc-a725-11fa4b05d243 req-55cf53b2-c764-4e7a-b9d4-3bddc2b26f14 tempest-VolumesSnapshotsTestJSON-1967771929 None] Lock "cinder-quobyte-d8b8527c-1c9b-4f66-b164-904ada3206c9" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:25:26 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [req-37cc9842-6b14-4afc-a725-11fa4b05d243 req-55cf53b2-c764-4e7a-b9d4-3bddc2b26f14 tempest-VolumesSnapshotsTestJSON-1967771929 None] Deleting offline snapshot d8b8527c-1c9b-4f66-b164-904ada3206c9 of volume 39c5ee29-4550-47e9-87eb-9a7de6841551 {{(pid=93468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 29 03:25:26 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [req-37cc9842-6b14-4afc-a725-11fa4b05d243 req-55cf53b2-c764-4e7a-b9d4-3bddc2b26f14 tempest-VolumesSnapshotsTestJSON-1967771929 None] snapshot_file for this snap is: volume-39c5ee29-4550-47e9-87eb-9a7de6841551.d8b8527c-1c9b-4f66-b164-904ada3206c9 {{(pid=93468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 29 03:25:26 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[54b01a08-204d-4943-9bc9-b3f1fabf5c2f]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:25:26 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [req-37cc9842-6b14-4afc-a725-11fa4b05d243 req-55cf53b2-c764-4e7a-b9d4-3bddc2b26f14 tempest-VolumesSnapshotsTestJSON-1967771929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-39c5ee29-4550-47e9-87eb-9a7de6841551.d8b8527c-1c9b-4f66-b164-904ada3206c9 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:25:26 devstack sudo[99371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-39c5ee29-4550-47e9-87eb-9a7de6841551.d8b8527c-1c9b-4f66-b164-904ada3206c9 Jun 29 03:25:26 devstack sudo[99371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:25:27 devstack sudo[99368]: pam_unix(sudo:session): session closed for user root Jun 29 03:25:27 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-f90a6279-f408-4df7-a1c9-308d63dd6539 tempest-AttachVolumeNegativeTest-1677376095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-7395aef1-1102-446b-bae4-20b004eb5c30 1073741824" returned: 0 in 1.318s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:25:27 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-f90a6279-f408-4df7-a1c9-308d63dd6539 tempest-AttachVolumeNegativeTest-1677376095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-7395aef1-1102-446b-bae4-20b004eb5c30 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:25:27 devstack sudo[99377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-7395aef1-1102-446b-bae4-20b004eb5c30 Jun 29 03:25:27 devstack sudo[99377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:25:27 devstack sudo[99371]: pam_unix(sudo:session): session closed for user root Jun 29 03:25:27 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [req-37cc9842-6b14-4afc-a725-11fa4b05d243 req-55cf53b2-c764-4e7a-b9d4-3bddc2b26f14 tempest-VolumesSnapshotsTestJSON-1967771929 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-39c5ee29-4550-47e9-87eb-9a7de6841551.d8b8527c-1c9b-4f66-b164-904ada3206c9" returned: 0 in 1.562s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:25:27 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [req-37cc9842-6b14-4afc-a725-11fa4b05d243 req-55cf53b2-c764-4e7a-b9d4-3bddc2b26f14 tempest-VolumesSnapshotsTestJSON-1967771929 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-39c5ee29-4550-47e9-87eb-9a7de6841551(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93468) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 29 03:25:27 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[98e68c6c-c96e-4f71-8714-9225714cd95a]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:25:27 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [req-37cc9842-6b14-4afc-a725-11fa4b05d243 req-55cf53b2-c764-4e7a-b9d4-3bddc2b26f14 tempest-VolumesSnapshotsTestJSON-1967771929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-39c5ee29-4550-47e9-87eb-9a7de6841551 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:25:28 devstack sudo[99382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-39c5ee29-4550-47e9-87eb-9a7de6841551 Jun 29 03:25:28 devstack sudo[99382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:25:28 devstack sudo[99377]: pam_unix(sudo:session): session closed for user root Jun 29 03:25:28 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-f90a6279-f408-4df7-a1c9-308d63dd6539 tempest-AttachVolumeNegativeTest-1677376095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-7395aef1-1102-446b-bae4-20b004eb5c30" returned: 0 in 1.168s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:25:28 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-f90a6279-f408-4df7-a1c9-308d63dd6539 tempest-AttachVolumeNegativeTest-1677376095 None] <== create_volume: return (2590ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:25:28 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-f90a6279-f408-4df7-a1c9-308d63dd6539 tempest-AttachVolumeNegativeTest-1677376095 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.595s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:25:28 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-f90a6279-f408-4df7-a1c9-308d63dd6539 tempest-AttachVolumeNegativeTest-1677376095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c52fbdbd-0616-4d3a-9a7c-a014a38729a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7395aef1-1102-446b-bae4-20b004eb5c30', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:25:28 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-f90a6279-f408-4df7-a1c9-308d63dd6539 tempest-AttachVolumeNegativeTest-1677376095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b545ca6-eca5-427e-abb0-c413878a31bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:25:28 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-f90a6279-f408-4df7-a1c9-308d63dd6539 tempest-AttachVolumeNegativeTest-1677376095 None] Volume volume-7395aef1-1102-446b-bae4-20b004eb5c30 (7395aef1-1102-446b-bae4-20b004eb5c30): created successfully Jun 29 03:25:28 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-f90a6279-f408-4df7-a1c9-308d63dd6539 tempest-AttachVolumeNegativeTest-1677376095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b545ca6-eca5-427e-abb0-c413878a31bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:25:28 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-f90a6279-f408-4df7-a1c9-308d63dd6539 tempest-AttachVolumeNegativeTest-1677376095 None] Flow 'volume_create_manager' (ca6edcce-b0a7-49fb-8705-6b5022c259b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:25:28 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-f90a6279-f408-4df7-a1c9-308d63dd6539 tempest-AttachVolumeNegativeTest-1677376095 None] Created volume successfully. Jun 29 03:25:28 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-927300f0-e67f-4242-b27b-5900a23913b6 tempest-ServerRescueNegativeTestJSON-1378316394 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:25:28 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-927300f0-e67f-4242-b27b-5900a23913b6 tempest-ServerRescueNegativeTestJSON-1378316394 None] Flow 'volume_create_manager' (ccdb38d4-e603-4842-a4f6-ae3565cc3891) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:25:28 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-927300f0-e67f-4242-b27b-5900a23913b6 tempest-ServerRescueNegativeTestJSON-1378316394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1484ed2b-7303-4782-91f2-c9db811ee4ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:25:28 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-927300f0-e67f-4242-b27b-5900a23913b6 tempest-ServerRescueNegativeTestJSON-1378316394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1484ed2b-7303-4782-91f2-c9db811ee4ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:25:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1471226224',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9ede627-7d1a-42f4-9cf6-8aea03280bb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fab4caa4eff44b290f91335c5847678',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:25:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:25:29Z,use_quota=True,user_id='4f5da840c4474d5b9be22c33caed8733',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:25:28 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-927300f0-e67f-4242-b27b-5900a23913b6 tempest-ServerRescueNegativeTestJSON-1378316394 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9479b30-2e9f-4741-a48f-725b02902c0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:25:28 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-927300f0-e67f-4242-b27b-5900a23913b6 tempest-ServerRescueNegativeTestJSON-1378316394 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9479b30-2e9f-4741-a48f-725b02902c0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:25:28 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-927300f0-e67f-4242-b27b-5900a23913b6 tempest-ServerRescueNegativeTestJSON-1378316394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c9f02bc-58df-46ec-b96f-e073c5dce444) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:25:28 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-927300f0-e67f-4242-b27b-5900a23913b6 tempest-ServerRescueNegativeTestJSON-1378316394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c9f02bc-58df-46ec-b96f-e073c5dce444) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd9ede627-7d1a-42f4-9cf6-8aea03280bb5', 'volume_name': 'volume-d9ede627-7d1a-42f4-9cf6-8aea03280bb5', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:25:28 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-927300f0-e67f-4242-b27b-5900a23913b6 tempest-ServerRescueNegativeTestJSON-1378316394 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (818bfed2-c120-41d5-a53c-e614b9587ad1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:25:28 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-927300f0-e67f-4242-b27b-5900a23913b6 tempest-ServerRescueNegativeTestJSON-1378316394 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (818bfed2-c120-41d5-a53c-e614b9587ad1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:25:28 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-927300f0-e67f-4242-b27b-5900a23913b6 tempest-ServerRescueNegativeTestJSON-1378316394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (487e5637-1530-4277-a9de-3c37aec27bcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:25:28 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-927300f0-e67f-4242-b27b-5900a23913b6 tempest-ServerRescueNegativeTestJSON-1378316394 None] Volume d9ede627-7d1a-42f4-9cf6-8aea03280bb5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d9ede627-7d1a-42f4-9cf6-8aea03280bb5', 'volume_size': 1} Jun 29 03:25:28 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-927300f0-e67f-4242-b27b-5900a23913b6 tempest-ServerRescueNegativeTestJSON-1378316394 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:25:28 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-927300f0-e67f-4242-b27b-5900a23913b6 tempest-ServerRescueNegativeTestJSON-1378316394 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:25:28 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-927300f0-e67f-4242-b27b-5900a23913b6 tempest-ServerRescueNegativeTestJSON-1378316394 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:25:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1471226224',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9ede627-7d1a-42f4-9cf6-8aea03280bb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fab4caa4eff44b290f91335c5847678',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:25:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:25:29Z,use_quota=True,user_id='4f5da840c4474d5b9be22c33caed8733',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:25:28 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-927300f0-e67f-4242-b27b-5900a23913b6 tempest-ServerRescueNegativeTestJSON-1378316394 None] Creating volume d9ede627-7d1a-42f4-9cf6-8aea03280bb5 {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:25:28 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-927300f0-e67f-4242-b27b-5900a23913b6 tempest-ServerRescueNegativeTestJSON-1378316394 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:25:28 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-927300f0-e67f-4242-b27b-5900a23913b6 tempest-ServerRescueNegativeTestJSON-1378316394 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:25:28 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-927300f0-e67f-4242-b27b-5900a23913b6 tempest-ServerRescueNegativeTestJSON-1378316394 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:25:28 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-927300f0-e67f-4242-b27b-5900a23913b6 tempest-ServerRescueNegativeTestJSON-1378316394 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:25:28 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-927300f0-e67f-4242-b27b-5900a23913b6 tempest-ServerRescueNegativeTestJSON-1378316394 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:25:28 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-927300f0-e67f-4242-b27b-5900a23913b6 tempest-ServerRescueNegativeTestJSON-1378316394 None] Selected osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:25:28 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-927300f0-e67f-4242-b27b-5900a23913b6 tempest-ServerRescueNegativeTestJSON-1378316394 None] casted to osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f Jun 29 03:25:28 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-927300f0-e67f-4242-b27b-5900a23913b6 tempest-ServerRescueNegativeTestJSON-1378316394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-d9ede627-7d1a-42f4-9cf6-8aea03280bb5 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:25:28 devstack sudo[99385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-d9ede627-7d1a-42f4-9cf6-8aea03280bb5 1073741824 Jun 29 03:25:28 devstack sudo[99385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:25:29 devstack sudo[99382]: pam_unix(sudo:session): session closed for user root Jun 29 03:25:29 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [req-37cc9842-6b14-4afc-a725-11fa4b05d243 req-55cf53b2-c764-4e7a-b9d4-3bddc2b26f14 tempest-VolumesSnapshotsTestJSON-1967771929 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-39c5ee29-4550-47e9-87eb-9a7de6841551" returned: 0 in 1.281s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:25:29 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [req-37cc9842-6b14-4afc-a725-11fa4b05d243 req-55cf53b2-c764-4e7a-b9d4-3bddc2b26f14 tempest-VolumesSnapshotsTestJSON-1967771929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-39c5ee29-4550-47e9-87eb-9a7de6841551.d8b8527c-1c9b-4f66-b164-904ada3206c9 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:25:29 devstack sudo[99390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-39c5ee29-4550-47e9-87eb-9a7de6841551.d8b8527c-1c9b-4f66-b164-904ada3206c9 Jun 29 03:25:29 devstack sudo[99390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:25:29 devstack sudo[99385]: pam_unix(sudo:session): session closed for user root Jun 29 03:25:29 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-927300f0-e67f-4242-b27b-5900a23913b6 tempest-ServerRescueNegativeTestJSON-1378316394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-d9ede627-7d1a-42f4-9cf6-8aea03280bb5 1073741824" returned: 0 in 1.134s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:25:30 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-927300f0-e67f-4242-b27b-5900a23913b6 tempest-ServerRescueNegativeTestJSON-1378316394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-d9ede627-7d1a-42f4-9cf6-8aea03280bb5 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:25:30 devstack sudo[99404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-d9ede627-7d1a-42f4-9cf6-8aea03280bb5 Jun 29 03:25:30 devstack sudo[99404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:25:30 devstack sudo[99390]: pam_unix(sudo:session): session closed for user root Jun 29 03:25:30 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [req-37cc9842-6b14-4afc-a725-11fa4b05d243 req-55cf53b2-c764-4e7a-b9d4-3bddc2b26f14 tempest-VolumesSnapshotsTestJSON-1967771929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-39c5ee29-4550-47e9-87eb-9a7de6841551.d8b8527c-1c9b-4f66-b164-904ada3206c9" returned: 0 in 1.021s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:25:30 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [req-37cc9842-6b14-4afc-a725-11fa4b05d243 req-55cf53b2-c764-4e7a-b9d4-3bddc2b26f14 tempest-VolumesSnapshotsTestJSON-1967771929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-39c5ee29-4550-47e9-87eb-9a7de6841551.d8b8527c-1c9b-4f66-b164-904ada3206c9 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:25:30 devstack sudo[99406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-39c5ee29-4550-47e9-87eb-9a7de6841551.d8b8527c-1c9b-4f66-b164-904ada3206c9 Jun 29 03:25:30 devstack sudo[99406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:25:30 devstack sudo[99404]: pam_unix(sudo:session): session closed for user root Jun 29 03:25:30 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-927300f0-e67f-4242-b27b-5900a23913b6 tempest-ServerRescueNegativeTestJSON-1378316394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-d9ede627-7d1a-42f4-9cf6-8aea03280bb5" returned: 0 in 0.907s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:25:30 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-927300f0-e67f-4242-b27b-5900a23913b6 tempest-ServerRescueNegativeTestJSON-1378316394 None] <== create_volume: return (2095ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:25:30 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-927300f0-e67f-4242-b27b-5900a23913b6 tempest-ServerRescueNegativeTestJSON-1378316394 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.098s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:25:30 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-927300f0-e67f-4242-b27b-5900a23913b6 tempest-ServerRescueNegativeTestJSON-1378316394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (487e5637-1530-4277-a9de-3c37aec27bcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9ede627-7d1a-42f4-9cf6-8aea03280bb5', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:25:30 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-927300f0-e67f-4242-b27b-5900a23913b6 tempest-ServerRescueNegativeTestJSON-1378316394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6a20bd5-4fa4-4942-8c75-13c07c0a81a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:25:30 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-927300f0-e67f-4242-b27b-5900a23913b6 tempest-ServerRescueNegativeTestJSON-1378316394 None] Volume volume-d9ede627-7d1a-42f4-9cf6-8aea03280bb5 (d9ede627-7d1a-42f4-9cf6-8aea03280bb5): created successfully Jun 29 03:25:30 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-927300f0-e67f-4242-b27b-5900a23913b6 tempest-ServerRescueNegativeTestJSON-1378316394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6a20bd5-4fa4-4942-8c75-13c07c0a81a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:25:31 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-927300f0-e67f-4242-b27b-5900a23913b6 tempest-ServerRescueNegativeTestJSON-1378316394 None] Flow 'volume_create_manager' (ccdb38d4-e603-4842-a4f6-ae3565cc3891) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:25:31 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-927300f0-e67f-4242-b27b-5900a23913b6 tempest-ServerRescueNegativeTestJSON-1378316394 None] Created volume successfully. Jun 29 03:25:31 devstack sudo[99406]: pam_unix(sudo:session): session closed for user root Jun 29 03:25:31 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [req-37cc9842-6b14-4afc-a725-11fa4b05d243 req-55cf53b2-c764-4e7a-b9d4-3bddc2b26f14 tempest-VolumesSnapshotsTestJSON-1967771929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-39c5ee29-4550-47e9-87eb-9a7de6841551.d8b8527c-1c9b-4f66-b164-904ada3206c9" returned: 0 in 0.905s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:25:31 devstack cinder-volume[93468]: DEBUG cinder.coordination [req-37cc9842-6b14-4afc-a725-11fa4b05d243 req-55cf53b2-c764-4e7a-b9d4-3bddc2b26f14 tempest-VolumesSnapshotsTestJSON-1967771929 None] Lock "cinder-quobyte-d8b8527c-1c9b-4f66-b164-904ada3206c9" released by "_delete_snapshot" :: held 4.967s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:25:31 devstack cinder-volume[93468]: DEBUG cinder.coordination [req-37cc9842-6b14-4afc-a725-11fa4b05d243 req-55cf53b2-c764-4e7a-b9d4-3bddc2b26f14 tempest-VolumesSnapshotsTestJSON-1967771929 None] Lock "cinder-quobyte-39c5ee29-4550-47e9-87eb-9a7de6841551" released by "delete_snapshot" :: held 4.999s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:25:31 devstack cinder-volume[93468]: WARNING cinder.quota [req-37cc9842-6b14-4afc-a725-11fa4b05d243 req-55cf53b2-c764-4e7a-b9d4-3bddc2b26f14 tempest-VolumesSnapshotsTestJSON-1967771929 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jun 29 03:25:31 devstack cinder-volume[93468]: DEBUG cinder.quota [req-37cc9842-6b14-4afc-a725-11fa4b05d243 req-55cf53b2-c764-4e7a-b9d4-3bddc2b26f14 tempest-VolumesSnapshotsTestJSON-1967771929 None] Created reservations ['805d8da6-c761-49ae-8c4c-c5a4f5f47b8e', '69efed57-60ed-4a34-a4e6-ea353e9f315f', '37da76e1-9836-41f9-b50d-c773270c3348', '0f8dfbe3-1f0d-4fa5-a961-f1e3dddefc2d'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:25:31 devstack cinder-volume[93468]: INFO cinder.volume.manager [req-37cc9842-6b14-4afc-a725-11fa4b05d243 req-55cf53b2-c764-4e7a-b9d4-3bddc2b26f14 tempest-VolumesSnapshotsTestJSON-1967771929 None] Delete snapshot completed successfully. Jun 29 03:25:31 devstack cinder-volume[93468]: DEBUG cinder.coordination [req-37cc9842-6b14-4afc-a725-11fa4b05d243 req-55cf53b2-c764-4e7a-b9d4-3bddc2b26f14 tempest-VolumesSnapshotsTestJSON-1967771929 None] Lock "cinder-d8b8527c-1c9b-4f66-b164-904ada3206c9-delete_snapshot" released by "delete_snapshot" :: held 5.187s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:25:31 devstack cinder-volume[93468]: DEBUG cinder.coordination [req-5059c5a2-50b2-4ec4-819b-07aba6bfbeee req-1aa681b1-36a8-4da5-a509-840c655283f3 tempest-VolumesSnapshotsTestJSON-1967771929 None] Acquiring lock "cinder-39c5ee29-4550-47e9-87eb-9a7de6841551-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:25:31 devstack cinder-volume[93468]: DEBUG cinder.coordination [req-5059c5a2-50b2-4ec4-819b-07aba6bfbeee req-1aa681b1-36a8-4da5-a509-840c655283f3 tempest-VolumesSnapshotsTestJSON-1967771929 None] Lock "cinder-39c5ee29-4550-47e9-87eb-9a7de6841551-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:25:31 devstack cinder-volume[93468]: DEBUG cinder.coordination [req-5059c5a2-50b2-4ec4-819b-07aba6bfbeee req-1aa681b1-36a8-4da5-a509-840c655283f3 tempest-VolumesSnapshotsTestJSON-1967771929 None] Acquiring lock "cinder-quobyte-39c5ee29-4550-47e9-87eb-9a7de6841551" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:25:32 devstack cinder-volume[93468]: DEBUG cinder.coordination [req-5059c5a2-50b2-4ec4-819b-07aba6bfbeee req-1aa681b1-36a8-4da5-a509-840c655283f3 tempest-VolumesSnapshotsTestJSON-1967771929 None] Lock "cinder-quobyte-39c5ee29-4550-47e9-87eb-9a7de6841551" acquired by "delete_volume" :: waited 0.034s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:25:32 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[9beab901-a82d-42ad-a71e-7b1a805e361b]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:25:32 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [req-5059c5a2-50b2-4ec4-819b-07aba6bfbeee req-1aa681b1-36a8-4da5-a509-840c655283f3 tempest-VolumesSnapshotsTestJSON-1967771929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-39c5ee29-4550-47e9-87eb-9a7de6841551 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:25:32 devstack sudo[99412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-39c5ee29-4550-47e9-87eb-9a7de6841551 Jun 29 03:25:32 devstack sudo[99412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:25:33 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [req-022fde63-51c1-4a4b-9dfa-2f566dc84ee1 req-efeff91d-c4fe-496c-a6dc-696bcb49f1f8 tempest-AttachVolumeNegativeTest-1677376095 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:25:33 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [req-022fde63-51c1-4a4b-9dfa-2f566dc84ee1 req-efeff91d-c4fe-496c-a6dc-696bcb49f1f8 tempest-AttachVolumeNegativeTest-1677376095 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:25:33 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bd4ac8f-1b64-4912-844b-b9a5f01f7953]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:25:33 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [req-022fde63-51c1-4a4b-9dfa-2f566dc84ee1 req-efeff91d-c4fe-496c-a6dc-696bcb49f1f8 tempest-AttachVolumeNegativeTest-1677376095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-7395aef1-1102-446b-bae4-20b004eb5c30 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:25:33 devstack sudo[99412]: pam_unix(sudo:session): session closed for user root Jun 29 03:25:33 devstack sudo[99426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-7395aef1-1102-446b-bae4-20b004eb5c30 Jun 29 03:25:33 devstack sudo[99426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:25:33 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [req-5059c5a2-50b2-4ec4-819b-07aba6bfbeee req-1aa681b1-36a8-4da5-a509-840c655283f3 tempest-VolumesSnapshotsTestJSON-1967771929 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-39c5ee29-4550-47e9-87eb-9a7de6841551" returned: 0 in 1.271s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:25:33 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [req-5059c5a2-50b2-4ec4-819b-07aba6bfbeee req-1aa681b1-36a8-4da5-a509-840c655283f3 tempest-VolumesSnapshotsTestJSON-1967771929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-39c5ee29-4550-47e9-87eb-9a7de6841551 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:25:33 devstack sudo[99429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-39c5ee29-4550-47e9-87eb-9a7de6841551 Jun 29 03:25:33 devstack sudo[99429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:25:34 devstack sudo[99429]: pam_unix(sudo:session): session closed for user root Jun 29 03:25:34 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [req-5059c5a2-50b2-4ec4-819b-07aba6bfbeee req-1aa681b1-36a8-4da5-a509-840c655283f3 tempest-VolumesSnapshotsTestJSON-1967771929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-39c5ee29-4550-47e9-87eb-9a7de6841551" returned: 0 in 1.113s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:25:34 devstack cinder-volume[93468]: DEBUG cinder.coordination [req-5059c5a2-50b2-4ec4-819b-07aba6bfbeee req-1aa681b1-36a8-4da5-a509-840c655283f3 tempest-VolumesSnapshotsTestJSON-1967771929 None] Lock "cinder-quobyte-39c5ee29-4550-47e9-87eb-9a7de6841551" released by "delete_volume" :: held 2.483s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:25:34 devstack sudo[99426]: pam_unix(sudo:session): session closed for user root Jun 29 03:25:34 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [req-022fde63-51c1-4a4b-9dfa-2f566dc84ee1 req-efeff91d-c4fe-496c-a6dc-696bcb49f1f8 tempest-AttachVolumeNegativeTest-1677376095 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-7395aef1-1102-446b-bae4-20b004eb5c30" returned: 0 in 1.350s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:25:34 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [req-022fde63-51c1-4a4b-9dfa-2f566dc84ee1 req-efeff91d-c4fe-496c-a6dc-696bcb49f1f8 tempest-AttachVolumeNegativeTest-1677376095 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.370s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:25:34 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [req-022fde63-51c1-4a4b-9dfa-2f566dc84ee1 req-efeff91d-c4fe-496c-a6dc-696bcb49f1f8 tempest-AttachVolumeNegativeTest-1677376095 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f', 'name': 'volume-7395aef1-1102-446b-bae4-20b004eb5c30', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5139ba60-c85d-4fa9-8fb3-b68a02307a9d', 'enforce_multipath': True} {{(pid=93468) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 29 03:25:34 devstack cinder-volume[93468]: DEBUG cinder.quota [req-5059c5a2-50b2-4ec4-819b-07aba6bfbeee req-1aa681b1-36a8-4da5-a509-840c655283f3 tempest-VolumesSnapshotsTestJSON-1967771929 None] Created reservations ['47851b12-c8a1-40a1-a1a6-39047b92053b', '2f513b43-6693-48e2-8911-b7027ab57882', 'f0a4fb70-73de-4d1b-8224-aa7184fef654', 'c994abd3-a6e9-4f8b-871b-24fb359e8f55'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:25:34 devstack cinder-volume[93468]: INFO cinder.volume.manager [req-022fde63-51c1-4a4b-9dfa-2f566dc84ee1 req-efeff91d-c4fe-496c-a6dc-696bcb49f1f8 tempest-AttachVolumeNegativeTest-1677376095 None] attachment_update completed successfully. Jun 29 03:25:34 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [req-5059c5a2-50b2-4ec4-819b-07aba6bfbeee req-1aa681b1-36a8-4da5-a509-840c655283f3 tempest-VolumesSnapshotsTestJSON-1967771929 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:25:34 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [req-5059c5a2-50b2-4ec4-819b-07aba6bfbeee req-1aa681b1-36a8-4da5-a509-840c655283f3 tempest-VolumesSnapshotsTestJSON-1967771929 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:25:34 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [req-5059c5a2-50b2-4ec4-819b-07aba6bfbeee req-1aa681b1-36a8-4da5-a509-840c655283f3 tempest-VolumesSnapshotsTestJSON-1967771929 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:25:34 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [req-5059c5a2-50b2-4ec4-819b-07aba6bfbeee req-1aa681b1-36a8-4da5-a509-840c655283f3 tempest-VolumesSnapshotsTestJSON-1967771929 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:25:34 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [req-5059c5a2-50b2-4ec4-819b-07aba6bfbeee req-1aa681b1-36a8-4da5-a509-840c655283f3 tempest-VolumesSnapshotsTestJSON-1967771929 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:25:34 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [req-5059c5a2-50b2-4ec4-819b-07aba6bfbeee req-1aa681b1-36a8-4da5-a509-840c655283f3 tempest-VolumesSnapshotsTestJSON-1967771929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:25:34 devstack sudo[99436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf Jun 29 03:25:34 devstack sudo[99436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:25:35 devstack sudo[99436]: pam_unix(sudo:session): session closed for user root Jun 29 03:25:35 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [req-5059c5a2-50b2-4ec4-819b-07aba6bfbeee req-1aa681b1-36a8-4da5-a509-840c655283f3 tempest-VolumesSnapshotsTestJSON-1967771929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf" returned: 0 in 1.129s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:25:35 devstack cinder-volume[93468]: DEBUG cinder.manager [req-5059c5a2-50b2-4ec4-819b-07aba6bfbeee req-1aa681b1-36a8-4da5-a509-840c655283f3 tempest-VolumesSnapshotsTestJSON-1967771929 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:25:35 devstack cinder-volume[93468]: INFO cinder.volume.manager [req-5059c5a2-50b2-4ec4-819b-07aba6bfbeee req-1aa681b1-36a8-4da5-a509-840c655283f3 tempest-VolumesSnapshotsTestJSON-1967771929 None] Deleted volume successfully. Jun 29 03:25:35 devstack cinder-volume[93468]: DEBUG cinder.coordination [req-5059c5a2-50b2-4ec4-819b-07aba6bfbeee req-1aa681b1-36a8-4da5-a509-840c655283f3 tempest-VolumesSnapshotsTestJSON-1967771929 None] Lock "cinder-39c5ee29-4550-47e9-87eb-9a7de6841551-delete_volume" released by "delete_volume" :: held 4.034s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:25:42 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [req-498b9791-0e4c-4194-8e11-1eb1d9f1af62 req-d0f7b135-e25a-42fb-a946-566557f740cb tempest-VolumesGetTestJSON-1418791695 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:25:42 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [req-498b9791-0e4c-4194-8e11-1eb1d9f1af62 req-d0f7b135-e25a-42fb-a946-566557f740cb tempest-VolumesGetTestJSON-1418791695 None] Flow 'volume_create_manager' (5bf70457-e4df-4c10-b700-1bb005618049) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:25:42 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [req-498b9791-0e4c-4194-8e11-1eb1d9f1af62 req-d0f7b135-e25a-42fb-a946-566557f740cb tempest-VolumesGetTestJSON-1418791695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04bdb031-2540-4aeb-9a5f-084880e69add) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:25:42 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [req-498b9791-0e4c-4194-8e11-1eb1d9f1af62 req-d0f7b135-e25a-42fb-a946-566557f740cb tempest-VolumesGetTestJSON-1418791695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04bdb031-2540-4aeb-9a5f-084880e69add) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:25:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1475432598',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52f6870d-3284-45f8-b436-a0a97fc23726,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='84c26a69af644ca2a2e234b1c7992d5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:25:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:25:42Z,use_quota=True,user_id='0c0465ec8f2a42ed878f32a2af86adfd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:25:42 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [req-498b9791-0e4c-4194-8e11-1eb1d9f1af62 req-d0f7b135-e25a-42fb-a946-566557f740cb tempest-VolumesGetTestJSON-1418791695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68c34c50-baeb-4e82-86f4-38da91ff0f06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:25:42 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [req-498b9791-0e4c-4194-8e11-1eb1d9f1af62 req-d0f7b135-e25a-42fb-a946-566557f740cb tempest-VolumesGetTestJSON-1418791695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68c34c50-baeb-4e82-86f4-38da91ff0f06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:25:42 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [req-498b9791-0e4c-4194-8e11-1eb1d9f1af62 req-d0f7b135-e25a-42fb-a946-566557f740cb tempest-VolumesGetTestJSON-1418791695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (887f3fbc-34f6-4c2f-9f3e-a0a9847fd90d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:25:42 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [req-498b9791-0e4c-4194-8e11-1eb1d9f1af62 req-d0f7b135-e25a-42fb-a946-566557f740cb tempest-VolumesGetTestJSON-1418791695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (887f3fbc-34f6-4c2f-9f3e-a0a9847fd90d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '52f6870d-3284-45f8-b436-a0a97fc23726', 'volume_name': 'volume-52f6870d-3284-45f8-b436-a0a97fc23726', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:25:42 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [req-498b9791-0e4c-4194-8e11-1eb1d9f1af62 req-d0f7b135-e25a-42fb-a946-566557f740cb tempest-VolumesGetTestJSON-1418791695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3305e7ca-5ef2-46c8-a24c-1aa72954ed08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:25:42 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [req-498b9791-0e4c-4194-8e11-1eb1d9f1af62 req-d0f7b135-e25a-42fb-a946-566557f740cb tempest-VolumesGetTestJSON-1418791695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3305e7ca-5ef2-46c8-a24c-1aa72954ed08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:25:42 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [req-498b9791-0e4c-4194-8e11-1eb1d9f1af62 req-d0f7b135-e25a-42fb-a946-566557f740cb tempest-VolumesGetTestJSON-1418791695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (221bd9b4-c277-4deb-bec3-d31cc9baef1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:25:42 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [req-498b9791-0e4c-4194-8e11-1eb1d9f1af62 req-d0f7b135-e25a-42fb-a946-566557f740cb tempest-VolumesGetTestJSON-1418791695 None] Volume 52f6870d-3284-45f8-b436-a0a97fc23726: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-52f6870d-3284-45f8-b436-a0a97fc23726', 'volume_size': 1} Jun 29 03:25:42 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [req-498b9791-0e4c-4194-8e11-1eb1d9f1af62 req-d0f7b135-e25a-42fb-a946-566557f740cb tempest-VolumesGetTestJSON-1418791695 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:25:42 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [req-498b9791-0e4c-4194-8e11-1eb1d9f1af62 req-d0f7b135-e25a-42fb-a946-566557f740cb tempest-VolumesGetTestJSON-1418791695 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:25:42 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [req-498b9791-0e4c-4194-8e11-1eb1d9f1af62 req-d0f7b135-e25a-42fb-a946-566557f740cb tempest-VolumesGetTestJSON-1418791695 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:25:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1475432598',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52f6870d-3284-45f8-b436-a0a97fc23726,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='84c26a69af644ca2a2e234b1c7992d5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:25:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:25:42Z,use_quota=True,user_id='0c0465ec8f2a42ed878f32a2af86adfd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:25:42 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [req-498b9791-0e4c-4194-8e11-1eb1d9f1af62 req-d0f7b135-e25a-42fb-a946-566557f740cb tempest-VolumesGetTestJSON-1418791695 None] Creating volume 52f6870d-3284-45f8-b436-a0a97fc23726 {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:25:42 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [req-498b9791-0e4c-4194-8e11-1eb1d9f1af62 req-d0f7b135-e25a-42fb-a946-566557f740cb tempest-VolumesGetTestJSON-1418791695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:25:42 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [req-498b9791-0e4c-4194-8e11-1eb1d9f1af62 req-d0f7b135-e25a-42fb-a946-566557f740cb tempest-VolumesGetTestJSON-1418791695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:25:42 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [req-498b9791-0e4c-4194-8e11-1eb1d9f1af62 req-d0f7b135-e25a-42fb-a946-566557f740cb tempest-VolumesGetTestJSON-1418791695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:25:42 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [req-498b9791-0e4c-4194-8e11-1eb1d9f1af62 req-d0f7b135-e25a-42fb-a946-566557f740cb tempest-VolumesGetTestJSON-1418791695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:25:42 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [req-498b9791-0e4c-4194-8e11-1eb1d9f1af62 req-d0f7b135-e25a-42fb-a946-566557f740cb tempest-VolumesGetTestJSON-1418791695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:25:42 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [req-498b9791-0e4c-4194-8e11-1eb1d9f1af62 req-d0f7b135-e25a-42fb-a946-566557f740cb tempest-VolumesGetTestJSON-1418791695 None] Selected osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:25:42 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [req-498b9791-0e4c-4194-8e11-1eb1d9f1af62 req-d0f7b135-e25a-42fb-a946-566557f740cb tempest-VolumesGetTestJSON-1418791695 None] casted to osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f Jun 29 03:25:42 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [req-498b9791-0e4c-4194-8e11-1eb1d9f1af62 req-d0f7b135-e25a-42fb-a946-566557f740cb tempest-VolumesGetTestJSON-1418791695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-52f6870d-3284-45f8-b436-a0a97fc23726 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:25:42 devstack sudo[99941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-52f6870d-3284-45f8-b436-a0a97fc23726 1073741824 Jun 29 03:25:42 devstack sudo[99941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:25:42 devstack cinder-volume[93468]: INFO cinder.volume.manager [req-8c4c52d1-653b-49fa-b143-d06545b32d63 req-41c1bb37-e7a1-40ca-ad7f-7e611b69a651 tempest-AttachVolumeNegativeTest-1677376095 None] Terminate volume connection completed successfully. Jun 29 03:25:42 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [req-8c4c52d1-653b-49fa-b143-d06545b32d63 req-41c1bb37-e7a1-40ca-ad7f-7e611b69a651 tempest-AttachVolumeNegativeTest-1677376095 None] Deleting attachment 5139ba60-c85d-4fa9-8fb3-b68a02307a9d. {{(pid=93468) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 29 03:25:43 devstack sudo[99941]: pam_unix(sudo:session): session closed for user root Jun 29 03:25:43 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [req-498b9791-0e4c-4194-8e11-1eb1d9f1af62 req-d0f7b135-e25a-42fb-a946-566557f740cb tempest-VolumesGetTestJSON-1418791695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-52f6870d-3284-45f8-b436-a0a97fc23726 1073741824" returned: 0 in 1.173s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:25:43 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [req-498b9791-0e4c-4194-8e11-1eb1d9f1af62 req-d0f7b135-e25a-42fb-a946-566557f740cb tempest-VolumesGetTestJSON-1418791695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-52f6870d-3284-45f8-b436-a0a97fc23726 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:25:43 devstack sudo[100016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-52f6870d-3284-45f8-b436-a0a97fc23726 Jun 29 03:25:43 devstack sudo[100016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:25:44 devstack sudo[100016]: pam_unix(sudo:session): session closed for user root Jun 29 03:25:44 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [req-498b9791-0e4c-4194-8e11-1eb1d9f1af62 req-d0f7b135-e25a-42fb-a946-566557f740cb tempest-VolumesGetTestJSON-1418791695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-52f6870d-3284-45f8-b436-a0a97fc23726" returned: 0 in 1.084s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:25:44 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [req-498b9791-0e4c-4194-8e11-1eb1d9f1af62 req-d0f7b135-e25a-42fb-a946-566557f740cb tempest-VolumesGetTestJSON-1418791695 None] <== create_volume: return (2334ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:25:44 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [req-498b9791-0e4c-4194-8e11-1eb1d9f1af62 req-d0f7b135-e25a-42fb-a946-566557f740cb tempest-VolumesGetTestJSON-1418791695 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.337s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:25:44 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [req-498b9791-0e4c-4194-8e11-1eb1d9f1af62 req-d0f7b135-e25a-42fb-a946-566557f740cb tempest-VolumesGetTestJSON-1418791695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (221bd9b4-c277-4deb-bec3-d31cc9baef1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-52f6870d-3284-45f8-b436-a0a97fc23726', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:25:44 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [req-498b9791-0e4c-4194-8e11-1eb1d9f1af62 req-d0f7b135-e25a-42fb-a946-566557f740cb tempest-VolumesGetTestJSON-1418791695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ecf3369-6849-4abf-99f0-8850980d42a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:25:44 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [req-498b9791-0e4c-4194-8e11-1eb1d9f1af62 req-d0f7b135-e25a-42fb-a946-566557f740cb tempest-VolumesGetTestJSON-1418791695 None] Volume volume-52f6870d-3284-45f8-b436-a0a97fc23726 (52f6870d-3284-45f8-b436-a0a97fc23726): created successfully Jun 29 03:25:44 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [req-498b9791-0e4c-4194-8e11-1eb1d9f1af62 req-d0f7b135-e25a-42fb-a946-566557f740cb tempest-VolumesGetTestJSON-1418791695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ecf3369-6849-4abf-99f0-8850980d42a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:25:44 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [req-498b9791-0e4c-4194-8e11-1eb1d9f1af62 req-d0f7b135-e25a-42fb-a946-566557f740cb tempest-VolumesGetTestJSON-1418791695 None] Flow 'volume_create_manager' (5bf70457-e4df-4c10-b700-1bb005618049) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:25:44 devstack cinder-volume[93468]: INFO cinder.volume.manager [req-498b9791-0e4c-4194-8e11-1eb1d9f1af62 req-d0f7b135-e25a-42fb-a946-566557f740cb tempest-VolumesGetTestJSON-1418791695 None] Created volume successfully. Jun 29 03:25:46 devstack cinder-volume[93468]: DEBUG cinder.coordination [req-bb7e2bdb-22d5-4572-b944-ad660c45a357 req-a784d946-eda9-48ee-b7e4-f76c14c37fe7 tempest-VolumesGetTestJSON-1418791695 None] Acquiring lock "cinder-52f6870d-3284-45f8-b436-a0a97fc23726-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:25:46 devstack cinder-volume[93468]: DEBUG cinder.coordination [req-bb7e2bdb-22d5-4572-b944-ad660c45a357 req-a784d946-eda9-48ee-b7e4-f76c14c37fe7 tempest-VolumesGetTestJSON-1418791695 None] Lock "cinder-52f6870d-3284-45f8-b436-a0a97fc23726-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:25:46 devstack cinder-volume[93468]: DEBUG cinder.coordination [req-bb7e2bdb-22d5-4572-b944-ad660c45a357 req-a784d946-eda9-48ee-b7e4-f76c14c37fe7 tempest-VolumesGetTestJSON-1418791695 None] Acquiring lock "cinder-quobyte-52f6870d-3284-45f8-b436-a0a97fc23726" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:25:46 devstack cinder-volume[93468]: DEBUG cinder.coordination [req-bb7e2bdb-22d5-4572-b944-ad660c45a357 req-a784d946-eda9-48ee-b7e4-f76c14c37fe7 tempest-VolumesGetTestJSON-1418791695 None] Lock "cinder-quobyte-52f6870d-3284-45f8-b436-a0a97fc23726" acquired by "delete_volume" :: waited 0.066s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:25:47 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[2912b573-627a-4ced-84ba-245b4f83edff]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:25:47 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [req-bb7e2bdb-22d5-4572-b944-ad660c45a357 req-a784d946-eda9-48ee-b7e4-f76c14c37fe7 tempest-VolumesGetTestJSON-1418791695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-52f6870d-3284-45f8-b436-a0a97fc23726 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:25:47 devstack sudo[100073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-52f6870d-3284-45f8-b436-a0a97fc23726 Jun 29 03:25:47 devstack sudo[100073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:25:48 devstack sudo[100073]: pam_unix(sudo:session): session closed for user root Jun 29 03:25:48 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [req-bb7e2bdb-22d5-4572-b944-ad660c45a357 req-a784d946-eda9-48ee-b7e4-f76c14c37fe7 tempest-VolumesGetTestJSON-1418791695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-52f6870d-3284-45f8-b436-a0a97fc23726" returned: 0 in 1.702s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:25:48 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [req-bb7e2bdb-22d5-4572-b944-ad660c45a357 req-a784d946-eda9-48ee-b7e4-f76c14c37fe7 tempest-VolumesGetTestJSON-1418791695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-52f6870d-3284-45f8-b436-a0a97fc23726 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:25:48 devstack sudo[100082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-52f6870d-3284-45f8-b436-a0a97fc23726 Jun 29 03:25:48 devstack sudo[100082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:25:49 devstack sudo[100082]: pam_unix(sudo:session): session closed for user root Jun 29 03:25:49 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [req-bb7e2bdb-22d5-4572-b944-ad660c45a357 req-a784d946-eda9-48ee-b7e4-f76c14c37fe7 tempest-VolumesGetTestJSON-1418791695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-52f6870d-3284-45f8-b436-a0a97fc23726" returned: 0 in 1.251s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:25:50 devstack cinder-volume[93468]: DEBUG cinder.coordination [req-bb7e2bdb-22d5-4572-b944-ad660c45a357 req-a784d946-eda9-48ee-b7e4-f76c14c37fe7 tempest-VolumesGetTestJSON-1418791695 None] Lock "cinder-quobyte-52f6870d-3284-45f8-b436-a0a97fc23726" released by "delete_volume" :: held 3.033s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:25:50 devstack cinder-volume[93468]: DEBUG cinder.quota [req-bb7e2bdb-22d5-4572-b944-ad660c45a357 req-a784d946-eda9-48ee-b7e4-f76c14c37fe7 tempest-VolumesGetTestJSON-1418791695 None] Created reservations ['5a9064e7-4329-43d5-a58b-b4d736d9ed92', '8f1ffcb2-41a6-4a0d-b506-2c0e0a5bbdf7', '3e86c0b8-55e6-4568-b0ab-b0f48a83f060', '8123496d-bae6-4bb1-9803-b69ec7ccb36a'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:25:50 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [req-bb7e2bdb-22d5-4572-b944-ad660c45a357 req-a784d946-eda9-48ee-b7e4-f76c14c37fe7 tempest-VolumesGetTestJSON-1418791695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:25:50 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [req-bb7e2bdb-22d5-4572-b944-ad660c45a357 req-a784d946-eda9-48ee-b7e4-f76c14c37fe7 tempest-VolumesGetTestJSON-1418791695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:25:50 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [req-bb7e2bdb-22d5-4572-b944-ad660c45a357 req-a784d946-eda9-48ee-b7e4-f76c14c37fe7 tempest-VolumesGetTestJSON-1418791695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:25:50 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [req-bb7e2bdb-22d5-4572-b944-ad660c45a357 req-a784d946-eda9-48ee-b7e4-f76c14c37fe7 tempest-VolumesGetTestJSON-1418791695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:25:50 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [req-bb7e2bdb-22d5-4572-b944-ad660c45a357 req-a784d946-eda9-48ee-b7e4-f76c14c37fe7 tempest-VolumesGetTestJSON-1418791695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:25:50 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [req-bb7e2bdb-22d5-4572-b944-ad660c45a357 req-a784d946-eda9-48ee-b7e4-f76c14c37fe7 tempest-VolumesGetTestJSON-1418791695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:25:50 devstack sudo[100086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf Jun 29 03:25:50 devstack sudo[100086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:25:51 devstack sudo[100086]: pam_unix(sudo:session): session closed for user root Jun 29 03:25:51 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [req-bb7e2bdb-22d5-4572-b944-ad660c45a357 req-a784d946-eda9-48ee-b7e4-f76c14c37fe7 tempest-VolumesGetTestJSON-1418791695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf" returned: 0 in 1.179s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:25:51 devstack cinder-volume[93468]: DEBUG cinder.manager [req-bb7e2bdb-22d5-4572-b944-ad660c45a357 req-a784d946-eda9-48ee-b7e4-f76c14c37fe7 tempest-VolumesGetTestJSON-1418791695 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:25:51 devstack cinder-volume[93468]: INFO cinder.volume.manager [req-bb7e2bdb-22d5-4572-b944-ad660c45a357 req-a784d946-eda9-48ee-b7e4-f76c14c37fe7 tempest-VolumesGetTestJSON-1418791695 None] Deleted volume successfully. Jun 29 03:25:51 devstack cinder-volume[93468]: DEBUG cinder.coordination [req-bb7e2bdb-22d5-4572-b944-ad660c45a357 req-a784d946-eda9-48ee-b7e4-f76c14c37fe7 tempest-VolumesGetTestJSON-1418791695 None] Lock "cinder-52f6870d-3284-45f8-b436-a0a97fc23726-delete_volume" released by "delete_volume" :: held 4.731s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:25:56 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-bd9b1e0f-3630-4a40-9939-816ad412b059 tempest-ServerRescueNegativeTestJSON-1378316394 None] Acquiring lock "cinder-d9ede627-7d1a-42f4-9cf6-8aea03280bb5-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:25:56 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-bd9b1e0f-3630-4a40-9939-816ad412b059 tempest-ServerRescueNegativeTestJSON-1378316394 None] Lock "cinder-d9ede627-7d1a-42f4-9cf6-8aea03280bb5-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:25:56 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-bd9b1e0f-3630-4a40-9939-816ad412b059 tempest-ServerRescueNegativeTestJSON-1378316394 None] Acquiring lock "cinder-quobyte-d9ede627-7d1a-42f4-9cf6-8aea03280bb5" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:25:56 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-bd9b1e0f-3630-4a40-9939-816ad412b059 tempest-ServerRescueNegativeTestJSON-1378316394 None] Lock "cinder-quobyte-d9ede627-7d1a-42f4-9cf6-8aea03280bb5" acquired by "delete_volume" :: waited 0.018s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:25:56 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[e327b06d-6658-4385-be80-f24c47d660b3]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:25:56 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-bd9b1e0f-3630-4a40-9939-816ad412b059 tempest-ServerRescueNegativeTestJSON-1378316394 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-d9ede627-7d1a-42f4-9cf6-8aea03280bb5 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:25:56 devstack sudo[100187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-d9ede627-7d1a-42f4-9cf6-8aea03280bb5 Jun 29 03:25:56 devstack sudo[100187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:25:58 devstack sudo[100187]: pam_unix(sudo:session): session closed for user root Jun 29 03:25:58 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-bd9b1e0f-3630-4a40-9939-816ad412b059 tempest-ServerRescueNegativeTestJSON-1378316394 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-d9ede627-7d1a-42f4-9cf6-8aea03280bb5" returned: 0 in 1.451s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:25:58 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-bd9b1e0f-3630-4a40-9939-816ad412b059 tempest-ServerRescueNegativeTestJSON-1378316394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-d9ede627-7d1a-42f4-9cf6-8aea03280bb5 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:25:58 devstack sudo[100193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-d9ede627-7d1a-42f4-9cf6-8aea03280bb5 Jun 29 03:25:58 devstack sudo[100193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:25:58 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-c39cb9b2-36e8-4125-9ce3-fdf5bfd20cb2 tempest-VolumesServicesTestJSON-282051472 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:25:58 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-c39cb9b2-36e8-4125-9ce3-fdf5bfd20cb2 tempest-VolumesServicesTestJSON-282051472 None] Flow 'volume_create_manager' (75675620-a5a9-4835-8ca4-b3840a188dc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:25:58 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-c39cb9b2-36e8-4125-9ce3-fdf5bfd20cb2 tempest-VolumesServicesTestJSON-282051472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e94e41d2-f252-4fdc-ba54-c56deddc265c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:25:58 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-c39cb9b2-36e8-4125-9ce3-fdf5bfd20cb2 tempest-VolumesServicesTestJSON-282051472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e94e41d2-f252-4fdc-ba54-c56deddc265c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:25:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1812028027',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b42502a-615d-43f4-8a0c-3253c6986231,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3cd04322d7f6430fbfb2d55987e2ffee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:25:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:25:58Z,use_quota=True,user_id='8e0f7d7f4fbb47e8b6a6f72f8b6cf29e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:25:58 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-c39cb9b2-36e8-4125-9ce3-fdf5bfd20cb2 tempest-VolumesServicesTestJSON-282051472 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d57c1a8b-8614-4818-a441-88f3464d98bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:25:58 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-c39cb9b2-36e8-4125-9ce3-fdf5bfd20cb2 tempest-VolumesServicesTestJSON-282051472 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d57c1a8b-8614-4818-a441-88f3464d98bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:25:58 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-c39cb9b2-36e8-4125-9ce3-fdf5bfd20cb2 tempest-VolumesServicesTestJSON-282051472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f35c8f12-43f2-404a-8da0-ebd733be123b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:25:58 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-c39cb9b2-36e8-4125-9ce3-fdf5bfd20cb2 tempest-VolumesServicesTestJSON-282051472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f35c8f12-43f2-404a-8da0-ebd733be123b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b42502a-615d-43f4-8a0c-3253c6986231', 'volume_name': 'volume-0b42502a-615d-43f4-8a0c-3253c6986231', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:25:58 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-c39cb9b2-36e8-4125-9ce3-fdf5bfd20cb2 tempest-VolumesServicesTestJSON-282051472 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc93b8f0-813f-4916-9650-f3689dddd9c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:25:58 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-c39cb9b2-36e8-4125-9ce3-fdf5bfd20cb2 tempest-VolumesServicesTestJSON-282051472 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc93b8f0-813f-4916-9650-f3689dddd9c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:25:58 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-c39cb9b2-36e8-4125-9ce3-fdf5bfd20cb2 tempest-VolumesServicesTestJSON-282051472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5487bd81-369e-4bf6-8a6b-194ddaff6a09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:25:58 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-c39cb9b2-36e8-4125-9ce3-fdf5bfd20cb2 tempest-VolumesServicesTestJSON-282051472 None] Volume 0b42502a-615d-43f4-8a0c-3253c6986231: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b42502a-615d-43f4-8a0c-3253c6986231', 'volume_size': 1} Jun 29 03:25:58 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-c39cb9b2-36e8-4125-9ce3-fdf5bfd20cb2 tempest-VolumesServicesTestJSON-282051472 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:25:58 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-c39cb9b2-36e8-4125-9ce3-fdf5bfd20cb2 tempest-VolumesServicesTestJSON-282051472 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:25:58 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-c39cb9b2-36e8-4125-9ce3-fdf5bfd20cb2 tempest-VolumesServicesTestJSON-282051472 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:25:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1812028027',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b42502a-615d-43f4-8a0c-3253c6986231,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3cd04322d7f6430fbfb2d55987e2ffee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:25:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:25:58Z,use_quota=True,user_id='8e0f7d7f4fbb47e8b6a6f72f8b6cf29e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:25:58 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-c39cb9b2-36e8-4125-9ce3-fdf5bfd20cb2 tempest-VolumesServicesTestJSON-282051472 None] Creating volume 0b42502a-615d-43f4-8a0c-3253c6986231 {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:25:58 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-c39cb9b2-36e8-4125-9ce3-fdf5bfd20cb2 tempest-VolumesServicesTestJSON-282051472 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:25:58 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-c39cb9b2-36e8-4125-9ce3-fdf5bfd20cb2 tempest-VolumesServicesTestJSON-282051472 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:25:58 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-c39cb9b2-36e8-4125-9ce3-fdf5bfd20cb2 tempest-VolumesServicesTestJSON-282051472 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:25:58 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-c39cb9b2-36e8-4125-9ce3-fdf5bfd20cb2 tempest-VolumesServicesTestJSON-282051472 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:25:58 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-c39cb9b2-36e8-4125-9ce3-fdf5bfd20cb2 tempest-VolumesServicesTestJSON-282051472 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:25:58 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-c39cb9b2-36e8-4125-9ce3-fdf5bfd20cb2 tempest-VolumesServicesTestJSON-282051472 None] Selected osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:25:58 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-c39cb9b2-36e8-4125-9ce3-fdf5bfd20cb2 tempest-VolumesServicesTestJSON-282051472 None] casted to osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f Jun 29 03:25:58 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c39cb9b2-36e8-4125-9ce3-fdf5bfd20cb2 tempest-VolumesServicesTestJSON-282051472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-0b42502a-615d-43f4-8a0c-3253c6986231 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:25:58 devstack sudo[100195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-0b42502a-615d-43f4-8a0c-3253c6986231 1073741824 Jun 29 03:25:58 devstack sudo[100195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:25:58 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-0804f0ad-04ff-41e7-9017-b333d789f1be tempest-GroupSnapshotsTest-1771286532 None] Group tempest-GroupSnapshotsTest-Group-1400060805: creating Jun 29 03:25:58 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-0804f0ad-04ff-41e7-9017-b333d789f1be tempest-GroupSnapshotsTest-1771286532 None] Group tempest-GroupSnapshotsTest-Group-1400060805: created successfully Jun 29 03:25:58 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-0804f0ad-04ff-41e7-9017-b333d789f1be tempest-GroupSnapshotsTest-1771286532 None] Create group completed successfully. Jun 29 03:25:59 devstack sudo[100193]: pam_unix(sudo:session): session closed for user root Jun 29 03:25:59 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-bd9b1e0f-3630-4a40-9939-816ad412b059 tempest-ServerRescueNegativeTestJSON-1378316394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-d9ede627-7d1a-42f4-9cf6-8aea03280bb5" returned: 0 in 1.142s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:25:59 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-bd9b1e0f-3630-4a40-9939-816ad412b059 tempest-ServerRescueNegativeTestJSON-1378316394 None] Lock "cinder-quobyte-d9ede627-7d1a-42f4-9cf6-8aea03280bb5" released by "delete_volume" :: held 2.715s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:25:59 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-bd9b1e0f-3630-4a40-9939-816ad412b059 tempest-ServerRescueNegativeTestJSON-1378316394 None] Created reservations ['acac99e6-fe42-4c21-ae52-90d6422ab9cc', '0cd8478a-90d7-40c7-9143-f2e2454f25c1', 'f9d0729f-a0ac-456c-9ac2-d1019cd7222a', '3ecfbc6c-6095-46c3-a661-e7c45de94d3d'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:25:59 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-bd9b1e0f-3630-4a40-9939-816ad412b059 tempest-ServerRescueNegativeTestJSON-1378316394 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:25:59 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-bd9b1e0f-3630-4a40-9939-816ad412b059 tempest-ServerRescueNegativeTestJSON-1378316394 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:25:59 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-bd9b1e0f-3630-4a40-9939-816ad412b059 tempest-ServerRescueNegativeTestJSON-1378316394 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:25:59 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-bd9b1e0f-3630-4a40-9939-816ad412b059 tempest-ServerRescueNegativeTestJSON-1378316394 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:25:59 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-bd9b1e0f-3630-4a40-9939-816ad412b059 tempest-ServerRescueNegativeTestJSON-1378316394 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:25:59 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-bd9b1e0f-3630-4a40-9939-816ad412b059 tempest-ServerRescueNegativeTestJSON-1378316394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:25:59 devstack sudo[100203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf Jun 29 03:25:59 devstack sudo[100203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:25:59 devstack sudo[100195]: pam_unix(sudo:session): session closed for user root Jun 29 03:25:59 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c39cb9b2-36e8-4125-9ce3-fdf5bfd20cb2 tempest-VolumesServicesTestJSON-282051472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-0b42502a-615d-43f4-8a0c-3253c6986231 1073741824" returned: 0 in 1.138s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:25:59 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c39cb9b2-36e8-4125-9ce3-fdf5bfd20cb2 tempest-VolumesServicesTestJSON-282051472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-0b42502a-615d-43f4-8a0c-3253c6986231 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:25:59 devstack sudo[100205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-0b42502a-615d-43f4-8a0c-3253c6986231 Jun 29 03:25:59 devstack sudo[100205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:26:00 devstack sudo[100203]: pam_unix(sudo:session): session closed for user root Jun 29 03:26:00 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-bd9b1e0f-3630-4a40-9939-816ad412b059 tempest-ServerRescueNegativeTestJSON-1378316394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf" returned: 0 in 1.096s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:26:00 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-bd9b1e0f-3630-4a40-9939-816ad412b059 tempest-ServerRescueNegativeTestJSON-1378316394 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:26:00 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-bd9b1e0f-3630-4a40-9939-816ad412b059 tempest-ServerRescueNegativeTestJSON-1378316394 None] Deleted volume successfully. Jun 29 03:26:00 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-bd9b1e0f-3630-4a40-9939-816ad412b059 tempest-ServerRescueNegativeTestJSON-1378316394 None] Lock "cinder-d9ede627-7d1a-42f4-9cf6-8aea03280bb5-delete_volume" released by "delete_volume" :: held 4.221s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:26:01 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-78abc96a-7873-4583-b5e5-410954b52a72 tempest-GroupSnapshotsTest-1771286532 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:26:01 devstack sudo[100205]: pam_unix(sudo:session): session closed for user root Jun 29 03:26:01 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-78abc96a-7873-4583-b5e5-410954b52a72 tempest-GroupSnapshotsTest-1771286532 None] Flow 'volume_create_manager' (5a2cef97-a463-4d5c-850b-a59a41155326) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:26:01 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-78abc96a-7873-4583-b5e5-410954b52a72 tempest-GroupSnapshotsTest-1771286532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ce5403b-0ef5-4019-b20e-c237ea889447) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:26:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c39cb9b2-36e8-4125-9ce3-fdf5bfd20cb2 tempest-VolumesServicesTestJSON-282051472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-0b42502a-615d-43f4-8a0c-3253c6986231" returned: 0 in 1.511s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:26:01 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-c39cb9b2-36e8-4125-9ce3-fdf5bfd20cb2 tempest-VolumesServicesTestJSON-282051472 None] <== create_volume: return (2748ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:26:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-c39cb9b2-36e8-4125-9ce3-fdf5bfd20cb2 tempest-VolumesServicesTestJSON-282051472 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.753s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:26:01 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-78abc96a-7873-4583-b5e5-410954b52a72 tempest-GroupSnapshotsTest-1771286532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ce5403b-0ef5-4019-b20e-c237ea889447) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:26:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-209889470',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e66dd1eb-8666-44e1-9d1d-705a56d306c7,host='devstack@QuobyteHD#QuobyteHD',id=58a0ab99-bb2e-4388-8115-29a477a313f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c152379270c34f8cbfcc68d9bff1896d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:26:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:26:01Z,use_quota=True,user_id='07b5122bd8a84b24bfe42d705a4f0cd2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cd38795f-067a-4014-ba1c-31144f497eac),volume_type_id=cd38795f-067a-4014-ba1c-31144f497eac)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:26:01 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-78abc96a-7873-4583-b5e5-410954b52a72 tempest-GroupSnapshotsTest-1771286532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c56226b-db38-49ed-8aee-828dfffa0db7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:26:01 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-78abc96a-7873-4583-b5e5-410954b52a72 tempest-GroupSnapshotsTest-1771286532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c56226b-db38-49ed-8aee-828dfffa0db7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:26:01 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-78abc96a-7873-4583-b5e5-410954b52a72 tempest-GroupSnapshotsTest-1771286532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03f8a45a-4bbd-48ee-9e02-58518e2642a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:26:01 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-78abc96a-7873-4583-b5e5-410954b52a72 tempest-GroupSnapshotsTest-1771286532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03f8a45a-4bbd-48ee-9e02-58518e2642a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '58a0ab99-bb2e-4388-8115-29a477a313f9', 'volume_name': 'volume-58a0ab99-bb2e-4388-8115-29a477a313f9', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:26:01 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-78abc96a-7873-4583-b5e5-410954b52a72 tempest-GroupSnapshotsTest-1771286532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb3f6bd2-6665-4584-8962-14b94c17f5fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:26:01 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-78abc96a-7873-4583-b5e5-410954b52a72 tempest-GroupSnapshotsTest-1771286532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb3f6bd2-6665-4584-8962-14b94c17f5fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:26:01 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-78abc96a-7873-4583-b5e5-410954b52a72 tempest-GroupSnapshotsTest-1771286532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (084c7911-020f-4437-942b-50b2f34fed90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:26:01 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-78abc96a-7873-4583-b5e5-410954b52a72 tempest-GroupSnapshotsTest-1771286532 None] Volume 58a0ab99-bb2e-4388-8115-29a477a313f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-58a0ab99-bb2e-4388-8115-29a477a313f9', 'volume_size': 1} Jun 29 03:26:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-78abc96a-7873-4583-b5e5-410954b52a72 tempest-GroupSnapshotsTest-1771286532 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:26:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-78abc96a-7873-4583-b5e5-410954b52a72 tempest-GroupSnapshotsTest-1771286532 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:26:01 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-78abc96a-7873-4583-b5e5-410954b52a72 tempest-GroupSnapshotsTest-1771286532 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=e66dd1eb-8666-44e1-9d1d-705a56d306c7,created_at=2026-06-29T01:26:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-209889470',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e66dd1eb-8666-44e1-9d1d-705a56d306c7,host='devstack@QuobyteHD#QuobyteHD',id=58a0ab99-bb2e-4388-8115-29a477a313f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c152379270c34f8cbfcc68d9bff1896d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:26:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:26:01Z,use_quota=True,user_id='07b5122bd8a84b24bfe42d705a4f0cd2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cd38795f-067a-4014-ba1c-31144f497eac),volume_type_id=cd38795f-067a-4014-ba1c-31144f497eac)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:26:01 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-78abc96a-7873-4583-b5e5-410954b52a72 tempest-GroupSnapshotsTest-1771286532 None] Creating volume 58a0ab99-bb2e-4388-8115-29a477a313f9 {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:26:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-78abc96a-7873-4583-b5e5-410954b52a72 tempest-GroupSnapshotsTest-1771286532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:26:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-78abc96a-7873-4583-b5e5-410954b52a72 tempest-GroupSnapshotsTest-1771286532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:26:01 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-78abc96a-7873-4583-b5e5-410954b52a72 tempest-GroupSnapshotsTest-1771286532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:26:01 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-78abc96a-7873-4583-b5e5-410954b52a72 tempest-GroupSnapshotsTest-1771286532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:26:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-78abc96a-7873-4583-b5e5-410954b52a72 tempest-GroupSnapshotsTest-1771286532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:26:01 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-78abc96a-7873-4583-b5e5-410954b52a72 tempest-GroupSnapshotsTest-1771286532 None] Selected osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:26:01 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-78abc96a-7873-4583-b5e5-410954b52a72 tempest-GroupSnapshotsTest-1771286532 None] casted to osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f Jun 29 03:26:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-78abc96a-7873-4583-b5e5-410954b52a72 tempest-GroupSnapshotsTest-1771286532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-58a0ab99-bb2e-4388-8115-29a477a313f9 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:26:01 devstack sudo[100214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-58a0ab99-bb2e-4388-8115-29a477a313f9 1073741824 Jun 29 03:26:01 devstack sudo[100214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:26:01 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-c39cb9b2-36e8-4125-9ce3-fdf5bfd20cb2 tempest-VolumesServicesTestJSON-282051472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5487bd81-369e-4bf6-8a6b-194ddaff6a09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b42502a-615d-43f4-8a0c-3253c6986231', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:26:01 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-c39cb9b2-36e8-4125-9ce3-fdf5bfd20cb2 tempest-VolumesServicesTestJSON-282051472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0470ec4d-fc38-40cf-860a-c51d4ff49caf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:26:01 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-c39cb9b2-36e8-4125-9ce3-fdf5bfd20cb2 tempest-VolumesServicesTestJSON-282051472 None] Volume volume-0b42502a-615d-43f4-8a0c-3253c6986231 (0b42502a-615d-43f4-8a0c-3253c6986231): created successfully Jun 29 03:26:01 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-c39cb9b2-36e8-4125-9ce3-fdf5bfd20cb2 tempest-VolumesServicesTestJSON-282051472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0470ec4d-fc38-40cf-860a-c51d4ff49caf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:26:01 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-c39cb9b2-36e8-4125-9ce3-fdf5bfd20cb2 tempest-VolumesServicesTestJSON-282051472 None] Flow 'volume_create_manager' (75675620-a5a9-4835-8ca4-b3840a188dc6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:26:01 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-c39cb9b2-36e8-4125-9ce3-fdf5bfd20cb2 tempest-VolumesServicesTestJSON-282051472 None] Created volume successfully. Jun 29 03:26:02 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-efb87f17-b067-420b-a6c7-1f8a5d3fe1c4 tempest-VolumesServicesTestJSON-282051472 None] Acquiring lock "cinder-0b42502a-615d-43f4-8a0c-3253c6986231-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:26:02 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-efb87f17-b067-420b-a6c7-1f8a5d3fe1c4 tempest-VolumesServicesTestJSON-282051472 None] Lock "cinder-0b42502a-615d-43f4-8a0c-3253c6986231-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:26:02 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-efb87f17-b067-420b-a6c7-1f8a5d3fe1c4 tempest-VolumesServicesTestJSON-282051472 None] Acquiring lock "cinder-quobyte-0b42502a-615d-43f4-8a0c-3253c6986231" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:26:02 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-efb87f17-b067-420b-a6c7-1f8a5d3fe1c4 tempest-VolumesServicesTestJSON-282051472 None] Lock "cinder-quobyte-0b42502a-615d-43f4-8a0c-3253c6986231" acquired by "delete_volume" :: waited 0.032s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:26:02 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[08643151-ecc7-41b7-ae87-6f87952dc95d]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:26:02 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-efb87f17-b067-420b-a6c7-1f8a5d3fe1c4 tempest-VolumesServicesTestJSON-282051472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-0b42502a-615d-43f4-8a0c-3253c6986231 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:26:02 devstack sudo[100252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-0b42502a-615d-43f4-8a0c-3253c6986231 Jun 29 03:26:02 devstack sudo[100252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:26:03 devstack sudo[100214]: pam_unix(sudo:session): session closed for user root Jun 29 03:26:03 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-78abc96a-7873-4583-b5e5-410954b52a72 tempest-GroupSnapshotsTest-1771286532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-58a0ab99-bb2e-4388-8115-29a477a313f9 1073741824" returned: 0 in 2.370s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:26:03 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-78abc96a-7873-4583-b5e5-410954b52a72 tempest-GroupSnapshotsTest-1771286532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-58a0ab99-bb2e-4388-8115-29a477a313f9 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:26:03 devstack sudo[100276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-58a0ab99-bb2e-4388-8115-29a477a313f9 Jun 29 03:26:03 devstack sudo[100276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:26:04 devstack sudo[100252]: pam_unix(sudo:session): session closed for user root Jun 29 03:26:04 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-efb87f17-b067-420b-a6c7-1f8a5d3fe1c4 tempest-VolumesServicesTestJSON-282051472 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-0b42502a-615d-43f4-8a0c-3253c6986231" returned: 0 in 1.643s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:26:04 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-efb87f17-b067-420b-a6c7-1f8a5d3fe1c4 tempest-VolumesServicesTestJSON-282051472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-0b42502a-615d-43f4-8a0c-3253c6986231 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:26:04 devstack sudo[100279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-0b42502a-615d-43f4-8a0c-3253c6986231 Jun 29 03:26:04 devstack sudo[100279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:26:05 devstack sudo[100276]: pam_unix(sudo:session): session closed for user root Jun 29 03:26:05 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-78abc96a-7873-4583-b5e5-410954b52a72 tempest-GroupSnapshotsTest-1771286532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-58a0ab99-bb2e-4388-8115-29a477a313f9" returned: 0 in 1.305s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:26:05 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-78abc96a-7873-4583-b5e5-410954b52a72 tempest-GroupSnapshotsTest-1771286532 None] <== create_volume: return (3761ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:26:05 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-78abc96a-7873-4583-b5e5-410954b52a72 tempest-GroupSnapshotsTest-1771286532 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.766s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:26:05 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-78abc96a-7873-4583-b5e5-410954b52a72 tempest-GroupSnapshotsTest-1771286532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (084c7911-020f-4437-942b-50b2f34fed90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58a0ab99-bb2e-4388-8115-29a477a313f9', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:26:05 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-78abc96a-7873-4583-b5e5-410954b52a72 tempest-GroupSnapshotsTest-1771286532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00ad6556-cb6f-4dea-bd71-2f9f9ddf5e8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:26:05 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-78abc96a-7873-4583-b5e5-410954b52a72 tempest-GroupSnapshotsTest-1771286532 None] Volume volume-58a0ab99-bb2e-4388-8115-29a477a313f9 (58a0ab99-bb2e-4388-8115-29a477a313f9): created successfully Jun 29 03:26:05 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-78abc96a-7873-4583-b5e5-410954b52a72 tempest-GroupSnapshotsTest-1771286532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00ad6556-cb6f-4dea-bd71-2f9f9ddf5e8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:26:05 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-78abc96a-7873-4583-b5e5-410954b52a72 tempest-GroupSnapshotsTest-1771286532 None] Flow 'volume_create_manager' (5a2cef97-a463-4d5c-850b-a59a41155326) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:26:05 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-78abc96a-7873-4583-b5e5-410954b52a72 tempest-GroupSnapshotsTest-1771286532 None] Created volume successfully. Jun 29 03:26:05 devstack sudo[100279]: pam_unix(sudo:session): session closed for user root Jun 29 03:26:05 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-efb87f17-b067-420b-a6c7-1f8a5d3fe1c4 tempest-VolumesServicesTestJSON-282051472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-0b42502a-615d-43f4-8a0c-3253c6986231" returned: 0 in 1.247s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:26:05 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-efb87f17-b067-420b-a6c7-1f8a5d3fe1c4 tempest-VolumesServicesTestJSON-282051472 None] Lock "cinder-quobyte-0b42502a-615d-43f4-8a0c-3253c6986231" released by "delete_volume" :: held 2.984s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:26:05 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-efb87f17-b067-420b-a6c7-1f8a5d3fe1c4 tempest-VolumesServicesTestJSON-282051472 None] Created reservations ['997d134a-9c70-4c3b-b877-a7ee1edf2419', 'e8881667-fd2c-452d-ad09-113169be33da', '815a95bc-657e-4a2b-80c4-5c66719eaa11', 'c0511f6d-c93d-450e-a4fb-1c16f427cfa0'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:26:05 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-efb87f17-b067-420b-a6c7-1f8a5d3fe1c4 tempest-VolumesServicesTestJSON-282051472 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:26:05 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-efb87f17-b067-420b-a6c7-1f8a5d3fe1c4 tempest-VolumesServicesTestJSON-282051472 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:26:05 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-efb87f17-b067-420b-a6c7-1f8a5d3fe1c4 tempest-VolumesServicesTestJSON-282051472 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:26:05 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-efb87f17-b067-420b-a6c7-1f8a5d3fe1c4 tempest-VolumesServicesTestJSON-282051472 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:26:05 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-efb87f17-b067-420b-a6c7-1f8a5d3fe1c4 tempest-VolumesServicesTestJSON-282051472 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:26:05 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-efb87f17-b067-420b-a6c7-1f8a5d3fe1c4 tempest-VolumesServicesTestJSON-282051472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:26:05 devstack sudo[100285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf Jun 29 03:26:05 devstack sudo[100285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:26:06 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-adac38f6-3259-46f7-a559-ab740eddeb37 tempest-GroupSnapshotsTest-1771286532 None] GroupSnapshot a8990c66-6a48-4119-a918-a5c5117fe1bc: creating. Jun 29 03:26:06 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-adac38f6-3259-46f7-a559-ab740eddeb37 tempest-GroupSnapshotsTest-1771286532 None] Group snapshot a8990c66-6a48-4119-a918-a5c5117fe1bc: creating. {{(pid=93468) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jun 29 03:26:06 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-adac38f6-3259-46f7-a559-ab740eddeb37 tempest-GroupSnapshotsTest-1771286532 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:26:06 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-adac38f6-3259-46f7-a559-ab740eddeb37 tempest-GroupSnapshotsTest-1771286532 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:26:06 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-adac38f6-3259-46f7-a559-ab740eddeb37 tempest-GroupSnapshotsTest-1771286532 None] Creating offline snapshot dd3e0717-eb39-48b0-bd45-76edd267c4af of volume 58a0ab99-bb2e-4388-8115-29a477a313f9 {{(pid=93468) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 29 03:26:06 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[776b5a6e-fc0b-477c-be18-1e7fab5a85ce]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:26:06 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-adac38f6-3259-46f7-a559-ab740eddeb37 tempest-GroupSnapshotsTest-1771286532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-58a0ab99-bb2e-4388-8115-29a477a313f9 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:26:06 devstack sudo[100287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-58a0ab99-bb2e-4388-8115-29a477a313f9 Jun 29 03:26:06 devstack sudo[100287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:26:06 devstack sudo[100285]: pam_unix(sudo:session): session closed for user root Jun 29 03:26:06 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-efb87f17-b067-420b-a6c7-1f8a5d3fe1c4 tempest-VolumesServicesTestJSON-282051472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf" returned: 0 in 1.154s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:26:06 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-efb87f17-b067-420b-a6c7-1f8a5d3fe1c4 tempest-VolumesServicesTestJSON-282051472 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:26:06 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-efb87f17-b067-420b-a6c7-1f8a5d3fe1c4 tempest-VolumesServicesTestJSON-282051472 None] Deleted volume successfully. Jun 29 03:26:06 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-efb87f17-b067-420b-a6c7-1f8a5d3fe1c4 tempest-VolumesServicesTestJSON-282051472 None] Lock "cinder-0b42502a-615d-43f4-8a0c-3253c6986231-delete_volume" released by "delete_volume" :: held 4.483s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:26:07 devstack sudo[100287]: pam_unix(sudo:session): session closed for user root Jun 29 03:26:07 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-adac38f6-3259-46f7-a559-ab740eddeb37 tempest-GroupSnapshotsTest-1771286532 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-58a0ab99-bb2e-4388-8115-29a477a313f9" returned: 0 in 1.103s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:26:07 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-adac38f6-3259-46f7-a559-ab740eddeb37 tempest-GroupSnapshotsTest-1771286532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-58a0ab99-bb2e-4388-8115-29a477a313f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-58a0ab99-bb2e-4388-8115-29a477a313f9.dd3e0717-eb39-48b0-bd45-76edd267c4af 1G {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:26:07 devstack sudo[100294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-58a0ab99-bb2e-4388-8115-29a477a313f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-58a0ab99-bb2e-4388-8115-29a477a313f9.dd3e0717-eb39-48b0-bd45-76edd267c4af 1G Jun 29 03:26:07 devstack sudo[100294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:26:08 devstack sudo[100294]: pam_unix(sudo:session): session closed for user root Jun 29 03:26:08 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-adac38f6-3259-46f7-a559-ab740eddeb37 tempest-GroupSnapshotsTest-1771286532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-58a0ab99-bb2e-4388-8115-29a477a313f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-58a0ab99-bb2e-4388-8115-29a477a313f9.dd3e0717-eb39-48b0-bd45-76edd267c4af 1G" returned: 0 in 1.106s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:26:08 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-adac38f6-3259-46f7-a559-ab740eddeb37 tempest-GroupSnapshotsTest-1771286532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-58a0ab99-bb2e-4388-8115-29a477a313f9 -F qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-58a0ab99-bb2e-4388-8115-29a477a313f9.dd3e0717-eb39-48b0-bd45-76edd267c4af {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:26:08 devstack sudo[100303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-58a0ab99-bb2e-4388-8115-29a477a313f9 -F qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-58a0ab99-bb2e-4388-8115-29a477a313f9.dd3e0717-eb39-48b0-bd45-76edd267c4af Jun 29 03:26:08 devstack sudo[100303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:26:09 devstack sudo[100303]: pam_unix(sudo:session): session closed for user root Jun 29 03:26:09 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-adac38f6-3259-46f7-a559-ab740eddeb37 tempest-GroupSnapshotsTest-1771286532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-58a0ab99-bb2e-4388-8115-29a477a313f9 -F qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-58a0ab99-bb2e-4388-8115-29a477a313f9.dd3e0717-eb39-48b0-bd45-76edd267c4af" returned: 0 in 0.809s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:26:09 devstack cinder-volume[93468]: WARNING cinder.volume.drivers.remotefs [None req-adac38f6-3259-46f7-a559-ab740eddeb37 tempest-GroupSnapshotsTest-1771286532 None] /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-58a0ab99-bb2e-4388-8115-29a477a313f9.dd3e0717-eb39-48b0-bd45-76edd267c4af is being set with open permissions: ugo+rw: NotImplementedError Jun 29 03:26:09 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-adac38f6-3259-46f7-a559-ab740eddeb37 tempest-GroupSnapshotsTest-1771286532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-58a0ab99-bb2e-4388-8115-29a477a313f9.dd3e0717-eb39-48b0-bd45-76edd267c4af {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:26:09 devstack sudo[100308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-58a0ab99-bb2e-4388-8115-29a477a313f9.dd3e0717-eb39-48b0-bd45-76edd267c4af Jun 29 03:26:09 devstack sudo[100308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:26:09 devstack sudo[100308]: pam_unix(sudo:session): session closed for user root Jun 29 03:26:09 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-adac38f6-3259-46f7-a559-ab740eddeb37 tempest-GroupSnapshotsTest-1771286532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-58a0ab99-bb2e-4388-8115-29a477a313f9.dd3e0717-eb39-48b0-bd45-76edd267c4af" returned: 0 in 0.736s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:26:09 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-adac38f6-3259-46f7-a559-ab740eddeb37 tempest-GroupSnapshotsTest-1771286532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-58a0ab99-bb2e-4388-8115-29a477a313f9.info {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:26:10 devstack sudo[100311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-58a0ab99-bb2e-4388-8115-29a477a313f9.info Jun 29 03:26:10 devstack sudo[100311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:26:10 devstack sudo[100311]: pam_unix(sudo:session): session closed for user root Jun 29 03:26:10 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-adac38f6-3259-46f7-a559-ab740eddeb37 tempest-GroupSnapshotsTest-1771286532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-58a0ab99-bb2e-4388-8115-29a477a313f9.info" returned: 0 in 0.896s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:26:10 devstack cinder-volume[93468]: WARNING cinder.volume.drivers.remotefs [None req-adac38f6-3259-46f7-a559-ab740eddeb37 tempest-GroupSnapshotsTest-1771286532 None] /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-58a0ab99-bb2e-4388-8115-29a477a313f9.info is being set with open permissions: ugo+rw: NotImplementedError Jun 29 03:26:10 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-adac38f6-3259-46f7-a559-ab740eddeb37 tempest-GroupSnapshotsTest-1771286532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-58a0ab99-bb2e-4388-8115-29a477a313f9.info {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:26:10 devstack sudo[100315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-58a0ab99-bb2e-4388-8115-29a477a313f9.info Jun 29 03:26:10 devstack sudo[100315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:26:11 devstack cinder-volume[93468]: DEBUG oslo_service.periodic_task [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93468) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 29 03:26:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:26:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:26:11 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:26:11 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:26:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:26:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:26:11 devstack sudo[100320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf Jun 29 03:26:11 devstack sudo[100320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:26:11 devstack sudo[100315]: pam_unix(sudo:session): session closed for user root Jun 29 03:26:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-adac38f6-3259-46f7-a559-ab740eddeb37 tempest-GroupSnapshotsTest-1771286532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-58a0ab99-bb2e-4388-8115-29a477a313f9.info" returned: 0 in 1.066s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:26:12 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-adac38f6-3259-46f7-a559-ab740eddeb37 tempest-GroupSnapshotsTest-1771286532 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.860s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:26:12 devstack cinder-volume[93468]: DEBUG dbcounter [-] [93468] Writing DB stats cinder:SELECT=52,cinder:UPDATE=62,cinder:DELETE=4,cinder:INSERT=13 {{(pid=93468) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 29 03:26:12 devstack cinder-volume[93468]: DEBUG dbcounter [-] [93468] Writing DB stats cinder:UPDATE=59,cinder:SELECT=53,cinder:INSERT=15,cinder:DELETE=7 {{(pid=93468) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 29 03:26:12 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-adac38f6-3259-46f7-a559-ab740eddeb37 tempest-GroupSnapshotsTest-1771286532 None] group_snapshot a8990c66-6a48-4119-a918-a5c5117fe1bc: created successfully Jun 29 03:26:12 devstack sudo[100320]: pam_unix(sudo:session): session closed for user root Jun 29 03:26:12 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf" returned: 0 in 1.128s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:26:12 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:26:12 devstack cinder-volume[93468]: DEBUG oslo_service.periodic_task [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Running periodic task VolumeManager._thread_info {{(pid=93468) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 29 03:26:12 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] thread count: 8 {{(pid=93468) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 29 03:26:12 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] thread info: [<_MainThread(MainThread, started 132331377287296)>, , , , , , , ] {{(pid=93468) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 29 03:26:14 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-a95447a4-00fd-4d7d-92ba-12f8ad46cd14 tempest-GroupSnapshotsTest-1771286532 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:26:14 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-a95447a4-00fd-4d7d-92ba-12f8ad46cd14 tempest-GroupSnapshotsTest-1771286532 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:26:14 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-a95447a4-00fd-4d7d-92ba-12f8ad46cd14 tempest-GroupSnapshotsTest-1771286532 None] Acquiring lock "cinder-quobyte-dd3e0717-eb39-48b0-bd45-76edd267c4af-3e057c45-7ab8-4c4b-8361-a661fbf99994" by "_create_volume_from_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:26:14 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-a95447a4-00fd-4d7d-92ba-12f8ad46cd14 tempest-GroupSnapshotsTest-1771286532 None] Lock "cinder-quobyte-dd3e0717-eb39-48b0-bd45-76edd267c4af-3e057c45-7ab8-4c4b-8361-a661fbf99994" acquired by "_create_volume_from_snapshot" :: waited 0.024s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:26:14 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-a95447a4-00fd-4d7d-92ba-12f8ad46cd14 tempest-GroupSnapshotsTest-1771286532 None] Creating volume 3e057c45-7ab8-4c4b-8361-a661fbf99994 from snapshot dd3e0717-eb39-48b0-bd45-76edd267c4af {{(pid=93468) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 29 03:26:14 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-a95447a4-00fd-4d7d-92ba-12f8ad46cd14 tempest-GroupSnapshotsTest-1771286532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:26:14 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-a95447a4-00fd-4d7d-92ba-12f8ad46cd14 tempest-GroupSnapshotsTest-1771286532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:26:14 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-a95447a4-00fd-4d7d-92ba-12f8ad46cd14 tempest-GroupSnapshotsTest-1771286532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:26:14 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-a95447a4-00fd-4d7d-92ba-12f8ad46cd14 tempest-GroupSnapshotsTest-1771286532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:26:14 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-a95447a4-00fd-4d7d-92ba-12f8ad46cd14 tempest-GroupSnapshotsTest-1771286532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:26:14 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-a95447a4-00fd-4d7d-92ba-12f8ad46cd14 tempest-GroupSnapshotsTest-1771286532 None] Selected osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:26:14 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-a95447a4-00fd-4d7d-92ba-12f8ad46cd14 tempest-GroupSnapshotsTest-1771286532 None] Acquiring lock "cinder-quobyte-3e057c45-7ab8-4c4b-8361-a661fbf99994" by "_copy_volume_from_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:26:14 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-a95447a4-00fd-4d7d-92ba-12f8ad46cd14 tempest-GroupSnapshotsTest-1771286532 None] Lock "cinder-quobyte-3e057c45-7ab8-4c4b-8361-a661fbf99994" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:26:14 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-a95447a4-00fd-4d7d-92ba-12f8ad46cd14 tempest-GroupSnapshotsTest-1771286532 None] snapshot: dd3e0717-eb39-48b0-bd45-76edd267c4af, volume: 3e057c45-7ab8-4c4b-8361-a661fbf99994, {{(pid=93468) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 29 03:26:14 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-a95447a4-00fd-4d7d-92ba-12f8ad46cd14 tempest-GroupSnapshotsTest-1771286532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:26:14 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-a95447a4-00fd-4d7d-92ba-12f8ad46cd14 tempest-GroupSnapshotsTest-1771286532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:26:14 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-a95447a4-00fd-4d7d-92ba-12f8ad46cd14 tempest-GroupSnapshotsTest-1771286532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:26:14 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-a95447a4-00fd-4d7d-92ba-12f8ad46cd14 tempest-GroupSnapshotsTest-1771286532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:26:14 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-a95447a4-00fd-4d7d-92ba-12f8ad46cd14 tempest-GroupSnapshotsTest-1771286532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:26:14 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[da1994eb-4ac0-4d66-874b-b505d5ef0471]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:26:14 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a95447a4-00fd-4d7d-92ba-12f8ad46cd14 tempest-GroupSnapshotsTest-1771286532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-58a0ab99-bb2e-4388-8115-29a477a313f9.dd3e0717-eb39-48b0-bd45-76edd267c4af {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:26:14 devstack sudo[100383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-58a0ab99-bb2e-4388-8115-29a477a313f9.dd3e0717-eb39-48b0-bd45-76edd267c4af Jun 29 03:26:14 devstack sudo[100383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:26:15 devstack sudo[100383]: pam_unix(sudo:session): session closed for user root Jun 29 03:26:15 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a95447a4-00fd-4d7d-92ba-12f8ad46cd14 tempest-GroupSnapshotsTest-1771286532 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-58a0ab99-bb2e-4388-8115-29a477a313f9.dd3e0717-eb39-48b0-bd45-76edd267c4af" returned: 0 in 1.124s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:26:15 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-a95447a4-00fd-4d7d-92ba-12f8ad46cd14 tempest-GroupSnapshotsTest-1771286532 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-58a0ab99-bb2e-4388-8115-29a477a313f9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93468) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 29 03:26:15 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-a95447a4-00fd-4d7d-92ba-12f8ad46cd14 tempest-GroupSnapshotsTest-1771286532 None] will copy from snapshot at /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-58a0ab99-bb2e-4388-8115-29a477a313f9 {{(pid=93468) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 29 03:26:15 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-a95447a4-00fd-4d7d-92ba-12f8ad46cd14 tempest-GroupSnapshotsTest-1771286532 None] Creating direct copy from snapshot {{(pid=93468) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 29 03:26:15 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[748d22f8-874e-4f12-83e9-1ec681c1fecc]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:26:15 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a95447a4-00fd-4d7d-92ba-12f8ad46cd14 tempest-GroupSnapshotsTest-1771286532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-58a0ab99-bb2e-4388-8115-29a477a313f9 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:26:15 devstack sudo[100393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-58a0ab99-bb2e-4388-8115-29a477a313f9 Jun 29 03:26:15 devstack sudo[100393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:26:16 devstack sudo[100393]: pam_unix(sudo:session): session closed for user root Jun 29 03:26:16 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a95447a4-00fd-4d7d-92ba-12f8ad46cd14 tempest-GroupSnapshotsTest-1771286532 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-58a0ab99-bb2e-4388-8115-29a477a313f9" returned: 0 in 0.919s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:26:16 devstack cinder-volume[93468]: DEBUG cinder.utils [None req-a95447a4-00fd-4d7d-92ba-12f8ad46cd14 tempest-GroupSnapshotsTest-1771286532 None] Path /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-3e057c45-7ab8-4c4b-8361-a661fbf99994 not found in is_blk_device check {{(pid=93468) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 29 03:26:16 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a95447a4-00fd-4d7d-92ba-12f8ad46cd14 tempest-GroupSnapshotsTest-1771286532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-58a0ab99-bb2e-4388-8115-29a477a313f9 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-3e057c45-7ab8-4c4b-8361-a661fbf99994 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:26:16 devstack sudo[100398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-58a0ab99-bb2e-4388-8115-29a477a313f9 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-3e057c45-7ab8-4c4b-8361-a661fbf99994 Jun 29 03:26:16 devstack sudo[100398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:26:24 devstack cinder-volume[93468]: DEBUG dbcounter [-] [93468] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=93468) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 29 03:26:24 devstack cinder-volume[93468]: DEBUG dbcounter [-] [93468] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=93468) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 29 03:26:25 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0ca5b84-8546-4bee-a885-fea41faaea5a tempest-VolumeSnapshotQuotasNegativeTestJSON-908931209 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:26:25 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-b0ca5b84-8546-4bee-a885-fea41faaea5a tempest-VolumeSnapshotQuotasNegativeTestJSON-908931209 None] Flow 'volume_create_manager' (9b971904-1e17-4088-a5c2-92f32aa7fcdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:26:25 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-b0ca5b84-8546-4bee-a885-fea41faaea5a tempest-VolumeSnapshotQuotasNegativeTestJSON-908931209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e9e3b03-0993-4bdb-9033-9bbbfe997913) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:26:25 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-b0ca5b84-8546-4bee-a885-fea41faaea5a tempest-VolumeSnapshotQuotasNegativeTestJSON-908931209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e9e3b03-0993-4bdb-9033-9bbbfe997913) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:26:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-61813746',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b62871f-b6ab-4985-a28a-7512d08eefac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a54376a9b5db4483984aeacf75841179',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:26:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:26:25Z,use_quota=True,user_id='b1af0629b65a4277ba56dfb75101fa2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:26:25 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-b0ca5b84-8546-4bee-a885-fea41faaea5a tempest-VolumeSnapshotQuotasNegativeTestJSON-908931209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08d1c546-e745-4ea5-ab5f-fa2be6e77458) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:26:25 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-b0ca5b84-8546-4bee-a885-fea41faaea5a tempest-VolumeSnapshotQuotasNegativeTestJSON-908931209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08d1c546-e745-4ea5-ab5f-fa2be6e77458) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:26:25 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-b0ca5b84-8546-4bee-a885-fea41faaea5a tempest-VolumeSnapshotQuotasNegativeTestJSON-908931209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b70e8b7e-d2b2-4dea-b72e-a443508f38aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:26:25 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-b0ca5b84-8546-4bee-a885-fea41faaea5a tempest-VolumeSnapshotQuotasNegativeTestJSON-908931209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b70e8b7e-d2b2-4dea-b72e-a443508f38aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b62871f-b6ab-4985-a28a-7512d08eefac', 'volume_name': 'volume-9b62871f-b6ab-4985-a28a-7512d08eefac', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:26:25 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-b0ca5b84-8546-4bee-a885-fea41faaea5a tempest-VolumeSnapshotQuotasNegativeTestJSON-908931209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f871860-3f0c-4320-84ed-bcb2433df041) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:26:25 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-b0ca5b84-8546-4bee-a885-fea41faaea5a tempest-VolumeSnapshotQuotasNegativeTestJSON-908931209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f871860-3f0c-4320-84ed-bcb2433df041) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:26:25 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-b0ca5b84-8546-4bee-a885-fea41faaea5a tempest-VolumeSnapshotQuotasNegativeTestJSON-908931209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abdbe8bc-0ef2-4781-933c-d6c7bafe2e2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:26:25 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-b0ca5b84-8546-4bee-a885-fea41faaea5a tempest-VolumeSnapshotQuotasNegativeTestJSON-908931209 None] Volume 9b62871f-b6ab-4985-a28a-7512d08eefac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b62871f-b6ab-4985-a28a-7512d08eefac', 'volume_size': 1} Jun 29 03:26:25 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-b0ca5b84-8546-4bee-a885-fea41faaea5a tempest-VolumeSnapshotQuotasNegativeTestJSON-908931209 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:26:25 devstack sudo[100398]: pam_unix(sudo:session): session closed for user root Jun 29 03:26:25 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a95447a4-00fd-4d7d-92ba-12f8ad46cd14 tempest-GroupSnapshotsTest-1771286532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-58a0ab99-bb2e-4388-8115-29a477a313f9 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-3e057c45-7ab8-4c4b-8361-a661fbf99994" returned: 0 in 8.715s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:26:25 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[b47b2ed2-cc55-4e04-932d-46a7840851eb]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:26:25 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a95447a4-00fd-4d7d-92ba-12f8ad46cd14 tempest-GroupSnapshotsTest-1771286532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-58a0ab99-bb2e-4388-8115-29a477a313f9 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:26:25 devstack sudo[100516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-58a0ab99-bb2e-4388-8115-29a477a313f9 Jun 29 03:26:25 devstack sudo[100516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:26:26 devstack sudo[100516]: pam_unix(sudo:session): session closed for user root Jun 29 03:26:26 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a95447a4-00fd-4d7d-92ba-12f8ad46cd14 tempest-GroupSnapshotsTest-1771286532 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-58a0ab99-bb2e-4388-8115-29a477a313f9" returned: 0 in 1.275s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:26:26 devstack cinder-volume[93468]: DEBUG cinder.image.image_utils [None req-a95447a4-00fd-4d7d-92ba-12f8ad46cd14 tempest-GroupSnapshotsTest-1771286532 None] Image conversion details: src /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-58a0ab99-bb2e-4388-8115-29a477a313f9, size 1024.00 MB, duration 8.72 sec, destination /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-3e057c45-7ab8-4c4b-8361-a661fbf99994 {{(pid=93468) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 29 03:26:26 devstack cinder-volume[93468]: INFO cinder.image.image_utils [None req-a95447a4-00fd-4d7d-92ba-12f8ad46cd14 tempest-GroupSnapshotsTest-1771286532 None] Converted 1024.00 MB image at 117.48 MB/s Jun 29 03:26:26 devstack cinder-volume[93468]: WARNING cinder.volume.drivers.remotefs [None req-a95447a4-00fd-4d7d-92ba-12f8ad46cd14 tempest-GroupSnapshotsTest-1771286532 None] /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-3e057c45-7ab8-4c4b-8361-a661fbf99994 is being set with open permissions: ugo+rw: NotImplementedError Jun 29 03:26:26 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a95447a4-00fd-4d7d-92ba-12f8ad46cd14 tempest-GroupSnapshotsTest-1771286532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-3e057c45-7ab8-4c4b-8361-a661fbf99994 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:26:26 devstack sudo[100525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-3e057c45-7ab8-4c4b-8361-a661fbf99994 Jun 29 03:26:26 devstack sudo[100525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:26:27 devstack sudo[100525]: pam_unix(sudo:session): session closed for user root Jun 29 03:26:27 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a95447a4-00fd-4d7d-92ba-12f8ad46cd14 tempest-GroupSnapshotsTest-1771286532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-3e057c45-7ab8-4c4b-8361-a661fbf99994" returned: 0 in 0.866s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:26:27 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-a95447a4-00fd-4d7d-92ba-12f8ad46cd14 tempest-GroupSnapshotsTest-1771286532 None] Lock "cinder-quobyte-3e057c45-7ab8-4c4b-8361-a661fbf99994" released by "_copy_volume_from_snapshot" :: held 13.021s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:26:27 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-a95447a4-00fd-4d7d-92ba-12f8ad46cd14 tempest-GroupSnapshotsTest-1771286532 None] Lock "cinder-quobyte-dd3e0717-eb39-48b0-bd45-76edd267c4af-3e057c45-7ab8-4c4b-8361-a661fbf99994" released by "_create_volume_from_snapshot" :: held 13.058s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:26:27 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-a95447a4-00fd-4d7d-92ba-12f8ad46cd14 tempest-GroupSnapshotsTest-1771286532 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 13.083s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:26:27 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-b0ca5b84-8546-4bee-a885-fea41faaea5a tempest-VolumeSnapshotQuotasNegativeTestJSON-908931209 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.236s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:26:27 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-b0ca5b84-8546-4bee-a885-fea41faaea5a tempest-VolumeSnapshotQuotasNegativeTestJSON-908931209 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:26:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-61813746',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b62871f-b6ab-4985-a28a-7512d08eefac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a54376a9b5db4483984aeacf75841179',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:26:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:26:25Z,use_quota=True,user_id='b1af0629b65a4277ba56dfb75101fa2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:26:27 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-b0ca5b84-8546-4bee-a885-fea41faaea5a tempest-VolumeSnapshotQuotasNegativeTestJSON-908931209 None] Creating volume 9b62871f-b6ab-4985-a28a-7512d08eefac {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:26:27 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-b0ca5b84-8546-4bee-a885-fea41faaea5a tempest-VolumeSnapshotQuotasNegativeTestJSON-908931209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:26:27 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-b0ca5b84-8546-4bee-a885-fea41faaea5a tempest-VolumeSnapshotQuotasNegativeTestJSON-908931209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:26:27 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-b0ca5b84-8546-4bee-a885-fea41faaea5a tempest-VolumeSnapshotQuotasNegativeTestJSON-908931209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:26:27 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-b0ca5b84-8546-4bee-a885-fea41faaea5a tempest-VolumeSnapshotQuotasNegativeTestJSON-908931209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:26:27 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-b0ca5b84-8546-4bee-a885-fea41faaea5a tempest-VolumeSnapshotQuotasNegativeTestJSON-908931209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:26:27 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-b0ca5b84-8546-4bee-a885-fea41faaea5a tempest-VolumeSnapshotQuotasNegativeTestJSON-908931209 None] Selected osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:26:27 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-b0ca5b84-8546-4bee-a885-fea41faaea5a tempest-VolumeSnapshotQuotasNegativeTestJSON-908931209 None] casted to osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f Jun 29 03:26:27 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b0ca5b84-8546-4bee-a885-fea41faaea5a tempest-VolumeSnapshotQuotasNegativeTestJSON-908931209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9b62871f-b6ab-4985-a28a-7512d08eefac 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:26:27 devstack sudo[100528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9b62871f-b6ab-4985-a28a-7512d08eefac 1073741824 Jun 29 03:26:27 devstack sudo[100528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:26:27 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-a95447a4-00fd-4d7d-92ba-12f8ad46cd14 tempest-GroupSnapshotsTest-1771286532 None] Create group from source-snapshot-a8990c66-6a48-4119-a918-a5c5117fe1bc completed successfully. Jun 29 03:26:28 devstack sudo[100528]: pam_unix(sudo:session): session closed for user root Jun 29 03:26:28 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b0ca5b84-8546-4bee-a885-fea41faaea5a tempest-VolumeSnapshotQuotasNegativeTestJSON-908931209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9b62871f-b6ab-4985-a28a-7512d08eefac 1073741824" returned: 0 in 1.268s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:26:28 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b0ca5b84-8546-4bee-a885-fea41faaea5a tempest-VolumeSnapshotQuotasNegativeTestJSON-908931209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9b62871f-b6ab-4985-a28a-7512d08eefac {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:26:28 devstack sudo[100535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9b62871f-b6ab-4985-a28a-7512d08eefac Jun 29 03:26:28 devstack sudo[100535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:26:29 devstack sudo[100535]: pam_unix(sudo:session): session closed for user root Jun 29 03:26:29 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b0ca5b84-8546-4bee-a885-fea41faaea5a tempest-VolumeSnapshotQuotasNegativeTestJSON-908931209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9b62871f-b6ab-4985-a28a-7512d08eefac" returned: 0 in 0.856s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:26:29 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-b0ca5b84-8546-4bee-a885-fea41faaea5a tempest-VolumeSnapshotQuotasNegativeTestJSON-908931209 None] <== create_volume: return (2178ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:26:29 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-b0ca5b84-8546-4bee-a885-fea41faaea5a tempest-VolumeSnapshotQuotasNegativeTestJSON-908931209 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.183s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:26:29 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-b0ca5b84-8546-4bee-a885-fea41faaea5a tempest-VolumeSnapshotQuotasNegativeTestJSON-908931209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abdbe8bc-0ef2-4781-933c-d6c7bafe2e2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b62871f-b6ab-4985-a28a-7512d08eefac', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:26:29 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-b0ca5b84-8546-4bee-a885-fea41faaea5a tempest-VolumeSnapshotQuotasNegativeTestJSON-908931209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e2488ed-c6bc-41d0-8049-05cf00da75c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:26:29 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-b0ca5b84-8546-4bee-a885-fea41faaea5a tempest-VolumeSnapshotQuotasNegativeTestJSON-908931209 None] Volume volume-9b62871f-b6ab-4985-a28a-7512d08eefac (9b62871f-b6ab-4985-a28a-7512d08eefac): created successfully Jun 29 03:26:29 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-b0ca5b84-8546-4bee-a885-fea41faaea5a tempest-VolumeSnapshotQuotasNegativeTestJSON-908931209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e2488ed-c6bc-41d0-8049-05cf00da75c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:26:29 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-b0ca5b84-8546-4bee-a885-fea41faaea5a tempest-VolumeSnapshotQuotasNegativeTestJSON-908931209 None] Flow 'volume_create_manager' (9b971904-1e17-4088-a5c2-92f32aa7fcdb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:26:29 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-b0ca5b84-8546-4bee-a885-fea41faaea5a tempest-VolumeSnapshotQuotasNegativeTestJSON-908931209 None] Created volume successfully. Jun 29 03:26:29 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-d8dd2bd1-5dc1-4164-9285-5c0159f5c76c tempest-GroupSnapshotsTest-1771286532 None] Acquiring lock "cinder-quobyte-3e057c45-7ab8-4c4b-8361-a661fbf99994" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:26:29 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-d8dd2bd1-5dc1-4164-9285-5c0159f5c76c tempest-GroupSnapshotsTest-1771286532 None] Lock "cinder-quobyte-3e057c45-7ab8-4c4b-8361-a661fbf99994" acquired by "delete_volume" :: waited 0.019s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:26:29 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fe6f21a-c9f2-4594-9146-85949aeb27f9]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:26:29 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d8dd2bd1-5dc1-4164-9285-5c0159f5c76c tempest-GroupSnapshotsTest-1771286532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-3e057c45-7ab8-4c4b-8361-a661fbf99994 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:26:29 devstack sudo[100538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-3e057c45-7ab8-4c4b-8361-a661fbf99994 Jun 29 03:26:29 devstack sudo[100538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:26:30 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-87fcdf8d-0c08-4bb7-8671-e6f73fae52cc tempest-VolumeSnapshotQuotasNegativeTestJSON-908931209 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:26:30 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-87fcdf8d-0c08-4bb7-8671-e6f73fae52cc tempest-VolumeSnapshotQuotasNegativeTestJSON-908931209 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:26:30 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-87fcdf8d-0c08-4bb7-8671-e6f73fae52cc tempest-VolumeSnapshotQuotasNegativeTestJSON-908931209 None] Creating offline snapshot 3a5203b9-1dc8-4bbd-afc6-c46582c78820 of volume 9b62871f-b6ab-4985-a28a-7512d08eefac {{(pid=93468) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 29 03:26:30 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5e11145-5c77-4b52-ac07-76ca7731354d]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:26:30 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-87fcdf8d-0c08-4bb7-8671-e6f73fae52cc tempest-VolumeSnapshotQuotasNegativeTestJSON-908931209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9b62871f-b6ab-4985-a28a-7512d08eefac {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:26:30 devstack sudo[100540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9b62871f-b6ab-4985-a28a-7512d08eefac Jun 29 03:26:30 devstack sudo[100540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:26:30 devstack sudo[100538]: pam_unix(sudo:session): session closed for user root Jun 29 03:26:30 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d8dd2bd1-5dc1-4164-9285-5c0159f5c76c tempest-GroupSnapshotsTest-1771286532 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-3e057c45-7ab8-4c4b-8361-a661fbf99994" returned: 0 in 1.099s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:26:30 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d8dd2bd1-5dc1-4164-9285-5c0159f5c76c tempest-GroupSnapshotsTest-1771286532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-3e057c45-7ab8-4c4b-8361-a661fbf99994 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:26:30 devstack sudo[100546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-3e057c45-7ab8-4c4b-8361-a661fbf99994 Jun 29 03:26:30 devstack sudo[100546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:26:31 devstack sudo[100540]: pam_unix(sudo:session): session closed for user root Jun 29 03:26:31 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-87fcdf8d-0c08-4bb7-8671-e6f73fae52cc tempest-VolumeSnapshotQuotasNegativeTestJSON-908931209 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9b62871f-b6ab-4985-a28a-7512d08eefac" returned: 0 in 1.045s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:26:31 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-87fcdf8d-0c08-4bb7-8671-e6f73fae52cc tempest-VolumeSnapshotQuotasNegativeTestJSON-908931209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9b62871f-b6ab-4985-a28a-7512d08eefac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9b62871f-b6ab-4985-a28a-7512d08eefac.3a5203b9-1dc8-4bbd-afc6-c46582c78820 1G {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:26:31 devstack sudo[100552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9b62871f-b6ab-4985-a28a-7512d08eefac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9b62871f-b6ab-4985-a28a-7512d08eefac.3a5203b9-1dc8-4bbd-afc6-c46582c78820 1G Jun 29 03:26:31 devstack sudo[100552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:26:31 devstack sudo[100546]: pam_unix(sudo:session): session closed for user root Jun 29 03:26:31 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d8dd2bd1-5dc1-4164-9285-5c0159f5c76c tempest-GroupSnapshotsTest-1771286532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-3e057c45-7ab8-4c4b-8361-a661fbf99994" returned: 0 in 0.984s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:26:31 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-d8dd2bd1-5dc1-4164-9285-5c0159f5c76c tempest-GroupSnapshotsTest-1771286532 None] Lock "cinder-quobyte-3e057c45-7ab8-4c4b-8361-a661fbf99994" released by "delete_volume" :: held 2.180s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:26:32 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-d8dd2bd1-5dc1-4164-9285-5c0159f5c76c tempest-GroupSnapshotsTest-1771286532 None] Created reservations ['78418dcd-95ec-4c08-ba6c-6e5c72054412'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:26:32 devstack cinder-volume[93468]: WARNING cinder.quota [None req-d8dd2bd1-5dc1-4164-9285-5c0159f5c76c tempest-GroupSnapshotsTest-1771286532 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-343397741 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-343397741, it is now deprecated. Please use the default quota class for default quota. Jun 29 03:26:32 devstack cinder-volume[93468]: WARNING cinder.quota [None req-d8dd2bd1-5dc1-4164-9285-5c0159f5c76c tempest-GroupSnapshotsTest-1771286532 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-343397741 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-343397741, it is now deprecated. Please use the default quota class for default quota. Jun 29 03:26:32 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-d8dd2bd1-5dc1-4164-9285-5c0159f5c76c tempest-GroupSnapshotsTest-1771286532 None] Created reservations ['9c0a7e5d-0303-4bbe-9873-1a366b14f3c7', 'ab91f8fd-07c1-41aa-8c5b-74e1643b8035', '231f5136-0a98-472c-bb1c-db19537d1230', '3784e9f3-78f5-4273-a505-7050faf2cabd'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:26:32 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-d8dd2bd1-5dc1-4164-9285-5c0159f5c76c tempest-GroupSnapshotsTest-1771286532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:26:32 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-d8dd2bd1-5dc1-4164-9285-5c0159f5c76c tempest-GroupSnapshotsTest-1771286532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:26:32 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-d8dd2bd1-5dc1-4164-9285-5c0159f5c76c tempest-GroupSnapshotsTest-1771286532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:26:32 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-d8dd2bd1-5dc1-4164-9285-5c0159f5c76c tempest-GroupSnapshotsTest-1771286532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:26:32 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-d8dd2bd1-5dc1-4164-9285-5c0159f5c76c tempest-GroupSnapshotsTest-1771286532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:26:32 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d8dd2bd1-5dc1-4164-9285-5c0159f5c76c tempest-GroupSnapshotsTest-1771286532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:26:32 devstack sudo[100555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf Jun 29 03:26:32 devstack sudo[100555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:26:32 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-5950b297-c907-4828-894d-977fe27738d6 tempest-GroupSnapshotsTest-1771286532 None] group_snapshot a8990c66-6a48-4119-a918-a5c5117fe1bc: deleting Jun 29 03:26:32 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-5950b297-c907-4828-894d-977fe27738d6 tempest-GroupSnapshotsTest-1771286532 None] group_snapshot a8990c66-6a48-4119-a918-a5c5117fe1bc: deleting {{(pid=93468) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jun 29 03:26:32 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-5950b297-c907-4828-894d-977fe27738d6 tempest-GroupSnapshotsTest-1771286532 None] Acquiring lock "cinder-quobyte-58a0ab99-bb2e-4388-8115-29a477a313f9" by "delete_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:26:32 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-5950b297-c907-4828-894d-977fe27738d6 tempest-GroupSnapshotsTest-1771286532 None] Lock "cinder-quobyte-58a0ab99-bb2e-4388-8115-29a477a313f9" acquired by "delete_snapshot" :: waited 0.047s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:26:32 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-5950b297-c907-4828-894d-977fe27738d6 tempest-GroupSnapshotsTest-1771286532 None] Acquiring lock "cinder-quobyte-dd3e0717-eb39-48b0-bd45-76edd267c4af" by "_delete_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:26:32 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-5950b297-c907-4828-894d-977fe27738d6 tempest-GroupSnapshotsTest-1771286532 None] Lock "cinder-quobyte-dd3e0717-eb39-48b0-bd45-76edd267c4af" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:26:32 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-5950b297-c907-4828-894d-977fe27738d6 tempest-GroupSnapshotsTest-1771286532 None] Deleting offline snapshot dd3e0717-eb39-48b0-bd45-76edd267c4af of volume 58a0ab99-bb2e-4388-8115-29a477a313f9 {{(pid=93468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 29 03:26:32 devstack sudo[100552]: pam_unix(sudo:session): session closed for user root Jun 29 03:26:32 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-5950b297-c907-4828-894d-977fe27738d6 tempest-GroupSnapshotsTest-1771286532 None] snapshot_file for this snap is: volume-58a0ab99-bb2e-4388-8115-29a477a313f9.dd3e0717-eb39-48b0-bd45-76edd267c4af {{(pid=93468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 29 03:26:32 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-87fcdf8d-0c08-4bb7-8671-e6f73fae52cc tempest-VolumeSnapshotQuotasNegativeTestJSON-908931209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9b62871f-b6ab-4985-a28a-7512d08eefac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9b62871f-b6ab-4985-a28a-7512d08eefac.3a5203b9-1dc8-4bbd-afc6-c46582c78820 1G" returned: 0 in 1.405s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:26:32 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-87fcdf8d-0c08-4bb7-8671-e6f73fae52cc tempest-VolumeSnapshotQuotasNegativeTestJSON-908931209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9b62871f-b6ab-4985-a28a-7512d08eefac -F qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9b62871f-b6ab-4985-a28a-7512d08eefac.3a5203b9-1dc8-4bbd-afc6-c46582c78820 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:26:32 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[88fb33f4-43f1-4522-8411-953909cc3b93]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:26:32 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-5950b297-c907-4828-894d-977fe27738d6 tempest-GroupSnapshotsTest-1771286532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-58a0ab99-bb2e-4388-8115-29a477a313f9.dd3e0717-eb39-48b0-bd45-76edd267c4af {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:26:32 devstack sudo[100561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9b62871f-b6ab-4985-a28a-7512d08eefac -F qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9b62871f-b6ab-4985-a28a-7512d08eefac.3a5203b9-1dc8-4bbd-afc6-c46582c78820 Jun 29 03:26:32 devstack sudo[100561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:26:33 devstack sudo[100562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-58a0ab99-bb2e-4388-8115-29a477a313f9.dd3e0717-eb39-48b0-bd45-76edd267c4af Jun 29 03:26:33 devstack sudo[100562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:26:33 devstack sudo[100555]: pam_unix(sudo:session): session closed for user root Jun 29 03:26:33 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d8dd2bd1-5dc1-4164-9285-5c0159f5c76c tempest-GroupSnapshotsTest-1771286532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf" returned: 0 in 1.404s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:26:33 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-d8dd2bd1-5dc1-4164-9285-5c0159f5c76c tempest-GroupSnapshotsTest-1771286532 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:26:33 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-d8dd2bd1-5dc1-4164-9285-5c0159f5c76c tempest-GroupSnapshotsTest-1771286532 None] Delete group completed successfully. Jun 29 03:26:34 devstack sudo[100561]: pam_unix(sudo:session): session closed for user root Jun 29 03:26:34 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-87fcdf8d-0c08-4bb7-8671-e6f73fae52cc tempest-VolumeSnapshotQuotasNegativeTestJSON-908931209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9b62871f-b6ab-4985-a28a-7512d08eefac -F qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9b62871f-b6ab-4985-a28a-7512d08eefac.3a5203b9-1dc8-4bbd-afc6-c46582c78820" returned: 0 in 1.180s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:26:34 devstack cinder-volume[93468]: WARNING cinder.volume.drivers.remotefs [None req-87fcdf8d-0c08-4bb7-8671-e6f73fae52cc tempest-VolumeSnapshotQuotasNegativeTestJSON-908931209 None] /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9b62871f-b6ab-4985-a28a-7512d08eefac.3a5203b9-1dc8-4bbd-afc6-c46582c78820 is being set with open permissions: ugo+rw Jun 29 03:26:34 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-87fcdf8d-0c08-4bb7-8671-e6f73fae52cc tempest-VolumeSnapshotQuotasNegativeTestJSON-908931209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9b62871f-b6ab-4985-a28a-7512d08eefac.3a5203b9-1dc8-4bbd-afc6-c46582c78820 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:26:34 devstack sudo[100577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9b62871f-b6ab-4985-a28a-7512d08eefac.3a5203b9-1dc8-4bbd-afc6-c46582c78820 Jun 29 03:26:34 devstack sudo[100577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:26:34 devstack sudo[100562]: pam_unix(sudo:session): session closed for user root Jun 29 03:26:34 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-5950b297-c907-4828-894d-977fe27738d6 tempest-GroupSnapshotsTest-1771286532 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-58a0ab99-bb2e-4388-8115-29a477a313f9.dd3e0717-eb39-48b0-bd45-76edd267c4af" returned: 0 in 1.198s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:26:34 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-5950b297-c907-4828-894d-977fe27738d6 tempest-GroupSnapshotsTest-1771286532 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-58a0ab99-bb2e-4388-8115-29a477a313f9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93468) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 29 03:26:34 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3574806-da85-4407-934f-f388c6929059]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:26:34 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-5950b297-c907-4828-894d-977fe27738d6 tempest-GroupSnapshotsTest-1771286532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-58a0ab99-bb2e-4388-8115-29a477a313f9 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:26:34 devstack sudo[100589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-58a0ab99-bb2e-4388-8115-29a477a313f9 Jun 29 03:26:34 devstack sudo[100589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:26:34 devstack sudo[100577]: pam_unix(sudo:session): session closed for user root Jun 29 03:26:34 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-87fcdf8d-0c08-4bb7-8671-e6f73fae52cc tempest-VolumeSnapshotQuotasNegativeTestJSON-908931209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9b62871f-b6ab-4985-a28a-7512d08eefac.3a5203b9-1dc8-4bbd-afc6-c46582c78820" returned: 0 in 0.786s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:26:34 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-87fcdf8d-0c08-4bb7-8671-e6f73fae52cc tempest-VolumeSnapshotQuotasNegativeTestJSON-908931209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9b62871f-b6ab-4985-a28a-7512d08eefac.info {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:26:34 devstack sudo[100596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9b62871f-b6ab-4985-a28a-7512d08eefac.info Jun 29 03:26:34 devstack sudo[100596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:26:35 devstack sudo[100589]: pam_unix(sudo:session): session closed for user root Jun 29 03:26:35 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-5950b297-c907-4828-894d-977fe27738d6 tempest-GroupSnapshotsTest-1771286532 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-58a0ab99-bb2e-4388-8115-29a477a313f9" returned: 0 in 0.975s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:26:35 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-5950b297-c907-4828-894d-977fe27738d6 tempest-GroupSnapshotsTest-1771286532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-58a0ab99-bb2e-4388-8115-29a477a313f9.dd3e0717-eb39-48b0-bd45-76edd267c4af {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:26:35 devstack sudo[100601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-58a0ab99-bb2e-4388-8115-29a477a313f9.dd3e0717-eb39-48b0-bd45-76edd267c4af Jun 29 03:26:35 devstack sudo[100601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:26:35 devstack sudo[100596]: pam_unix(sudo:session): session closed for user root Jun 29 03:26:35 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-87fcdf8d-0c08-4bb7-8671-e6f73fae52cc tempest-VolumeSnapshotQuotasNegativeTestJSON-908931209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9b62871f-b6ab-4985-a28a-7512d08eefac.info" returned: 0 in 0.709s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:26:35 devstack cinder-volume[93468]: WARNING cinder.volume.drivers.remotefs [None req-87fcdf8d-0c08-4bb7-8671-e6f73fae52cc tempest-VolumeSnapshotQuotasNegativeTestJSON-908931209 None] /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9b62871f-b6ab-4985-a28a-7512d08eefac.info is being set with open permissions: ugo+rw Jun 29 03:26:35 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-87fcdf8d-0c08-4bb7-8671-e6f73fae52cc tempest-VolumeSnapshotQuotasNegativeTestJSON-908931209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9b62871f-b6ab-4985-a28a-7512d08eefac.info {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:26:35 devstack sudo[100604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9b62871f-b6ab-4985-a28a-7512d08eefac.info Jun 29 03:26:35 devstack sudo[100604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:26:35 devstack sudo[100601]: pam_unix(sudo:session): session closed for user root Jun 29 03:26:35 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-5950b297-c907-4828-894d-977fe27738d6 tempest-GroupSnapshotsTest-1771286532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-58a0ab99-bb2e-4388-8115-29a477a313f9.dd3e0717-eb39-48b0-bd45-76edd267c4af" returned: 0 in 0.838s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:26:35 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-5950b297-c907-4828-894d-977fe27738d6 tempest-GroupSnapshotsTest-1771286532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-58a0ab99-bb2e-4388-8115-29a477a313f9.dd3e0717-eb39-48b0-bd45-76edd267c4af {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:26:36 devstack sudo[100609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-58a0ab99-bb2e-4388-8115-29a477a313f9.dd3e0717-eb39-48b0-bd45-76edd267c4af Jun 29 03:26:36 devstack sudo[100609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:26:36 devstack sudo[100604]: pam_unix(sudo:session): session closed for user root Jun 29 03:26:36 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-87fcdf8d-0c08-4bb7-8671-e6f73fae52cc tempest-VolumeSnapshotQuotasNegativeTestJSON-908931209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9b62871f-b6ab-4985-a28a-7512d08eefac.info" returned: 0 in 0.733s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:26:36 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-87fcdf8d-0c08-4bb7-8671-e6f73fae52cc tempest-VolumeSnapshotQuotasNegativeTestJSON-908931209 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.956s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:26:36 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-87fcdf8d-0c08-4bb7-8671-e6f73fae52cc tempest-VolumeSnapshotQuotasNegativeTestJSON-908931209 None] Create snapshot completed successfully Jun 29 03:26:36 devstack sudo[100609]: pam_unix(sudo:session): session closed for user root Jun 29 03:26:36 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-5950b297-c907-4828-894d-977fe27738d6 tempest-GroupSnapshotsTest-1771286532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-58a0ab99-bb2e-4388-8115-29a477a313f9.dd3e0717-eb39-48b0-bd45-76edd267c4af" returned: 0 in 0.671s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:26:36 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-5950b297-c907-4828-894d-977fe27738d6 tempest-GroupSnapshotsTest-1771286532 None] Lock "cinder-quobyte-dd3e0717-eb39-48b0-bd45-76edd267c4af" released by "_delete_snapshot" :: held 3.816s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:26:36 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-5950b297-c907-4828-894d-977fe27738d6 tempest-GroupSnapshotsTest-1771286532 None] Lock "cinder-quobyte-58a0ab99-bb2e-4388-8115-29a477a313f9" released by "delete_snapshot" :: held 3.858s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:26:36 devstack cinder-volume[93468]: WARNING cinder.quota [None req-5950b297-c907-4828-894d-977fe27738d6 tempest-GroupSnapshotsTest-1771286532 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-343397741 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-343397741, it is now deprecated. Please use the default quota class for default quota. Jun 29 03:26:36 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-5950b297-c907-4828-894d-977fe27738d6 tempest-GroupSnapshotsTest-1771286532 None] Created reservations ['dd380c84-594f-477a-b2c1-9d993199195f', '9448c8a4-1c18-48ba-a5fc-048a1b54df8e', '53a875d8-082b-44b6-9df8-1b8810180cc9', '6598122a-f157-49a8-a62f-17fd86cd0f97'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:26:36 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-5950b297-c907-4828-894d-977fe27738d6 tempest-GroupSnapshotsTest-1771286532 None] group_snapshot a8990c66-6a48-4119-a918-a5c5117fe1bc: deleted successfully Jun 29 03:26:37 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-d0ae3835-93ea-40c7-a770-ae8263cad600 tempest-VolumeSnapshotQuotasNegativeTestJSON-908931209 None] Acquiring lock "cinder-3a5203b9-1dc8-4bbd-afc6-c46582c78820-delete_snapshot" by "delete_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:26:37 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-d0ae3835-93ea-40c7-a770-ae8263cad600 tempest-VolumeSnapshotQuotasNegativeTestJSON-908931209 None] Lock "cinder-3a5203b9-1dc8-4bbd-afc6-c46582c78820-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:26:37 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-d0ae3835-93ea-40c7-a770-ae8263cad600 tempest-VolumeSnapshotQuotasNegativeTestJSON-908931209 None] Acquiring lock "cinder-quobyte-9b62871f-b6ab-4985-a28a-7512d08eefac" by "delete_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:26:37 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-d0ae3835-93ea-40c7-a770-ae8263cad600 tempest-VolumeSnapshotQuotasNegativeTestJSON-908931209 None] Lock "cinder-quobyte-9b62871f-b6ab-4985-a28a-7512d08eefac" acquired by "delete_snapshot" :: waited 0.025s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:26:37 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-d0ae3835-93ea-40c7-a770-ae8263cad600 tempest-VolumeSnapshotQuotasNegativeTestJSON-908931209 None] Acquiring lock "cinder-quobyte-3a5203b9-1dc8-4bbd-afc6-c46582c78820" by "_delete_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:26:37 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-d0ae3835-93ea-40c7-a770-ae8263cad600 tempest-VolumeSnapshotQuotasNegativeTestJSON-908931209 None] Lock "cinder-quobyte-3a5203b9-1dc8-4bbd-afc6-c46582c78820" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:26:37 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-d0ae3835-93ea-40c7-a770-ae8263cad600 tempest-VolumeSnapshotQuotasNegativeTestJSON-908931209 None] Deleting offline snapshot 3a5203b9-1dc8-4bbd-afc6-c46582c78820 of volume 9b62871f-b6ab-4985-a28a-7512d08eefac {{(pid=93468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 29 03:26:37 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-d0ae3835-93ea-40c7-a770-ae8263cad600 tempest-VolumeSnapshotQuotasNegativeTestJSON-908931209 None] snapshot_file for this snap is: volume-9b62871f-b6ab-4985-a28a-7512d08eefac.3a5203b9-1dc8-4bbd-afc6-c46582c78820 {{(pid=93468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 29 03:26:37 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c303844-2d84-4923-ad4e-a076f8c1acd7]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:26:37 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d0ae3835-93ea-40c7-a770-ae8263cad600 tempest-VolumeSnapshotQuotasNegativeTestJSON-908931209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9b62871f-b6ab-4985-a28a-7512d08eefac.3a5203b9-1dc8-4bbd-afc6-c46582c78820 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:26:37 devstack sudo[100649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9b62871f-b6ab-4985-a28a-7512d08eefac.3a5203b9-1dc8-4bbd-afc6-c46582c78820 Jun 29 03:26:37 devstack sudo[100649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:26:37 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-b2584831-dce5-4f2c-be5f-ab27fdd54c40 tempest-GroupSnapshotsTest-1771286532 None] Acquiring lock "cinder-quobyte-58a0ab99-bb2e-4388-8115-29a477a313f9" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:26:37 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-b2584831-dce5-4f2c-be5f-ab27fdd54c40 tempest-GroupSnapshotsTest-1771286532 None] Lock "cinder-quobyte-58a0ab99-bb2e-4388-8115-29a477a313f9" acquired by "delete_volume" :: waited 0.037s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:26:37 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7e34374-e19e-402f-8946-eed70058e55d]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:26:37 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b2584831-dce5-4f2c-be5f-ab27fdd54c40 tempest-GroupSnapshotsTest-1771286532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-58a0ab99-bb2e-4388-8115-29a477a313f9 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:26:37 devstack sudo[100651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-58a0ab99-bb2e-4388-8115-29a477a313f9 Jun 29 03:26:37 devstack sudo[100651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:26:38 devstack sudo[100649]: pam_unix(sudo:session): session closed for user root Jun 29 03:26:38 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d0ae3835-93ea-40c7-a770-ae8263cad600 tempest-VolumeSnapshotQuotasNegativeTestJSON-908931209 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9b62871f-b6ab-4985-a28a-7512d08eefac.3a5203b9-1dc8-4bbd-afc6-c46582c78820" returned: 0 in 0.957s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:26:38 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-d0ae3835-93ea-40c7-a770-ae8263cad600 tempest-VolumeSnapshotQuotasNegativeTestJSON-908931209 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9b62871f-b6ab-4985-a28a-7512d08eefac(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93468) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 29 03:26:38 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[27d4a641-9002-48e8-9c7c-178ba25666f6]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:26:38 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d0ae3835-93ea-40c7-a770-ae8263cad600 tempest-VolumeSnapshotQuotasNegativeTestJSON-908931209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9b62871f-b6ab-4985-a28a-7512d08eefac {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:26:38 devstack sudo[100656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9b62871f-b6ab-4985-a28a-7512d08eefac Jun 29 03:26:38 devstack sudo[100656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:26:38 devstack sudo[100651]: pam_unix(sudo:session): session closed for user root Jun 29 03:26:38 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b2584831-dce5-4f2c-be5f-ab27fdd54c40 tempest-GroupSnapshotsTest-1771286532 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-58a0ab99-bb2e-4388-8115-29a477a313f9" returned: 0 in 0.881s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:26:38 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b2584831-dce5-4f2c-be5f-ab27fdd54c40 tempest-GroupSnapshotsTest-1771286532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-58a0ab99-bb2e-4388-8115-29a477a313f9 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:26:38 devstack sudo[100661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-58a0ab99-bb2e-4388-8115-29a477a313f9 Jun 29 03:26:38 devstack sudo[100661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:26:39 devstack sudo[100656]: pam_unix(sudo:session): session closed for user root Jun 29 03:26:39 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d0ae3835-93ea-40c7-a770-ae8263cad600 tempest-VolumeSnapshotQuotasNegativeTestJSON-908931209 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9b62871f-b6ab-4985-a28a-7512d08eefac" returned: 0 in 0.910s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:26:39 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d0ae3835-93ea-40c7-a770-ae8263cad600 tempest-VolumeSnapshotQuotasNegativeTestJSON-908931209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9b62871f-b6ab-4985-a28a-7512d08eefac.3a5203b9-1dc8-4bbd-afc6-c46582c78820 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:26:39 devstack sudo[100668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9b62871f-b6ab-4985-a28a-7512d08eefac.3a5203b9-1dc8-4bbd-afc6-c46582c78820 Jun 29 03:26:39 devstack sudo[100668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:26:39 devstack sudo[100661]: pam_unix(sudo:session): session closed for user root Jun 29 03:26:39 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b2584831-dce5-4f2c-be5f-ab27fdd54c40 tempest-GroupSnapshotsTest-1771286532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-58a0ab99-bb2e-4388-8115-29a477a313f9" returned: 0 in 0.778s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:26:39 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-b2584831-dce5-4f2c-be5f-ab27fdd54c40 tempest-GroupSnapshotsTest-1771286532 None] Lock "cinder-quobyte-58a0ab99-bb2e-4388-8115-29a477a313f9" released by "delete_volume" :: held 1.760s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:26:39 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-b2584831-dce5-4f2c-be5f-ab27fdd54c40 tempest-GroupSnapshotsTest-1771286532 None] Created reservations ['97c167b4-f35b-4590-8903-d035ea42052a'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:26:39 devstack cinder-volume[93468]: WARNING cinder.db.api [None req-b2584831-dce5-4f2c-be5f-ab27fdd54c40 tempest-GroupSnapshotsTest-1771286532 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-343397741'] Jun 29 03:26:39 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-b2584831-dce5-4f2c-be5f-ab27fdd54c40 tempest-GroupSnapshotsTest-1771286532 None] Created reservations ['eb7a324c-39c9-4b15-ab6b-b08e4307498b', '59676ba8-ee18-45a5-8676-824cbcb0cf5c', '6c28820e-2e54-4a6d-9e40-1984f6e6fcc1', 'a2c7446a-02ba-47bf-a7d3-6ffda73bfaf0'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:26:39 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-b2584831-dce5-4f2c-be5f-ab27fdd54c40 tempest-GroupSnapshotsTest-1771286532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:26:39 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-b2584831-dce5-4f2c-be5f-ab27fdd54c40 tempest-GroupSnapshotsTest-1771286532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:26:39 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-b2584831-dce5-4f2c-be5f-ab27fdd54c40 tempest-GroupSnapshotsTest-1771286532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:26:39 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-b2584831-dce5-4f2c-be5f-ab27fdd54c40 tempest-GroupSnapshotsTest-1771286532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:26:39 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-b2584831-dce5-4f2c-be5f-ab27fdd54c40 tempest-GroupSnapshotsTest-1771286532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:26:39 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b2584831-dce5-4f2c-be5f-ab27fdd54c40 tempest-GroupSnapshotsTest-1771286532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:26:39 devstack sudo[100671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf Jun 29 03:26:39 devstack sudo[100671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:26:40 devstack sudo[100668]: pam_unix(sudo:session): session closed for user root Jun 29 03:26:40 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d0ae3835-93ea-40c7-a770-ae8263cad600 tempest-VolumeSnapshotQuotasNegativeTestJSON-908931209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9b62871f-b6ab-4985-a28a-7512d08eefac.3a5203b9-1dc8-4bbd-afc6-c46582c78820" returned: 0 in 1.039s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:26:40 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d0ae3835-93ea-40c7-a770-ae8263cad600 tempest-VolumeSnapshotQuotasNegativeTestJSON-908931209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9b62871f-b6ab-4985-a28a-7512d08eefac.3a5203b9-1dc8-4bbd-afc6-c46582c78820 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:26:40 devstack sudo[100677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9b62871f-b6ab-4985-a28a-7512d08eefac.3a5203b9-1dc8-4bbd-afc6-c46582c78820 Jun 29 03:26:40 devstack sudo[100677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:26:40 devstack sudo[100671]: pam_unix(sudo:session): session closed for user root Jun 29 03:26:40 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b2584831-dce5-4f2c-be5f-ab27fdd54c40 tempest-GroupSnapshotsTest-1771286532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf" returned: 0 in 0.984s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:26:40 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-b2584831-dce5-4f2c-be5f-ab27fdd54c40 tempest-GroupSnapshotsTest-1771286532 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:26:40 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-b2584831-dce5-4f2c-be5f-ab27fdd54c40 tempest-GroupSnapshotsTest-1771286532 None] Delete group completed successfully. Jun 29 03:26:41 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-6de88a68-93a5-445b-9b92-87d7c84449d2 tempest-GroupSnapshotsTest-1771286532 None] Group tempest-GroupSnapshotsTest-Group-418515827: creating Jun 29 03:26:41 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-6de88a68-93a5-445b-9b92-87d7c84449d2 tempest-GroupSnapshotsTest-1771286532 None] Group tempest-GroupSnapshotsTest-Group-418515827: created successfully Jun 29 03:26:41 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-6de88a68-93a5-445b-9b92-87d7c84449d2 tempest-GroupSnapshotsTest-1771286532 None] Create group completed successfully. Jun 29 03:26:41 devstack sudo[100677]: pam_unix(sudo:session): session closed for user root Jun 29 03:26:41 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d0ae3835-93ea-40c7-a770-ae8263cad600 tempest-VolumeSnapshotQuotasNegativeTestJSON-908931209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9b62871f-b6ab-4985-a28a-7512d08eefac.3a5203b9-1dc8-4bbd-afc6-c46582c78820" returned: 0 in 0.976s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:26:41 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-d0ae3835-93ea-40c7-a770-ae8263cad600 tempest-VolumeSnapshotQuotasNegativeTestJSON-908931209 None] Lock "cinder-quobyte-3a5203b9-1dc8-4bbd-afc6-c46582c78820" released by "_delete_snapshot" :: held 4.014s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:26:41 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-d0ae3835-93ea-40c7-a770-ae8263cad600 tempest-VolumeSnapshotQuotasNegativeTestJSON-908931209 None] Lock "cinder-quobyte-9b62871f-b6ab-4985-a28a-7512d08eefac" released by "delete_snapshot" :: held 4.044s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:26:41 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-d0ae3835-93ea-40c7-a770-ae8263cad600 tempest-VolumeSnapshotQuotasNegativeTestJSON-908931209 None] Created reservations ['cb87119f-5d6e-43b8-8697-9602c8b22144', '165c129c-67d7-470e-9238-460182e9684a', 'a0a184c4-7c33-4b85-8197-3646bd2f094d', 'ffa3f5a7-ba66-47eb-ab75-3e2314d47bb8'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:26:41 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-d0ae3835-93ea-40c7-a770-ae8263cad600 tempest-VolumeSnapshotQuotasNegativeTestJSON-908931209 None] Delete snapshot completed successfully. Jun 29 03:26:41 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-d0ae3835-93ea-40c7-a770-ae8263cad600 tempest-VolumeSnapshotQuotasNegativeTestJSON-908931209 None] Lock "cinder-3a5203b9-1dc8-4bbd-afc6-c46582c78820-delete_snapshot" released by "delete_snapshot" :: held 4.221s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:26:41 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-0d95fd43-0f9e-4da8-8bef-e60eb07fd285 tempest-VolumeSnapshotQuotasNegativeTestJSON-908931209 None] Acquiring lock "cinder-9b62871f-b6ab-4985-a28a-7512d08eefac-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:26:41 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-0d95fd43-0f9e-4da8-8bef-e60eb07fd285 tempest-VolumeSnapshotQuotasNegativeTestJSON-908931209 None] Lock "cinder-9b62871f-b6ab-4985-a28a-7512d08eefac-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:26:41 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-0d95fd43-0f9e-4da8-8bef-e60eb07fd285 tempest-VolumeSnapshotQuotasNegativeTestJSON-908931209 None] Acquiring lock "cinder-quobyte-9b62871f-b6ab-4985-a28a-7512d08eefac" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:26:41 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-0d95fd43-0f9e-4da8-8bef-e60eb07fd285 tempest-VolumeSnapshotQuotasNegativeTestJSON-908931209 None] Lock "cinder-quobyte-9b62871f-b6ab-4985-a28a-7512d08eefac" acquired by "delete_volume" :: waited 0.017s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:26:41 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[f62947c1-4591-4fda-9ddf-46458787b9b3]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:26:41 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-0d95fd43-0f9e-4da8-8bef-e60eb07fd285 tempest-VolumeSnapshotQuotasNegativeTestJSON-908931209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9b62871f-b6ab-4985-a28a-7512d08eefac {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:26:42 devstack sudo[100682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9b62871f-b6ab-4985-a28a-7512d08eefac Jun 29 03:26:42 devstack sudo[100682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:26:42 devstack sudo[100682]: pam_unix(sudo:session): session closed for user root Jun 29 03:26:42 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-0d95fd43-0f9e-4da8-8bef-e60eb07fd285 tempest-VolumeSnapshotQuotasNegativeTestJSON-908931209 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9b62871f-b6ab-4985-a28a-7512d08eefac" returned: 0 in 1.029s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:26:42 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-0d95fd43-0f9e-4da8-8bef-e60eb07fd285 tempest-VolumeSnapshotQuotasNegativeTestJSON-908931209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9b62871f-b6ab-4985-a28a-7512d08eefac {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:26:43 devstack sudo[100687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9b62871f-b6ab-4985-a28a-7512d08eefac Jun 29 03:26:43 devstack sudo[100687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:26:43 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-e95bbee1-22a8-4773-8659-16a4d78edd14 tempest-GroupSnapshotsTest-1771286532 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:26:43 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-e95bbee1-22a8-4773-8659-16a4d78edd14 tempest-GroupSnapshotsTest-1771286532 None] Flow 'volume_create_manager' (6493b5c2-3de0-42ee-9e96-da0930f336d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:26:43 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-e95bbee1-22a8-4773-8659-16a4d78edd14 tempest-GroupSnapshotsTest-1771286532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38dec59c-7187-43c8-a5c3-83bbb6d0257e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:26:43 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-e95bbee1-22a8-4773-8659-16a4d78edd14 tempest-GroupSnapshotsTest-1771286532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38dec59c-7187-43c8-a5c3-83bbb6d0257e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:26:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1180904547',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=55c06279-54b4-49cf-ad9b-46b516a4c99e,host='devstack@QuobyteHD#QuobyteHD',id=927e590e-ff80-4342-be46-8d91284ec972,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c152379270c34f8cbfcc68d9bff1896d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:26:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:26:43Z,use_quota=True,user_id='07b5122bd8a84b24bfe42d705a4f0cd2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd1098d3-6fdf-4a2c-b121-a1d49d039d77),volume_type_id=bd1098d3-6fdf-4a2c-b121-a1d49d039d77)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:26:43 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-e95bbee1-22a8-4773-8659-16a4d78edd14 tempest-GroupSnapshotsTest-1771286532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4dda0b7a-6f99-4566-8f73-215300224838) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:26:43 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-e95bbee1-22a8-4773-8659-16a4d78edd14 tempest-GroupSnapshotsTest-1771286532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4dda0b7a-6f99-4566-8f73-215300224838) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:26:43 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-e95bbee1-22a8-4773-8659-16a4d78edd14 tempest-GroupSnapshotsTest-1771286532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b74dbf9e-592d-465b-9799-284cba6fb0a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:26:43 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-e95bbee1-22a8-4773-8659-16a4d78edd14 tempest-GroupSnapshotsTest-1771286532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b74dbf9e-592d-465b-9799-284cba6fb0a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '927e590e-ff80-4342-be46-8d91284ec972', 'volume_name': 'volume-927e590e-ff80-4342-be46-8d91284ec972', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:26:43 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-e95bbee1-22a8-4773-8659-16a4d78edd14 tempest-GroupSnapshotsTest-1771286532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (587afdf9-acc4-4603-9956-a0aea5a6b6b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:26:43 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-e95bbee1-22a8-4773-8659-16a4d78edd14 tempest-GroupSnapshotsTest-1771286532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (587afdf9-acc4-4603-9956-a0aea5a6b6b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:26:43 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-e95bbee1-22a8-4773-8659-16a4d78edd14 tempest-GroupSnapshotsTest-1771286532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4dbcaca8-7ae7-41ac-91b6-34a35aee11f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:26:43 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-e95bbee1-22a8-4773-8659-16a4d78edd14 tempest-GroupSnapshotsTest-1771286532 None] Volume 927e590e-ff80-4342-be46-8d91284ec972: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-927e590e-ff80-4342-be46-8d91284ec972', 'volume_size': 1} Jun 29 03:26:43 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-e95bbee1-22a8-4773-8659-16a4d78edd14 tempest-GroupSnapshotsTest-1771286532 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:26:43 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-e95bbee1-22a8-4773-8659-16a4d78edd14 tempest-GroupSnapshotsTest-1771286532 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:26:43 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-e95bbee1-22a8-4773-8659-16a4d78edd14 tempest-GroupSnapshotsTest-1771286532 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=55c06279-54b4-49cf-ad9b-46b516a4c99e,created_at=2026-06-29T01:26:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1180904547',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=55c06279-54b4-49cf-ad9b-46b516a4c99e,host='devstack@QuobyteHD#QuobyteHD',id=927e590e-ff80-4342-be46-8d91284ec972,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c152379270c34f8cbfcc68d9bff1896d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:26:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:26:43Z,use_quota=True,user_id='07b5122bd8a84b24bfe42d705a4f0cd2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd1098d3-6fdf-4a2c-b121-a1d49d039d77),volume_type_id=bd1098d3-6fdf-4a2c-b121-a1d49d039d77)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:26:43 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-e95bbee1-22a8-4773-8659-16a4d78edd14 tempest-GroupSnapshotsTest-1771286532 None] Creating volume 927e590e-ff80-4342-be46-8d91284ec972 {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:26:43 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-e95bbee1-22a8-4773-8659-16a4d78edd14 tempest-GroupSnapshotsTest-1771286532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:26:43 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-e95bbee1-22a8-4773-8659-16a4d78edd14 tempest-GroupSnapshotsTest-1771286532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:26:43 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-e95bbee1-22a8-4773-8659-16a4d78edd14 tempest-GroupSnapshotsTest-1771286532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:26:43 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-e95bbee1-22a8-4773-8659-16a4d78edd14 tempest-GroupSnapshotsTest-1771286532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:26:43 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-e95bbee1-22a8-4773-8659-16a4d78edd14 tempest-GroupSnapshotsTest-1771286532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:26:43 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-e95bbee1-22a8-4773-8659-16a4d78edd14 tempest-GroupSnapshotsTest-1771286532 None] Selected osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:26:43 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-e95bbee1-22a8-4773-8659-16a4d78edd14 tempest-GroupSnapshotsTest-1771286532 None] casted to osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f Jun 29 03:26:43 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-e95bbee1-22a8-4773-8659-16a4d78edd14 tempest-GroupSnapshotsTest-1771286532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-927e590e-ff80-4342-be46-8d91284ec972 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:26:43 devstack sudo[100689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-927e590e-ff80-4342-be46-8d91284ec972 1073741824 Jun 29 03:26:43 devstack sudo[100689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:26:43 devstack sudo[100687]: pam_unix(sudo:session): session closed for user root Jun 29 03:26:43 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-0d95fd43-0f9e-4da8-8bef-e60eb07fd285 tempest-VolumeSnapshotQuotasNegativeTestJSON-908931209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9b62871f-b6ab-4985-a28a-7512d08eefac" returned: 0 in 0.717s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:26:43 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-0d95fd43-0f9e-4da8-8bef-e60eb07fd285 tempest-VolumeSnapshotQuotasNegativeTestJSON-908931209 None] Lock "cinder-quobyte-9b62871f-b6ab-4985-a28a-7512d08eefac" released by "delete_volume" :: held 1.829s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:26:43 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-0d95fd43-0f9e-4da8-8bef-e60eb07fd285 tempest-VolumeSnapshotQuotasNegativeTestJSON-908931209 None] Created reservations ['3a92444a-2750-4577-b880-9eb2fbf05ff9', 'f915ff6c-cbd0-4c4f-864c-203f7ad269f2', '03aa5cdb-7562-4063-b8ba-2d27e7e9cb49', 'f7fc8c00-6d44-48b1-9fd6-a60b20bbbb6b'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:26:43 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-0d95fd43-0f9e-4da8-8bef-e60eb07fd285 tempest-VolumeSnapshotQuotasNegativeTestJSON-908931209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:26:43 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-0d95fd43-0f9e-4da8-8bef-e60eb07fd285 tempest-VolumeSnapshotQuotasNegativeTestJSON-908931209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:26:43 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-0d95fd43-0f9e-4da8-8bef-e60eb07fd285 tempest-VolumeSnapshotQuotasNegativeTestJSON-908931209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:26:43 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-0d95fd43-0f9e-4da8-8bef-e60eb07fd285 tempest-VolumeSnapshotQuotasNegativeTestJSON-908931209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:26:43 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-0d95fd43-0f9e-4da8-8bef-e60eb07fd285 tempest-VolumeSnapshotQuotasNegativeTestJSON-908931209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:26:43 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-0d95fd43-0f9e-4da8-8bef-e60eb07fd285 tempest-VolumeSnapshotQuotasNegativeTestJSON-908931209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:26:43 devstack sudo[100696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf Jun 29 03:26:43 devstack sudo[100696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:26:44 devstack sudo[100689]: pam_unix(sudo:session): session closed for user root Jun 29 03:26:44 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-e95bbee1-22a8-4773-8659-16a4d78edd14 tempest-GroupSnapshotsTest-1771286532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-927e590e-ff80-4342-be46-8d91284ec972 1073741824" returned: 0 in 0.932s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:26:44 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-e95bbee1-22a8-4773-8659-16a4d78edd14 tempest-GroupSnapshotsTest-1771286532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-927e590e-ff80-4342-be46-8d91284ec972 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:26:44 devstack sudo[100701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-927e590e-ff80-4342-be46-8d91284ec972 Jun 29 03:26:44 devstack sudo[100701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:26:44 devstack sudo[100696]: pam_unix(sudo:session): session closed for user root Jun 29 03:26:44 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-0d95fd43-0f9e-4da8-8bef-e60eb07fd285 tempest-VolumeSnapshotQuotasNegativeTestJSON-908931209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf" returned: 0 in 0.921s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:26:44 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-0d95fd43-0f9e-4da8-8bef-e60eb07fd285 tempest-VolumeSnapshotQuotasNegativeTestJSON-908931209 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:26:44 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-0d95fd43-0f9e-4da8-8bef-e60eb07fd285 tempest-VolumeSnapshotQuotasNegativeTestJSON-908931209 None] Deleted volume successfully. Jun 29 03:26:44 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-0d95fd43-0f9e-4da8-8bef-e60eb07fd285 tempest-VolumeSnapshotQuotasNegativeTestJSON-908931209 None] Lock "cinder-9b62871f-b6ab-4985-a28a-7512d08eefac-delete_volume" released by "delete_volume" :: held 3.033s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:26:44 devstack sudo[100701]: pam_unix(sudo:session): session closed for user root Jun 29 03:26:44 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-e95bbee1-22a8-4773-8659-16a4d78edd14 tempest-GroupSnapshotsTest-1771286532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-927e590e-ff80-4342-be46-8d91284ec972" returned: 0 in 0.785s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:26:44 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-e95bbee1-22a8-4773-8659-16a4d78edd14 tempest-GroupSnapshotsTest-1771286532 None] <== create_volume: return (1770ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:26:44 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-e95bbee1-22a8-4773-8659-16a4d78edd14 tempest-GroupSnapshotsTest-1771286532 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.772s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:26:44 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-e95bbee1-22a8-4773-8659-16a4d78edd14 tempest-GroupSnapshotsTest-1771286532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4dbcaca8-7ae7-41ac-91b6-34a35aee11f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-927e590e-ff80-4342-be46-8d91284ec972', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:26:44 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-e95bbee1-22a8-4773-8659-16a4d78edd14 tempest-GroupSnapshotsTest-1771286532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (367e8268-7028-49be-a9bd-94989176bb9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:26:44 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-e95bbee1-22a8-4773-8659-16a4d78edd14 tempest-GroupSnapshotsTest-1771286532 None] Volume volume-927e590e-ff80-4342-be46-8d91284ec972 (927e590e-ff80-4342-be46-8d91284ec972): created successfully Jun 29 03:26:44 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-e95bbee1-22a8-4773-8659-16a4d78edd14 tempest-GroupSnapshotsTest-1771286532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (367e8268-7028-49be-a9bd-94989176bb9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:26:44 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-e95bbee1-22a8-4773-8659-16a4d78edd14 tempest-GroupSnapshotsTest-1771286532 None] Flow 'volume_create_manager' (6493b5c2-3de0-42ee-9e96-da0930f336d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:26:44 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-e95bbee1-22a8-4773-8659-16a4d78edd14 tempest-GroupSnapshotsTest-1771286532 None] Created volume successfully. Jun 29 03:26:46 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-27ecdee3-db24-40b0-b45e-74fa9fc8e8b5 tempest-GroupSnapshotsTest-1771286532 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:26:46 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-27ecdee3-db24-40b0-b45e-74fa9fc8e8b5 tempest-GroupSnapshotsTest-1771286532 None] Flow 'volume_create_manager' (7e84cc68-8ad5-4b37-a30c-f85d42b08fab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:26:46 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-27ecdee3-db24-40b0-b45e-74fa9fc8e8b5 tempest-GroupSnapshotsTest-1771286532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ced49933-8981-4e9b-a773-981c9566678b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:26:46 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-27ecdee3-db24-40b0-b45e-74fa9fc8e8b5 tempest-GroupSnapshotsTest-1771286532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ced49933-8981-4e9b-a773-981c9566678b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:26:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1598313756',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=55c06279-54b4-49cf-ad9b-46b516a4c99e,host='devstack@QuobyteHD#QuobyteHD',id=eb9611a2-76a1-42e9-8e9a-2827c5675094,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c152379270c34f8cbfcc68d9bff1896d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:26:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:26:46Z,use_quota=True,user_id='07b5122bd8a84b24bfe42d705a4f0cd2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd1098d3-6fdf-4a2c-b121-a1d49d039d77),volume_type_id=bd1098d3-6fdf-4a2c-b121-a1d49d039d77)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:26:46 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-27ecdee3-db24-40b0-b45e-74fa9fc8e8b5 tempest-GroupSnapshotsTest-1771286532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0c9ef9b-1785-4c75-a31b-1ed22b6503dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:26:46 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-27ecdee3-db24-40b0-b45e-74fa9fc8e8b5 tempest-GroupSnapshotsTest-1771286532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0c9ef9b-1785-4c75-a31b-1ed22b6503dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:26:46 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-27ecdee3-db24-40b0-b45e-74fa9fc8e8b5 tempest-GroupSnapshotsTest-1771286532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96b69d6d-bdc3-495f-97f7-91c7d84ded76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:26:46 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-27ecdee3-db24-40b0-b45e-74fa9fc8e8b5 tempest-GroupSnapshotsTest-1771286532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96b69d6d-bdc3-495f-97f7-91c7d84ded76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb9611a2-76a1-42e9-8e9a-2827c5675094', 'volume_name': 'volume-eb9611a2-76a1-42e9-8e9a-2827c5675094', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:26:46 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-27ecdee3-db24-40b0-b45e-74fa9fc8e8b5 tempest-GroupSnapshotsTest-1771286532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4488008b-34bb-460e-98d3-b192c48a070e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:26:46 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-27ecdee3-db24-40b0-b45e-74fa9fc8e8b5 tempest-GroupSnapshotsTest-1771286532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4488008b-34bb-460e-98d3-b192c48a070e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:26:46 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-27ecdee3-db24-40b0-b45e-74fa9fc8e8b5 tempest-GroupSnapshotsTest-1771286532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5b68042-8b6e-4c02-88d9-27678622d745) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:26:46 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-27ecdee3-db24-40b0-b45e-74fa9fc8e8b5 tempest-GroupSnapshotsTest-1771286532 None] Volume eb9611a2-76a1-42e9-8e9a-2827c5675094: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb9611a2-76a1-42e9-8e9a-2827c5675094', 'volume_size': 1} Jun 29 03:26:46 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-27ecdee3-db24-40b0-b45e-74fa9fc8e8b5 tempest-GroupSnapshotsTest-1771286532 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:26:46 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-27ecdee3-db24-40b0-b45e-74fa9fc8e8b5 tempest-GroupSnapshotsTest-1771286532 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:26:46 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-27ecdee3-db24-40b0-b45e-74fa9fc8e8b5 tempest-GroupSnapshotsTest-1771286532 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=55c06279-54b4-49cf-ad9b-46b516a4c99e,created_at=2026-06-29T01:26:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1598313756',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=55c06279-54b4-49cf-ad9b-46b516a4c99e,host='devstack@QuobyteHD#QuobyteHD',id=eb9611a2-76a1-42e9-8e9a-2827c5675094,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c152379270c34f8cbfcc68d9bff1896d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:26:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:26:46Z,use_quota=True,user_id='07b5122bd8a84b24bfe42d705a4f0cd2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd1098d3-6fdf-4a2c-b121-a1d49d039d77),volume_type_id=bd1098d3-6fdf-4a2c-b121-a1d49d039d77)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:26:46 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-27ecdee3-db24-40b0-b45e-74fa9fc8e8b5 tempest-GroupSnapshotsTest-1771286532 None] Creating volume eb9611a2-76a1-42e9-8e9a-2827c5675094 {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:26:46 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-27ecdee3-db24-40b0-b45e-74fa9fc8e8b5 tempest-GroupSnapshotsTest-1771286532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:26:46 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-27ecdee3-db24-40b0-b45e-74fa9fc8e8b5 tempest-GroupSnapshotsTest-1771286532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:26:46 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-27ecdee3-db24-40b0-b45e-74fa9fc8e8b5 tempest-GroupSnapshotsTest-1771286532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:26:46 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-27ecdee3-db24-40b0-b45e-74fa9fc8e8b5 tempest-GroupSnapshotsTest-1771286532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:26:46 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-27ecdee3-db24-40b0-b45e-74fa9fc8e8b5 tempest-GroupSnapshotsTest-1771286532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:26:46 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-27ecdee3-db24-40b0-b45e-74fa9fc8e8b5 tempest-GroupSnapshotsTest-1771286532 None] Selected osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:26:46 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-27ecdee3-db24-40b0-b45e-74fa9fc8e8b5 tempest-GroupSnapshotsTest-1771286532 None] casted to osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f Jun 29 03:26:46 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-27ecdee3-db24-40b0-b45e-74fa9fc8e8b5 tempest-GroupSnapshotsTest-1771286532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-eb9611a2-76a1-42e9-8e9a-2827c5675094 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:26:46 devstack sudo[100711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-eb9611a2-76a1-42e9-8e9a-2827c5675094 1073741824 Jun 29 03:26:46 devstack sudo[100711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:26:46 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f5b27d8-26c6-41cb-bfed-0c1ee7d00ef4 tempest-AttachVolumeNegativeTest-1677376095 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:26:46 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-5f5b27d8-26c6-41cb-bfed-0c1ee7d00ef4 tempest-AttachVolumeNegativeTest-1677376095 None] Flow 'volume_create_manager' (cf2dfb53-3791-4225-b5ec-3f766882ac39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:26:46 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-5f5b27d8-26c6-41cb-bfed-0c1ee7d00ef4 tempest-AttachVolumeNegativeTest-1677376095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b723b65-4081-4a46-84f3-6443ea9c5c2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:26:46 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-5f5b27d8-26c6-41cb-bfed-0c1ee7d00ef4 tempest-AttachVolumeNegativeTest-1677376095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b723b65-4081-4a46-84f3-6443ea9c5c2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:26:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1829474182',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c614786-b5cf-47b4-944f-a5fe920d198c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3526e51fa339415f81fd93e4f6eb79d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:26:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:26:47Z,use_quota=True,user_id='c63530b326234dd7a6d67b641079d8b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:26:46 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-5f5b27d8-26c6-41cb-bfed-0c1ee7d00ef4 tempest-AttachVolumeNegativeTest-1677376095 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33279c27-13a7-49f3-86b4-bdf7a0b222af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:26:46 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-5f5b27d8-26c6-41cb-bfed-0c1ee7d00ef4 tempest-AttachVolumeNegativeTest-1677376095 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33279c27-13a7-49f3-86b4-bdf7a0b222af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:26:46 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-5f5b27d8-26c6-41cb-bfed-0c1ee7d00ef4 tempest-AttachVolumeNegativeTest-1677376095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27ffdeac-0ffe-449b-a57f-65996e74b1a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:26:46 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-5f5b27d8-26c6-41cb-bfed-0c1ee7d00ef4 tempest-AttachVolumeNegativeTest-1677376095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27ffdeac-0ffe-449b-a57f-65996e74b1a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c614786-b5cf-47b4-944f-a5fe920d198c', 'volume_name': 'volume-0c614786-b5cf-47b4-944f-a5fe920d198c', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:26:46 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-5f5b27d8-26c6-41cb-bfed-0c1ee7d00ef4 tempest-AttachVolumeNegativeTest-1677376095 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac1adf5c-1246-4617-8abf-7064db082871) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:26:46 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-5f5b27d8-26c6-41cb-bfed-0c1ee7d00ef4 tempest-AttachVolumeNegativeTest-1677376095 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac1adf5c-1246-4617-8abf-7064db082871) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:26:46 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-5f5b27d8-26c6-41cb-bfed-0c1ee7d00ef4 tempest-AttachVolumeNegativeTest-1677376095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42a12884-e5d8-47ef-8cde-79e00913355d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:26:46 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-5f5b27d8-26c6-41cb-bfed-0c1ee7d00ef4 tempest-AttachVolumeNegativeTest-1677376095 None] Volume 0c614786-b5cf-47b4-944f-a5fe920d198c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c614786-b5cf-47b4-944f-a5fe920d198c', 'volume_size': 1} Jun 29 03:26:46 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-5f5b27d8-26c6-41cb-bfed-0c1ee7d00ef4 tempest-AttachVolumeNegativeTest-1677376095 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:26:47 devstack sudo[100711]: pam_unix(sudo:session): session closed for user root Jun 29 03:26:47 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-27ecdee3-db24-40b0-b45e-74fa9fc8e8b5 tempest-GroupSnapshotsTest-1771286532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-eb9611a2-76a1-42e9-8e9a-2827c5675094 1073741824" returned: 0 in 0.973s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:26:47 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-27ecdee3-db24-40b0-b45e-74fa9fc8e8b5 tempest-GroupSnapshotsTest-1771286532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-eb9611a2-76a1-42e9-8e9a-2827c5675094 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:26:47 devstack sudo[100716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-eb9611a2-76a1-42e9-8e9a-2827c5675094 Jun 29 03:26:47 devstack sudo[100716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:26:48 devstack sudo[100716]: pam_unix(sudo:session): session closed for user root Jun 29 03:26:48 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-27ecdee3-db24-40b0-b45e-74fa9fc8e8b5 tempest-GroupSnapshotsTest-1771286532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-eb9611a2-76a1-42e9-8e9a-2827c5675094" returned: 0 in 0.707s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:26:48 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-27ecdee3-db24-40b0-b45e-74fa9fc8e8b5 tempest-GroupSnapshotsTest-1771286532 None] <== create_volume: return (1737ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:26:48 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-27ecdee3-db24-40b0-b45e-74fa9fc8e8b5 tempest-GroupSnapshotsTest-1771286532 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.740s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:26:48 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-5f5b27d8-26c6-41cb-bfed-0c1ee7d00ef4 tempest-AttachVolumeNegativeTest-1677376095 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.481s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:26:48 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-5f5b27d8-26c6-41cb-bfed-0c1ee7d00ef4 tempest-AttachVolumeNegativeTest-1677376095 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:26:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1829474182',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c614786-b5cf-47b4-944f-a5fe920d198c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3526e51fa339415f81fd93e4f6eb79d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:26:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:26:47Z,use_quota=True,user_id='c63530b326234dd7a6d67b641079d8b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:26:48 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-5f5b27d8-26c6-41cb-bfed-0c1ee7d00ef4 tempest-AttachVolumeNegativeTest-1677376095 None] Creating volume 0c614786-b5cf-47b4-944f-a5fe920d198c {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:26:48 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-5f5b27d8-26c6-41cb-bfed-0c1ee7d00ef4 tempest-AttachVolumeNegativeTest-1677376095 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:26:48 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-5f5b27d8-26c6-41cb-bfed-0c1ee7d00ef4 tempest-AttachVolumeNegativeTest-1677376095 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:26:48 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-5f5b27d8-26c6-41cb-bfed-0c1ee7d00ef4 tempest-AttachVolumeNegativeTest-1677376095 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:26:48 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-5f5b27d8-26c6-41cb-bfed-0c1ee7d00ef4 tempest-AttachVolumeNegativeTest-1677376095 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:26:48 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-5f5b27d8-26c6-41cb-bfed-0c1ee7d00ef4 tempest-AttachVolumeNegativeTest-1677376095 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:26:48 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-5f5b27d8-26c6-41cb-bfed-0c1ee7d00ef4 tempest-AttachVolumeNegativeTest-1677376095 None] Selected osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:26:48 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-5f5b27d8-26c6-41cb-bfed-0c1ee7d00ef4 tempest-AttachVolumeNegativeTest-1677376095 None] casted to osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f Jun 29 03:26:48 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-5f5b27d8-26c6-41cb-bfed-0c1ee7d00ef4 tempest-AttachVolumeNegativeTest-1677376095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-0c614786-b5cf-47b4-944f-a5fe920d198c 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:26:48 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-27ecdee3-db24-40b0-b45e-74fa9fc8e8b5 tempest-GroupSnapshotsTest-1771286532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5b68042-8b6e-4c02-88d9-27678622d745) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb9611a2-76a1-42e9-8e9a-2827c5675094', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:26:48 devstack sudo[100719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-0c614786-b5cf-47b4-944f-a5fe920d198c 1073741824 Jun 29 03:26:48 devstack sudo[100719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:26:48 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-27ecdee3-db24-40b0-b45e-74fa9fc8e8b5 tempest-GroupSnapshotsTest-1771286532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48fd0701-0741-4892-91c9-dec6d8eb1256) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:26:48 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-27ecdee3-db24-40b0-b45e-74fa9fc8e8b5 tempest-GroupSnapshotsTest-1771286532 None] Volume volume-eb9611a2-76a1-42e9-8e9a-2827c5675094 (eb9611a2-76a1-42e9-8e9a-2827c5675094): created successfully Jun 29 03:26:48 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-27ecdee3-db24-40b0-b45e-74fa9fc8e8b5 tempest-GroupSnapshotsTest-1771286532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48fd0701-0741-4892-91c9-dec6d8eb1256) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:26:48 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-27ecdee3-db24-40b0-b45e-74fa9fc8e8b5 tempest-GroupSnapshotsTest-1771286532 None] Flow 'volume_create_manager' (7e84cc68-8ad5-4b37-a30c-f85d42b08fab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:26:48 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-27ecdee3-db24-40b0-b45e-74fa9fc8e8b5 tempest-GroupSnapshotsTest-1771286532 None] Created volume successfully. Jun 29 03:26:48 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-e361f100-8815-4372-a6d6-7a738c201db4 tempest-GroupSnapshotsTest-1771286532 None] Update group completed successfully. Jun 29 03:26:49 devstack sudo[100719]: pam_unix(sudo:session): session closed for user root Jun 29 03:26:49 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-5f5b27d8-26c6-41cb-bfed-0c1ee7d00ef4 tempest-AttachVolumeNegativeTest-1677376095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-0c614786-b5cf-47b4-944f-a5fe920d198c 1073741824" returned: 0 in 1.045s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:26:49 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-5f5b27d8-26c6-41cb-bfed-0c1ee7d00ef4 tempest-AttachVolumeNegativeTest-1677376095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-0c614786-b5cf-47b4-944f-a5fe920d198c {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:26:49 devstack sudo[100725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-0c614786-b5cf-47b4-944f-a5fe920d198c Jun 29 03:26:49 devstack sudo[100725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:26:50 devstack sudo[100725]: pam_unix(sudo:session): session closed for user root Jun 29 03:26:50 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-5f5b27d8-26c6-41cb-bfed-0c1ee7d00ef4 tempest-AttachVolumeNegativeTest-1677376095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-0c614786-b5cf-47b4-944f-a5fe920d198c" returned: 0 in 0.874s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:26:50 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-5f5b27d8-26c6-41cb-bfed-0c1ee7d00ef4 tempest-AttachVolumeNegativeTest-1677376095 None] <== create_volume: return (1961ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:26:50 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-5f5b27d8-26c6-41cb-bfed-0c1ee7d00ef4 tempest-AttachVolumeNegativeTest-1677376095 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.966s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:26:50 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-5f5b27d8-26c6-41cb-bfed-0c1ee7d00ef4 tempest-AttachVolumeNegativeTest-1677376095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42a12884-e5d8-47ef-8cde-79e00913355d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c614786-b5cf-47b4-944f-a5fe920d198c', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:26:50 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-5f5b27d8-26c6-41cb-bfed-0c1ee7d00ef4 tempest-AttachVolumeNegativeTest-1677376095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (488f4931-9f2b-402f-991e-69e3a4c3ab69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:26:50 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-5f5b27d8-26c6-41cb-bfed-0c1ee7d00ef4 tempest-AttachVolumeNegativeTest-1677376095 None] Volume volume-0c614786-b5cf-47b4-944f-a5fe920d198c (0c614786-b5cf-47b4-944f-a5fe920d198c): created successfully Jun 29 03:26:50 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-5f5b27d8-26c6-41cb-bfed-0c1ee7d00ef4 tempest-AttachVolumeNegativeTest-1677376095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (488f4931-9f2b-402f-991e-69e3a4c3ab69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:26:50 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-5f5b27d8-26c6-41cb-bfed-0c1ee7d00ef4 tempest-AttachVolumeNegativeTest-1677376095 None] Flow 'volume_create_manager' (cf2dfb53-3791-4225-b5ec-3f766882ac39) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:26:50 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-5f5b27d8-26c6-41cb-bfed-0c1ee7d00ef4 tempest-AttachVolumeNegativeTest-1677376095 None] Created volume successfully. Jun 29 03:26:50 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-e023ec54-3b6e-4f59-8002-de237f5b8665 tempest-GroupSnapshotsTest-1771286532 None] Update group completed successfully. Jun 29 03:26:51 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-c40675f4-8250-4b91-8618-2413ed519bcd tempest-GroupSnapshotsTest-1771286532 None] Update group completed successfully. Jun 29 03:26:52 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-f2889b31-ea10-41bc-a157-4269ef706257 tempest-GroupSnapshotsTest-1771286532 None] Update group completed successfully. Jun 29 03:26:54 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [req-56045bc3-6417-4452-970a-e156da1879ca req-5b9073c8-dc82-4296-a6c8-589dd4d95a5b tempest-AttachVolumeNegativeTest-1677376095 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:26:54 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [req-56045bc3-6417-4452-970a-e156da1879ca req-5b9073c8-dc82-4296-a6c8-589dd4d95a5b tempest-AttachVolumeNegativeTest-1677376095 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:26:54 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dee4ad3-6d53-41df-9181-a8d2ea340eb0]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:26:54 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [req-56045bc3-6417-4452-970a-e156da1879ca req-5b9073c8-dc82-4296-a6c8-589dd4d95a5b tempest-AttachVolumeNegativeTest-1677376095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-0c614786-b5cf-47b4-944f-a5fe920d198c {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:26:54 devstack sudo[100761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-0c614786-b5cf-47b4-944f-a5fe920d198c Jun 29 03:26:54 devstack sudo[100761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:26:54 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-704cc0bf-ec02-46a3-a3fc-500f2a5ae5db tempest-GroupSnapshotsTest-1771286532 None] GroupSnapshot 90e79657-6de8-470a-a2cd-30ccf469c8c7: creating. Jun 29 03:26:54 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-704cc0bf-ec02-46a3-a3fc-500f2a5ae5db tempest-GroupSnapshotsTest-1771286532 None] Group snapshot 90e79657-6de8-470a-a2cd-30ccf469c8c7: creating. {{(pid=93468) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jun 29 03:26:54 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-704cc0bf-ec02-46a3-a3fc-500f2a5ae5db tempest-GroupSnapshotsTest-1771286532 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:26:55 devstack sudo[100761]: pam_unix(sudo:session): session closed for user root Jun 29 03:26:55 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [req-56045bc3-6417-4452-970a-e156da1879ca req-5b9073c8-dc82-4296-a6c8-589dd4d95a5b tempest-AttachVolumeNegativeTest-1677376095 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-0c614786-b5cf-47b4-944f-a5fe920d198c" returned: 0 in 0.920s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:26:55 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [req-56045bc3-6417-4452-970a-e156da1879ca req-5b9073c8-dc82-4296-a6c8-589dd4d95a5b tempest-AttachVolumeNegativeTest-1677376095 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.944s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:26:55 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-704cc0bf-ec02-46a3-a3fc-500f2a5ae5db tempest-GroupSnapshotsTest-1771286532 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.582s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:26:55 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-704cc0bf-ec02-46a3-a3fc-500f2a5ae5db tempest-GroupSnapshotsTest-1771286532 None] Creating offline snapshot a3c57d7d-03ef-4449-adff-faa5b577afd9 of volume eb9611a2-76a1-42e9-8e9a-2827c5675094 {{(pid=93468) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 29 03:26:55 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[5477e4a9-b8d4-40ae-bb19-57da49b32303]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:26:55 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-704cc0bf-ec02-46a3-a3fc-500f2a5ae5db tempest-GroupSnapshotsTest-1771286532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-eb9611a2-76a1-42e9-8e9a-2827c5675094 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:26:55 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [req-56045bc3-6417-4452-970a-e156da1879ca req-5b9073c8-dc82-4296-a6c8-589dd4d95a5b tempest-AttachVolumeNegativeTest-1677376095 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f', 'name': 'volume-0c614786-b5cf-47b4-944f-a5fe920d198c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2521000a-90d4-4e6a-93d7-dcb213c51594', 'enforce_multipath': True} {{(pid=93468) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 29 03:26:55 devstack cinder-volume[93468]: INFO cinder.volume.manager [req-56045bc3-6417-4452-970a-e156da1879ca req-5b9073c8-dc82-4296-a6c8-589dd4d95a5b tempest-AttachVolumeNegativeTest-1677376095 None] attachment_update completed successfully. Jun 29 03:26:55 devstack sudo[100771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-eb9611a2-76a1-42e9-8e9a-2827c5675094 Jun 29 03:26:55 devstack sudo[100771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:26:55 devstack sudo[100771]: pam_unix(sudo:session): session closed for user root Jun 29 03:26:55 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-704cc0bf-ec02-46a3-a3fc-500f2a5ae5db tempest-GroupSnapshotsTest-1771286532 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-eb9611a2-76a1-42e9-8e9a-2827c5675094" returned: 0 in 0.866s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:26:55 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-704cc0bf-ec02-46a3-a3fc-500f2a5ae5db tempest-GroupSnapshotsTest-1771286532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-eb9611a2-76a1-42e9-8e9a-2827c5675094,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-eb9611a2-76a1-42e9-8e9a-2827c5675094.a3c57d7d-03ef-4449-adff-faa5b577afd9 1G {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:26:55 devstack sudo[100843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-eb9611a2-76a1-42e9-8e9a-2827c5675094,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-eb9611a2-76a1-42e9-8e9a-2827c5675094.a3c57d7d-03ef-4449-adff-faa5b577afd9 1G Jun 29 03:26:55 devstack sudo[100843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:26:56 devstack sudo[100843]: pam_unix(sudo:session): session closed for user root Jun 29 03:26:56 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-704cc0bf-ec02-46a3-a3fc-500f2a5ae5db tempest-GroupSnapshotsTest-1771286532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-eb9611a2-76a1-42e9-8e9a-2827c5675094,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-eb9611a2-76a1-42e9-8e9a-2827c5675094.a3c57d7d-03ef-4449-adff-faa5b577afd9 1G" returned: 0 in 0.946s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:26:56 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-704cc0bf-ec02-46a3-a3fc-500f2a5ae5db tempest-GroupSnapshotsTest-1771286532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eb9611a2-76a1-42e9-8e9a-2827c5675094 -F qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-eb9611a2-76a1-42e9-8e9a-2827c5675094.a3c57d7d-03ef-4449-adff-faa5b577afd9 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:26:56 devstack sudo[101173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eb9611a2-76a1-42e9-8e9a-2827c5675094 -F qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-eb9611a2-76a1-42e9-8e9a-2827c5675094.a3c57d7d-03ef-4449-adff-faa5b577afd9 Jun 29 03:26:56 devstack sudo[101173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:26:58 devstack sudo[101173]: pam_unix(sudo:session): session closed for user root Jun 29 03:26:58 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-704cc0bf-ec02-46a3-a3fc-500f2a5ae5db tempest-GroupSnapshotsTest-1771286532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eb9611a2-76a1-42e9-8e9a-2827c5675094 -F qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-eb9611a2-76a1-42e9-8e9a-2827c5675094.a3c57d7d-03ef-4449-adff-faa5b577afd9" returned: 0 in 1.127s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:26:58 devstack cinder-volume[93468]: WARNING cinder.volume.drivers.remotefs [None req-704cc0bf-ec02-46a3-a3fc-500f2a5ae5db tempest-GroupSnapshotsTest-1771286532 None] /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-eb9611a2-76a1-42e9-8e9a-2827c5675094.a3c57d7d-03ef-4449-adff-faa5b577afd9 is being set with open permissions: ugo+rw: NotImplementedError Jun 29 03:26:58 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-704cc0bf-ec02-46a3-a3fc-500f2a5ae5db tempest-GroupSnapshotsTest-1771286532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-eb9611a2-76a1-42e9-8e9a-2827c5675094.a3c57d7d-03ef-4449-adff-faa5b577afd9 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:26:58 devstack sudo[101241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-eb9611a2-76a1-42e9-8e9a-2827c5675094.a3c57d7d-03ef-4449-adff-faa5b577afd9 Jun 29 03:26:58 devstack sudo[101241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:26:59 devstack sudo[101241]: pam_unix(sudo:session): session closed for user root Jun 29 03:26:59 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-704cc0bf-ec02-46a3-a3fc-500f2a5ae5db tempest-GroupSnapshotsTest-1771286532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-eb9611a2-76a1-42e9-8e9a-2827c5675094.a3c57d7d-03ef-4449-adff-faa5b577afd9" returned: 0 in 1.026s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:26:59 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-704cc0bf-ec02-46a3-a3fc-500f2a5ae5db tempest-GroupSnapshotsTest-1771286532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-eb9611a2-76a1-42e9-8e9a-2827c5675094.info {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:26:59 devstack sudo[101256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-eb9611a2-76a1-42e9-8e9a-2827c5675094.info Jun 29 03:26:59 devstack sudo[101256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:26:59 devstack sudo[101256]: pam_unix(sudo:session): session closed for user root Jun 29 03:26:59 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-704cc0bf-ec02-46a3-a3fc-500f2a5ae5db tempest-GroupSnapshotsTest-1771286532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-eb9611a2-76a1-42e9-8e9a-2827c5675094.info" returned: 0 in 0.865s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:26:59 devstack cinder-volume[93468]: WARNING cinder.volume.drivers.remotefs [None req-704cc0bf-ec02-46a3-a3fc-500f2a5ae5db tempest-GroupSnapshotsTest-1771286532 None] /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-eb9611a2-76a1-42e9-8e9a-2827c5675094.info is being set with open permissions: ugo+rw: NotImplementedError Jun 29 03:26:59 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-704cc0bf-ec02-46a3-a3fc-500f2a5ae5db tempest-GroupSnapshotsTest-1771286532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-eb9611a2-76a1-42e9-8e9a-2827c5675094.info {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:27:00 devstack sudo[101259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-eb9611a2-76a1-42e9-8e9a-2827c5675094.info Jun 29 03:27:00 devstack sudo[101259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:27:00 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-b386741d-a8a3-4570-80f5-a3b8c89d1693 tempest-VolumesImageMetadata-1988334519 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:27:00 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-b386741d-a8a3-4570-80f5-a3b8c89d1693 tempest-VolumesImageMetadata-1988334519 None] Flow 'volume_create_manager' (89cc8039-2df8-4949-be3b-1715fa27c843) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:27:00 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-b386741d-a8a3-4570-80f5-a3b8c89d1693 tempest-VolumesImageMetadata-1988334519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b323138-31f2-456b-bba9-c7057dbfd3de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:27:00 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-b386741d-a8a3-4570-80f5-a3b8c89d1693 tempest-VolumesImageMetadata-1988334519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b323138-31f2-456b-bba9-c7057dbfd3de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:27:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1826794545',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c9a8cce-8378-4c7a-a3dc-a82599771a30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d30fc123099a4aeeab06afa7af575e84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:27:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:27:00Z,use_quota=True,user_id='711521c383b04c2ba703bcd5a74d6e5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:27:00 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-b386741d-a8a3-4570-80f5-a3b8c89d1693 tempest-VolumesImageMetadata-1988334519 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3178a1b0-660c-4c85-90a0-9aa783cd65f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:27:00 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-b386741d-a8a3-4570-80f5-a3b8c89d1693 tempest-VolumesImageMetadata-1988334519 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3178a1b0-660c-4c85-90a0-9aa783cd65f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:27:00 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-b386741d-a8a3-4570-80f5-a3b8c89d1693 tempest-VolumesImageMetadata-1988334519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6df9e79-22da-4e26-bd02-846d079e46d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:27:00 devstack cinder-volume[93468]: DEBUG cinder.image.glance [None req-b386741d-a8a3-4570-80f5-a3b8c89d1693 tempest-VolumesImageMetadata-1988334519 None] Creating Keystone auth plugin from conf {{(pid=93468) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 29 03:27:00 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-b386741d-a8a3-4570-80f5-a3b8c89d1693 tempest-VolumesImageMetadata-1988334519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6df9e79-22da-4e26-bd02-846d079e46d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '0c9a8cce-8378-4c7a-a3dc-a82599771a30', 'volume_name': 'volume-0c9a8cce-8378-4c7a-a3dc-a82599771a30', 'volume_size': 1, 'image_id': '24cf6ce1-1d2d-493f-a115-2a39928c82fb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/24cf6ce1-1d2d-493f-a115-2a39928c82fb', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1335b5873eea4762b9fea7f84dd1615c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '24cf6ce1-1d2d-493f-a115-2a39928c82fb', 'created_at': datetime.datetime(2026, 6, 29, 1, 13, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 29, 1, 13, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/24cf6ce1-1d2d-493f-a115-2a39928c82fb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:27:00 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-b386741d-a8a3-4570-80f5-a3b8c89d1693 tempest-VolumesImageMetadata-1988334519 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (926ffb98-6cdb-4c1a-afb6-83ce8dada5d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:27:00 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-b386741d-a8a3-4570-80f5-a3b8c89d1693 tempest-VolumesImageMetadata-1988334519 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (926ffb98-6cdb-4c1a-afb6-83ce8dada5d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:27:00 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-b386741d-a8a3-4570-80f5-a3b8c89d1693 tempest-VolumesImageMetadata-1988334519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b26ba6e-9866-46e8-a3be-7d0173bbda82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:27:00 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-b386741d-a8a3-4570-80f5-a3b8c89d1693 tempest-VolumesImageMetadata-1988334519 None] Volume 0c9a8cce-8378-4c7a-a3dc-a82599771a30: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-0c9a8cce-8378-4c7a-a3dc-a82599771a30', 'volume_size': 1, 'image_id': '24cf6ce1-1d2d-493f-a115-2a39928c82fb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/24cf6ce1-1d2d-493f-a115-2a39928c82fb', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1335b5873eea4762b9fea7f84dd1615c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '24cf6ce1-1d2d-493f-a115-2a39928c82fb', 'created_at': datetime.datetime(2026, 6, 29, 1, 13, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 29, 1, 13, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/24cf6ce1-1d2d-493f-a115-2a39928c82fb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jun 29 03:27:00 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-b386741d-a8a3-4570-80f5-a3b8c89d1693 tempest-VolumesImageMetadata-1988334519 None] Trying to clone 0c9a8cce-8378-4c7a-a3dc-a82599771a30 from image 24cf6ce1-1d2d-493f-a115-2a39928c82fb at location (None, [{'url': 'file:///opt/stack/data/glance/images/24cf6ce1-1d2d-493f-a115-2a39928c82fb', 'metadata': {}}]). {{(pid=93468) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 29 03:27:01 devstack sudo[101259]: pam_unix(sudo:session): session closed for user root Jun 29 03:27:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-704cc0bf-ec02-46a3-a3fc-500f2a5ae5db tempest-GroupSnapshotsTest-1771286532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-eb9611a2-76a1-42e9-8e9a-2827c5675094.info" returned: 0 in 1.271s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:27:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-704cc0bf-ec02-46a3-a3fc-500f2a5ae5db tempest-GroupSnapshotsTest-1771286532 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.231s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:27:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-704cc0bf-ec02-46a3-a3fc-500f2a5ae5db tempest-GroupSnapshotsTest-1771286532 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:27:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-704cc0bf-ec02-46a3-a3fc-500f2a5ae5db tempest-GroupSnapshotsTest-1771286532 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:27:01 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-704cc0bf-ec02-46a3-a3fc-500f2a5ae5db tempest-GroupSnapshotsTest-1771286532 None] Creating offline snapshot e0b70a18-5e8f-408c-9c02-212ceb70e9a2 of volume 927e590e-ff80-4342-be46-8d91284ec972 {{(pid=93468) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 29 03:27:01 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[55a84363-b926-4c30-8b42-9da9e6a389c4]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:27:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-704cc0bf-ec02-46a3-a3fc-500f2a5ae5db tempest-GroupSnapshotsTest-1771286532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-927e590e-ff80-4342-be46-8d91284ec972 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:27:01 devstack cinder-volume[93468]: DEBUG cinder.image.image_utils [None req-b386741d-a8a3-4570-80f5-a3b8c89d1693 tempest-VolumesImageMetadata-1988334519 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_24cf6ce1-1d2d-493f-a115-2a39928c82fb_55oewtnrdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=93468) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 29 03:27:01 devstack cinder-volume[93468]: INFO cinder.image.image_utils [None req-b386741d-a8a3-4570-80f5-a3b8c89d1693 tempest-VolumesImageMetadata-1988334519 None] Image download 20.69 MB at 20.69 MB/s Jun 29 03:27:01 devstack sudo[101284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-927e590e-ff80-4342-be46-8d91284ec972 Jun 29 03:27:01 devstack sudo[101284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:27:01 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fa6629a-8113-471f-ab4c-70603c0448e5]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:27:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b386741d-a8a3-4570-80f5-a3b8c89d1693 tempest-VolumesImageMetadata-1988334519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_24cf6ce1-1d2d-493f-a115-2a39928c82fb_55oewtnrdevstack@QuobyteHD {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:27:01 devstack sudo[101287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_24cf6ce1-1d2d-493f-a115-2a39928c82fb_55oewtnrdevstack@QuobyteHD Jun 29 03:27:01 devstack sudo[101287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:27:02 devstack sudo[101284]: pam_unix(sudo:session): session closed for user root Jun 29 03:27:02 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-704cc0bf-ec02-46a3-a3fc-500f2a5ae5db tempest-GroupSnapshotsTest-1771286532 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-927e590e-ff80-4342-be46-8d91284ec972" returned: 0 in 1.088s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:27:02 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-704cc0bf-ec02-46a3-a3fc-500f2a5ae5db tempest-GroupSnapshotsTest-1771286532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-927e590e-ff80-4342-be46-8d91284ec972,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-927e590e-ff80-4342-be46-8d91284ec972.e0b70a18-5e8f-408c-9c02-212ceb70e9a2 1G {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:27:02 devstack sudo[101295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-927e590e-ff80-4342-be46-8d91284ec972,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-927e590e-ff80-4342-be46-8d91284ec972.e0b70a18-5e8f-408c-9c02-212ceb70e9a2 1G Jun 29 03:27:02 devstack sudo[101295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:27:02 devstack sudo[101287]: pam_unix(sudo:session): session closed for user root Jun 29 03:27:02 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b386741d-a8a3-4570-80f5-a3b8c89d1693 tempest-VolumesImageMetadata-1988334519 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_24cf6ce1-1d2d-493f-a115-2a39928c82fb_55oewtnrdevstack@QuobyteHD" returned: 0 in 1.137s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:27:02 devstack cinder-volume[93468]: DEBUG cinder.image.image_utils [None req-b386741d-a8a3-4570-80f5-a3b8c89d1693 tempest-VolumesImageMetadata-1988334519 None] Temporary image 24cf6ce1-1d2d-493f-a115-2a39928c82fb is fetched for user 711521c383b04c2ba703bcd5a74d6e5e. {{(pid=93468) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 29 03:27:02 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[759390e7-ae00-4ec9-b225-151a6d8813a8]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:27:02 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b386741d-a8a3-4570-80f5-a3b8c89d1693 tempest-VolumesImageMetadata-1988334519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_24cf6ce1-1d2d-493f-a115-2a39928c82fb_55oewtnrdevstack@QuobyteHD {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:27:03 devstack sudo[101305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_24cf6ce1-1d2d-493f-a115-2a39928c82fb_55oewtnrdevstack@QuobyteHD Jun 29 03:27:03 devstack sudo[101305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:27:03 devstack cinder-volume[93468]: INFO cinder.volume.manager [req-2f44c6e9-ae28-48a7-9be9-f482dcd529d1 req-55baada8-176e-433c-948c-93fa6bc84861 tempest-AttachVolumeNegativeTest-1677376095 None] Terminate volume connection completed successfully. Jun 29 03:27:03 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [req-2f44c6e9-ae28-48a7-9be9-f482dcd529d1 req-55baada8-176e-433c-948c-93fa6bc84861 tempest-AttachVolumeNegativeTest-1677376095 None] Deleting attachment 2521000a-90d4-4e6a-93d7-dcb213c51594. {{(pid=93468) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 29 03:27:03 devstack sudo[101295]: pam_unix(sudo:session): session closed for user root Jun 29 03:27:03 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-704cc0bf-ec02-46a3-a3fc-500f2a5ae5db tempest-GroupSnapshotsTest-1771286532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-927e590e-ff80-4342-be46-8d91284ec972,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-927e590e-ff80-4342-be46-8d91284ec972.e0b70a18-5e8f-408c-9c02-212ceb70e9a2 1G" returned: 0 in 1.418s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:27:03 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-704cc0bf-ec02-46a3-a3fc-500f2a5ae5db tempest-GroupSnapshotsTest-1771286532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-927e590e-ff80-4342-be46-8d91284ec972 -F qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-927e590e-ff80-4342-be46-8d91284ec972.e0b70a18-5e8f-408c-9c02-212ceb70e9a2 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:27:03 devstack sudo[101354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-927e590e-ff80-4342-be46-8d91284ec972 -F qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-927e590e-ff80-4342-be46-8d91284ec972.e0b70a18-5e8f-408c-9c02-212ceb70e9a2 Jun 29 03:27:03 devstack sudo[101354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:27:04 devstack sudo[101305]: pam_unix(sudo:session): session closed for user root Jun 29 03:27:04 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b386741d-a8a3-4570-80f5-a3b8c89d1693 tempest-VolumesImageMetadata-1988334519 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_24cf6ce1-1d2d-493f-a115-2a39928c82fb_55oewtnrdevstack@QuobyteHD" returned: 0 in 1.243s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:27:04 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-b386741d-a8a3-4570-80f5-a3b8c89d1693 tempest-VolumesImageMetadata-1988334519 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:27:04 devstack sudo[101354]: pam_unix(sudo:session): session closed for user root Jun 29 03:27:04 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-704cc0bf-ec02-46a3-a3fc-500f2a5ae5db tempest-GroupSnapshotsTest-1771286532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-927e590e-ff80-4342-be46-8d91284ec972 -F qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-927e590e-ff80-4342-be46-8d91284ec972.e0b70a18-5e8f-408c-9c02-212ceb70e9a2" returned: 0 in 0.847s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:27:04 devstack cinder-volume[93468]: WARNING cinder.volume.drivers.remotefs [None req-704cc0bf-ec02-46a3-a3fc-500f2a5ae5db tempest-GroupSnapshotsTest-1771286532 None] /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-927e590e-ff80-4342-be46-8d91284ec972.e0b70a18-5e8f-408c-9c02-212ceb70e9a2 is being set with open permissions: ugo+rw: NotImplementedError Jun 29 03:27:04 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-704cc0bf-ec02-46a3-a3fc-500f2a5ae5db tempest-GroupSnapshotsTest-1771286532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-927e590e-ff80-4342-be46-8d91284ec972.e0b70a18-5e8f-408c-9c02-212ceb70e9a2 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:27:04 devstack sudo[101364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-927e590e-ff80-4342-be46-8d91284ec972.e0b70a18-5e8f-408c-9c02-212ceb70e9a2 Jun 29 03:27:04 devstack sudo[101364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:27:05 devstack sudo[101364]: pam_unix(sudo:session): session closed for user root Jun 29 03:27:05 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-704cc0bf-ec02-46a3-a3fc-500f2a5ae5db tempest-GroupSnapshotsTest-1771286532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-927e590e-ff80-4342-be46-8d91284ec972.e0b70a18-5e8f-408c-9c02-212ceb70e9a2" returned: 0 in 0.809s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:27:05 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-704cc0bf-ec02-46a3-a3fc-500f2a5ae5db tempest-GroupSnapshotsTest-1771286532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-927e590e-ff80-4342-be46-8d91284ec972.info {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:27:05 devstack sudo[101368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-927e590e-ff80-4342-be46-8d91284ec972.info Jun 29 03:27:05 devstack sudo[101368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:27:06 devstack sudo[101368]: pam_unix(sudo:session): session closed for user root Jun 29 03:27:06 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-704cc0bf-ec02-46a3-a3fc-500f2a5ae5db tempest-GroupSnapshotsTest-1771286532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-927e590e-ff80-4342-be46-8d91284ec972.info" returned: 0 in 0.889s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:27:06 devstack cinder-volume[93468]: WARNING cinder.volume.drivers.remotefs [None req-704cc0bf-ec02-46a3-a3fc-500f2a5ae5db tempest-GroupSnapshotsTest-1771286532 None] /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-927e590e-ff80-4342-be46-8d91284ec972.info is being set with open permissions: ugo+rw: NotImplementedError Jun 29 03:27:06 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-704cc0bf-ec02-46a3-a3fc-500f2a5ae5db tempest-GroupSnapshotsTest-1771286532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-927e590e-ff80-4342-be46-8d91284ec972.info {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:27:06 devstack sudo[101394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-927e590e-ff80-4342-be46-8d91284ec972.info Jun 29 03:27:06 devstack sudo[101394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:27:07 devstack sudo[101394]: pam_unix(sudo:session): session closed for user root Jun 29 03:27:07 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-704cc0bf-ec02-46a3-a3fc-500f2a5ae5db tempest-GroupSnapshotsTest-1771286532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-927e590e-ff80-4342-be46-8d91284ec972.info" returned: 0 in 0.965s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:27:07 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-704cc0bf-ec02-46a3-a3fc-500f2a5ae5db tempest-GroupSnapshotsTest-1771286532 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.160s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:27:07 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-b386741d-a8a3-4570-80f5-a3b8c89d1693 tempest-VolumesImageMetadata-1988334519 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.302s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:27:07 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-b386741d-a8a3-4570-80f5-a3b8c89d1693 tempest-VolumesImageMetadata-1988334519 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:27:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1826794545',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c9a8cce-8378-4c7a-a3dc-a82599771a30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d30fc123099a4aeeab06afa7af575e84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:27:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:27:00Z,use_quota=True,user_id='711521c383b04c2ba703bcd5a74d6e5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:27:07 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-b386741d-a8a3-4570-80f5-a3b8c89d1693 tempest-VolumesImageMetadata-1988334519 None] Creating volume 0c9a8cce-8378-4c7a-a3dc-a82599771a30 {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:27:07 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-b386741d-a8a3-4570-80f5-a3b8c89d1693 tempest-VolumesImageMetadata-1988334519 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:27:07 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-b386741d-a8a3-4570-80f5-a3b8c89d1693 tempest-VolumesImageMetadata-1988334519 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:27:07 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-b386741d-a8a3-4570-80f5-a3b8c89d1693 tempest-VolumesImageMetadata-1988334519 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:27:07 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-b386741d-a8a3-4570-80f5-a3b8c89d1693 tempest-VolumesImageMetadata-1988334519 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:27:07 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-b386741d-a8a3-4570-80f5-a3b8c89d1693 tempest-VolumesImageMetadata-1988334519 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:27:07 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-b386741d-a8a3-4570-80f5-a3b8c89d1693 tempest-VolumesImageMetadata-1988334519 None] Selected osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:27:07 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-b386741d-a8a3-4570-80f5-a3b8c89d1693 tempest-VolumesImageMetadata-1988334519 None] casted to osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f Jun 29 03:27:07 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b386741d-a8a3-4570-80f5-a3b8c89d1693 tempest-VolumesImageMetadata-1988334519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-0c9a8cce-8378-4c7a-a3dc-a82599771a30 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:27:07 devstack sudo[101414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-0c9a8cce-8378-4c7a-a3dc-a82599771a30 1073741824 Jun 29 03:27:07 devstack sudo[101414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:27:07 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-704cc0bf-ec02-46a3-a3fc-500f2a5ae5db tempest-GroupSnapshotsTest-1771286532 None] group_snapshot 90e79657-6de8-470a-a2cd-30ccf469c8c7: created successfully Jun 29 03:27:08 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-3d89322f-58e9-4114-8c72-a6f71b222efd tempest-GroupSnapshotsTest-1771286532 None] group_snapshot 90e79657-6de8-470a-a2cd-30ccf469c8c7: deleting Jun 29 03:27:08 devstack sudo[101414]: pam_unix(sudo:session): session closed for user root Jun 29 03:27:08 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b386741d-a8a3-4570-80f5-a3b8c89d1693 tempest-VolumesImageMetadata-1988334519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-0c9a8cce-8378-4c7a-a3dc-a82599771a30 1073741824" returned: 0 in 1.300s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:27:08 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-3d89322f-58e9-4114-8c72-a6f71b222efd tempest-GroupSnapshotsTest-1771286532 None] group_snapshot 90e79657-6de8-470a-a2cd-30ccf469c8c7: deleting {{(pid=93468) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jun 29 03:27:08 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-3d89322f-58e9-4114-8c72-a6f71b222efd tempest-GroupSnapshotsTest-1771286532 None] Acquiring lock "cinder-quobyte-eb9611a2-76a1-42e9-8e9a-2827c5675094" by "delete_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:27:08 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b386741d-a8a3-4570-80f5-a3b8c89d1693 tempest-VolumesImageMetadata-1988334519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-0c9a8cce-8378-4c7a-a3dc-a82599771a30 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:27:08 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-3d89322f-58e9-4114-8c72-a6f71b222efd tempest-GroupSnapshotsTest-1771286532 None] Lock "cinder-quobyte-eb9611a2-76a1-42e9-8e9a-2827c5675094" acquired by "delete_snapshot" :: waited 0.050s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:27:08 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-3d89322f-58e9-4114-8c72-a6f71b222efd tempest-GroupSnapshotsTest-1771286532 None] Acquiring lock "cinder-quobyte-a3c57d7d-03ef-4449-adff-faa5b577afd9" by "_delete_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:27:08 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-3d89322f-58e9-4114-8c72-a6f71b222efd tempest-GroupSnapshotsTest-1771286532 None] Lock "cinder-quobyte-a3c57d7d-03ef-4449-adff-faa5b577afd9" acquired by "_delete_snapshot" :: waited 0.055s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:27:08 devstack sudo[101424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-0c9a8cce-8378-4c7a-a3dc-a82599771a30 Jun 29 03:27:08 devstack sudo[101424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:27:08 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-3d89322f-58e9-4114-8c72-a6f71b222efd tempest-GroupSnapshotsTest-1771286532 None] Deleting offline snapshot a3c57d7d-03ef-4449-adff-faa5b577afd9 of volume eb9611a2-76a1-42e9-8e9a-2827c5675094 {{(pid=93468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 29 03:27:09 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-3d89322f-58e9-4114-8c72-a6f71b222efd tempest-GroupSnapshotsTest-1771286532 None] snapshot_file for this snap is: volume-eb9611a2-76a1-42e9-8e9a-2827c5675094.a3c57d7d-03ef-4449-adff-faa5b577afd9 {{(pid=93468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 29 03:27:09 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[146b9929-2fd9-46c6-85f4-eb7e3e3c6ceb]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:27:09 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-3d89322f-58e9-4114-8c72-a6f71b222efd tempest-GroupSnapshotsTest-1771286532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-eb9611a2-76a1-42e9-8e9a-2827c5675094.a3c57d7d-03ef-4449-adff-faa5b577afd9 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:27:09 devstack sudo[101427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-eb9611a2-76a1-42e9-8e9a-2827c5675094.a3c57d7d-03ef-4449-adff-faa5b577afd9 Jun 29 03:27:09 devstack sudo[101427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:27:09 devstack sudo[101424]: pam_unix(sudo:session): session closed for user root Jun 29 03:27:09 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b386741d-a8a3-4570-80f5-a3b8c89d1693 tempest-VolumesImageMetadata-1988334519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-0c9a8cce-8378-4c7a-a3dc-a82599771a30" returned: 0 in 1.088s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:27:09 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-b386741d-a8a3-4570-80f5-a3b8c89d1693 tempest-VolumesImageMetadata-1988334519 None] <== create_volume: return (2516ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:27:09 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-b386741d-a8a3-4570-80f5-a3b8c89d1693 tempest-VolumesImageMetadata-1988334519 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.519s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:27:10 devstack cinder-volume[93468]: DEBUG cinder.volume.volume_utils [None req-b386741d-a8a3-4570-80f5-a3b8c89d1693 tempest-VolumesImageMetadata-1988334519 None] Attempting download of 24cf6ce1-1d2d-493f-a115-2a39928c82fb ((None, [{'url': 'file:///opt/stack/data/glance/images/24cf6ce1-1d2d-493f-a115-2a39928c82fb', 'metadata': {}}])) to volume 0c9a8cce-8378-4c7a-a3dc-a82599771a30. {{(pid=93468) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 29 03:27:10 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[21835e5a-962b-4477-b07d-c1aa5549a360]: (4, 'raw') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:27:10 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b386741d-a8a3-4570-80f5-a3b8c89d1693 tempest-VolumesImageMetadata-1988334519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_24cf6ce1-1d2d-493f-a115-2a39928c82fb_0incbwqp {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:27:10 devstack sudo[101430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_24cf6ce1-1d2d-493f-a115-2a39928c82fb_0incbwqp Jun 29 03:27:10 devstack sudo[101430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:27:10 devstack sudo[101427]: pam_unix(sudo:session): session closed for user root Jun 29 03:27:10 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-3d89322f-58e9-4114-8c72-a6f71b222efd tempest-GroupSnapshotsTest-1771286532 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-eb9611a2-76a1-42e9-8e9a-2827c5675094.a3c57d7d-03ef-4449-adff-faa5b577afd9" returned: 0 in 1.356s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:27:10 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-3d89322f-58e9-4114-8c72-a6f71b222efd tempest-GroupSnapshotsTest-1771286532 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eb9611a2-76a1-42e9-8e9a-2827c5675094(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93468) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 29 03:27:10 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[82f5ea8d-117a-401c-8287-3524736fc5f9]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:27:10 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-3d89322f-58e9-4114-8c72-a6f71b222efd tempest-GroupSnapshotsTest-1771286532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-eb9611a2-76a1-42e9-8e9a-2827c5675094 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:27:10 devstack sudo[101435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-eb9611a2-76a1-42e9-8e9a-2827c5675094 Jun 29 03:27:10 devstack sudo[101435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:27:11 devstack sudo[101430]: pam_unix(sudo:session): session closed for user root Jun 29 03:27:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b386741d-a8a3-4570-80f5-a3b8c89d1693 tempest-VolumesImageMetadata-1988334519 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_24cf6ce1-1d2d-493f-a115-2a39928c82fb_0incbwqp" returned: 0 in 1.298s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:27:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b386741d-a8a3-4570-80f5-a3b8c89d1693 tempest-VolumesImageMetadata-1988334519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_24cf6ce1-1d2d-493f-a115-2a39928c82fb_0incbwqp {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:27:11 devstack sudo[101472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_24cf6ce1-1d2d-493f-a115-2a39928c82fb_0incbwqp Jun 29 03:27:11 devstack sudo[101472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:27:11 devstack cinder-volume[93468]: DEBUG oslo_service.periodic_task [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93468) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 29 03:27:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:27:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:27:11 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:27:11 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:27:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:27:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:27:11 devstack sudo[101475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf Jun 29 03:27:11 devstack sudo[101475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:27:12 devstack sudo[101435]: pam_unix(sudo:session): session closed for user root Jun 29 03:27:12 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-3d89322f-58e9-4114-8c72-a6f71b222efd tempest-GroupSnapshotsTest-1771286532 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-eb9611a2-76a1-42e9-8e9a-2827c5675094" returned: 0 in 1.733s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:27:12 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-3d89322f-58e9-4114-8c72-a6f71b222efd tempest-GroupSnapshotsTest-1771286532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-eb9611a2-76a1-42e9-8e9a-2827c5675094.a3c57d7d-03ef-4449-adff-faa5b577afd9 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:27:12 devstack sudo[101483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-eb9611a2-76a1-42e9-8e9a-2827c5675094.a3c57d7d-03ef-4449-adff-faa5b577afd9 Jun 29 03:27:12 devstack sudo[101483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:27:12 devstack sudo[101472]: pam_unix(sudo:session): session closed for user root Jun 29 03:27:12 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b386741d-a8a3-4570-80f5-a3b8c89d1693 tempest-VolumesImageMetadata-1988334519 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_24cf6ce1-1d2d-493f-a115-2a39928c82fb_0incbwqp" returned: 1 in 1.222s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:27:12 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b386741d-a8a3-4570-80f5-a3b8c89d1693 tempest-VolumesImageMetadata-1988334519 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_24cf6ce1-1d2d-493f-a115-2a39928c82fb_0incbwqp' failed. Not Retrying. {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 29 03:27:12 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[50e5494c-d91f-4b15-8caa-5161735f9c88]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:27:12 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b386741d-a8a3-4570-80f5-a3b8c89d1693 tempest-VolumesImageMetadata-1988334519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_24cf6ce1-1d2d-493f-a115-2a39928c82fb_55oewtnrdevstack@QuobyteHD {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:27:12 devstack sudo[101497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_24cf6ce1-1d2d-493f-a115-2a39928c82fb_55oewtnrdevstack@QuobyteHD Jun 29 03:27:12 devstack sudo[101497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:27:12 devstack sudo[101475]: pam_unix(sudo:session): session closed for user root Jun 29 03:27:12 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf" returned: 0 in 1.071s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:27:12 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:27:12 devstack cinder-volume[93468]: DEBUG oslo_service.periodic_task [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Running periodic task VolumeManager._thread_info {{(pid=93468) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 29 03:27:12 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] thread count: 28 {{(pid=93468) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 29 03:27:12 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] thread info: [<_MainThread(MainThread, started 132331377287296)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93468) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 29 03:27:13 devstack sudo[101483]: pam_unix(sudo:session): session closed for user root Jun 29 03:27:13 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-3d89322f-58e9-4114-8c72-a6f71b222efd tempest-GroupSnapshotsTest-1771286532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-eb9611a2-76a1-42e9-8e9a-2827c5675094.a3c57d7d-03ef-4449-adff-faa5b577afd9" returned: 0 in 1.191s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:27:13 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-3d89322f-58e9-4114-8c72-a6f71b222efd tempest-GroupSnapshotsTest-1771286532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-eb9611a2-76a1-42e9-8e9a-2827c5675094.a3c57d7d-03ef-4449-adff-faa5b577afd9 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:27:13 devstack sudo[101509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-eb9611a2-76a1-42e9-8e9a-2827c5675094.a3c57d7d-03ef-4449-adff-faa5b577afd9 Jun 29 03:27:13 devstack sudo[101509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:27:13 devstack sudo[101497]: pam_unix(sudo:session): session closed for user root Jun 29 03:27:13 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b386741d-a8a3-4570-80f5-a3b8c89d1693 tempest-VolumesImageMetadata-1988334519 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_24cf6ce1-1d2d-493f-a115-2a39928c82fb_55oewtnrdevstack@QuobyteHD" returned: 0 in 0.894s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:27:13 devstack cinder-volume[93468]: DEBUG cinder.image.image_utils [None req-b386741d-a8a3-4570-80f5-a3b8c89d1693 tempest-VolumesImageMetadata-1988334519 None] 24cf6ce1-1d2d-493f-a115-2a39928c82fb was qcow2, converting to raw {{(pid=93468) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 29 03:27:13 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b386741d-a8a3-4570-80f5-a3b8c89d1693 tempest-VolumesImageMetadata-1988334519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_24cf6ce1-1d2d-493f-a115-2a39928c82fb_55oewtnrdevstack@QuobyteHD /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-0c9a8cce-8378-4c7a-a3dc-a82599771a30 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:27:13 devstack sudo[101513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_24cf6ce1-1d2d-493f-a115-2a39928c82fb_55oewtnrdevstack@QuobyteHD /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-0c9a8cce-8378-4c7a-a3dc-a82599771a30 Jun 29 03:27:13 devstack sudo[101513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:27:14 devstack sudo[101509]: pam_unix(sudo:session): session closed for user root Jun 29 03:27:14 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-3d89322f-58e9-4114-8c72-a6f71b222efd tempest-GroupSnapshotsTest-1771286532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-eb9611a2-76a1-42e9-8e9a-2827c5675094.a3c57d7d-03ef-4449-adff-faa5b577afd9" returned: 0 in 0.846s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:27:14 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-3d89322f-58e9-4114-8c72-a6f71b222efd tempest-GroupSnapshotsTest-1771286532 None] Lock "cinder-quobyte-a3c57d7d-03ef-4449-adff-faa5b577afd9" released by "_delete_snapshot" :: held 5.318s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:27:14 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-3d89322f-58e9-4114-8c72-a6f71b222efd tempest-GroupSnapshotsTest-1771286532 None] Lock "cinder-quobyte-eb9611a2-76a1-42e9-8e9a-2827c5675094" released by "delete_snapshot" :: held 5.387s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:27:14 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-3d89322f-58e9-4114-8c72-a6f71b222efd tempest-GroupSnapshotsTest-1771286532 None] Acquiring lock "cinder-quobyte-927e590e-ff80-4342-be46-8d91284ec972" by "delete_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:27:14 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-3d89322f-58e9-4114-8c72-a6f71b222efd tempest-GroupSnapshotsTest-1771286532 None] Lock "cinder-quobyte-927e590e-ff80-4342-be46-8d91284ec972" acquired by "delete_snapshot" :: waited 0.017s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:27:14 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-3d89322f-58e9-4114-8c72-a6f71b222efd tempest-GroupSnapshotsTest-1771286532 None] Acquiring lock "cinder-quobyte-e0b70a18-5e8f-408c-9c02-212ceb70e9a2" by "_delete_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:27:14 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-3d89322f-58e9-4114-8c72-a6f71b222efd tempest-GroupSnapshotsTest-1771286532 None] Lock "cinder-quobyte-e0b70a18-5e8f-408c-9c02-212ceb70e9a2" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:27:14 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-3d89322f-58e9-4114-8c72-a6f71b222efd tempest-GroupSnapshotsTest-1771286532 None] Deleting offline snapshot e0b70a18-5e8f-408c-9c02-212ceb70e9a2 of volume 927e590e-ff80-4342-be46-8d91284ec972 {{(pid=93468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 29 03:27:14 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-3d89322f-58e9-4114-8c72-a6f71b222efd tempest-GroupSnapshotsTest-1771286532 None] snapshot_file for this snap is: volume-927e590e-ff80-4342-be46-8d91284ec972.e0b70a18-5e8f-408c-9c02-212ceb70e9a2 {{(pid=93468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 29 03:27:14 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[2708e2a9-5cbc-40a0-86ec-5690482d48fb]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:27:14 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-3d89322f-58e9-4114-8c72-a6f71b222efd tempest-GroupSnapshotsTest-1771286532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-927e590e-ff80-4342-be46-8d91284ec972.e0b70a18-5e8f-408c-9c02-212ceb70e9a2 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:27:14 devstack sudo[101530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-927e590e-ff80-4342-be46-8d91284ec972.e0b70a18-5e8f-408c-9c02-212ceb70e9a2 Jun 29 03:27:14 devstack sudo[101530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:27:14 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-61469f32-267f-4649-959e-d6f15541e983 tempest-AttachVolumeNegativeTest-1677376095 None] Acquiring lock "cinder-0c614786-b5cf-47b4-944f-a5fe920d198c-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:27:14 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-61469f32-267f-4649-959e-d6f15541e983 tempest-AttachVolumeNegativeTest-1677376095 None] Lock "cinder-0c614786-b5cf-47b4-944f-a5fe920d198c-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:27:14 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-61469f32-267f-4649-959e-d6f15541e983 tempest-AttachVolumeNegativeTest-1677376095 None] Acquiring lock "cinder-quobyte-0c614786-b5cf-47b4-944f-a5fe920d198c" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:27:14 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-61469f32-267f-4649-959e-d6f15541e983 tempest-AttachVolumeNegativeTest-1677376095 None] Lock "cinder-quobyte-0c614786-b5cf-47b4-944f-a5fe920d198c" acquired by "delete_volume" :: waited 0.023s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:27:14 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fa6c802-237f-48e2-8e22-91874ecefa25]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:27:14 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-61469f32-267f-4649-959e-d6f15541e983 tempest-AttachVolumeNegativeTest-1677376095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-0c614786-b5cf-47b4-944f-a5fe920d198c {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:27:14 devstack sudo[101532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-0c614786-b5cf-47b4-944f-a5fe920d198c Jun 29 03:27:14 devstack sudo[101532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:27:15 devstack sudo[101530]: pam_unix(sudo:session): session closed for user root Jun 29 03:27:15 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-3d89322f-58e9-4114-8c72-a6f71b222efd tempest-GroupSnapshotsTest-1771286532 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-927e590e-ff80-4342-be46-8d91284ec972.e0b70a18-5e8f-408c-9c02-212ceb70e9a2" returned: 0 in 1.008s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:27:15 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-3d89322f-58e9-4114-8c72-a6f71b222efd tempest-GroupSnapshotsTest-1771286532 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-927e590e-ff80-4342-be46-8d91284ec972(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93468) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 29 03:27:15 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cde0736-5e30-443f-86a5-bdc957ad22ee]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:27:15 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-3d89322f-58e9-4114-8c72-a6f71b222efd tempest-GroupSnapshotsTest-1771286532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-927e590e-ff80-4342-be46-8d91284ec972 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:27:15 devstack sudo[101537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-927e590e-ff80-4342-be46-8d91284ec972 Jun 29 03:27:15 devstack sudo[101537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:27:15 devstack sudo[101532]: pam_unix(sudo:session): session closed for user root Jun 29 03:27:15 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-61469f32-267f-4649-959e-d6f15541e983 tempest-AttachVolumeNegativeTest-1677376095 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-0c614786-b5cf-47b4-944f-a5fe920d198c" returned: 0 in 0.895s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:27:15 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-61469f32-267f-4649-959e-d6f15541e983 tempest-AttachVolumeNegativeTest-1677376095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-0c614786-b5cf-47b4-944f-a5fe920d198c {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:27:15 devstack sudo[101542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-0c614786-b5cf-47b4-944f-a5fe920d198c Jun 29 03:27:15 devstack sudo[101542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:27:15 devstack sudo[101513]: pam_unix(sudo:session): session closed for user root Jun 29 03:27:15 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b386741d-a8a3-4570-80f5-a3b8c89d1693 tempest-VolumesImageMetadata-1988334519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_24cf6ce1-1d2d-493f-a115-2a39928c82fb_55oewtnrdevstack@QuobyteHD /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-0c9a8cce-8378-4c7a-a3dc-a82599771a30" returned: 0 in 2.445s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:27:15 devstack cinder-volume[93468]: DEBUG cinder.image.image_utils [None req-b386741d-a8a3-4570-80f5-a3b8c89d1693 tempest-VolumesImageMetadata-1988334519 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_24cf6ce1-1d2d-493f-a115-2a39928c82fb_55oewtnrdevstack@QuobyteHD, size 112.00 MB, duration 2.45 sec, destination /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-0c9a8cce-8378-4c7a-a3dc-a82599771a30 {{(pid=93468) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 29 03:27:15 devstack cinder-volume[93468]: INFO cinder.image.image_utils [None req-b386741d-a8a3-4570-80f5-a3b8c89d1693 tempest-VolumesImageMetadata-1988334519 None] Converted 112.00 MB image at 45.77 MB/s Jun 29 03:27:15 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b386741d-a8a3-4570-80f5-a3b8c89d1693 tempest-VolumesImageMetadata-1988334519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-0c9a8cce-8378-4c7a-a3dc-a82599771a30 1G {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:27:16 devstack sudo[101544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-0c9a8cce-8378-4c7a-a3dc-a82599771a30 1G Jun 29 03:27:16 devstack sudo[101544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:27:16 devstack sudo[101537]: pam_unix(sudo:session): session closed for user root Jun 29 03:27:16 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-3d89322f-58e9-4114-8c72-a6f71b222efd tempest-GroupSnapshotsTest-1771286532 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-927e590e-ff80-4342-be46-8d91284ec972" returned: 0 in 0.954s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:27:16 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-3d89322f-58e9-4114-8c72-a6f71b222efd tempest-GroupSnapshotsTest-1771286532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-927e590e-ff80-4342-be46-8d91284ec972.e0b70a18-5e8f-408c-9c02-212ceb70e9a2 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:27:16 devstack sudo[101551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-927e590e-ff80-4342-be46-8d91284ec972.e0b70a18-5e8f-408c-9c02-212ceb70e9a2 Jun 29 03:27:16 devstack sudo[101551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:27:16 devstack sudo[101542]: pam_unix(sudo:session): session closed for user root Jun 29 03:27:16 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-61469f32-267f-4649-959e-d6f15541e983 tempest-AttachVolumeNegativeTest-1677376095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-0c614786-b5cf-47b4-944f-a5fe920d198c" returned: 0 in 0.746s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:27:16 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-61469f32-267f-4649-959e-d6f15541e983 tempest-AttachVolumeNegativeTest-1677376095 None] Lock "cinder-quobyte-0c614786-b5cf-47b4-944f-a5fe920d198c" released by "delete_volume" :: held 1.706s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:27:16 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-61469f32-267f-4649-959e-d6f15541e983 tempest-AttachVolumeNegativeTest-1677376095 None] Created reservations ['8c0cf409-d4ce-4d4f-a074-774e9595e3e8', '384e8807-958f-4f81-b9a0-947f38f70e76', '07093d5c-35aa-43b7-a25e-f0ed8117d596', '00b52906-d58b-4f0c-9d83-8e2c3b04fe59'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:27:16 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-61469f32-267f-4649-959e-d6f15541e983 tempest-AttachVolumeNegativeTest-1677376095 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:27:16 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-61469f32-267f-4649-959e-d6f15541e983 tempest-AttachVolumeNegativeTest-1677376095 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:27:16 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-61469f32-267f-4649-959e-d6f15541e983 tempest-AttachVolumeNegativeTest-1677376095 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:27:16 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-61469f32-267f-4649-959e-d6f15541e983 tempest-AttachVolumeNegativeTest-1677376095 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:27:16 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-61469f32-267f-4649-959e-d6f15541e983 tempest-AttachVolumeNegativeTest-1677376095 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:27:16 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-61469f32-267f-4649-959e-d6f15541e983 tempest-AttachVolumeNegativeTest-1677376095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:27:16 devstack sudo[101544]: pam_unix(sudo:session): session closed for user root Jun 29 03:27:16 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b386741d-a8a3-4570-80f5-a3b8c89d1693 tempest-VolumesImageMetadata-1988334519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-0c9a8cce-8378-4c7a-a3dc-a82599771a30 1G" returned: 0 in 0.779s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:27:16 devstack sudo[101562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf Jun 29 03:27:16 devstack sudo[101562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:27:16 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[713055cd-8d00-4817-848c-d076a49168fb]: (4, 'raw') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:27:16 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b386741d-a8a3-4570-80f5-a3b8c89d1693 tempest-VolumesImageMetadata-1988334519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-0c9a8cce-8378-4c7a-a3dc-a82599771a30 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:27:16 devstack sudo[101564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-0c9a8cce-8378-4c7a-a3dc-a82599771a30 Jun 29 03:27:16 devstack sudo[101564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:27:17 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-36f37e85-7410-475c-bb1b-09e452214844 tempest-AttachVolumeNegativeTest-1677376095 None] Acquiring lock "cinder-7395aef1-1102-446b-bae4-20b004eb5c30-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:27:17 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-36f37e85-7410-475c-bb1b-09e452214844 tempest-AttachVolumeNegativeTest-1677376095 None] Lock "cinder-7395aef1-1102-446b-bae4-20b004eb5c30-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:27:17 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-36f37e85-7410-475c-bb1b-09e452214844 tempest-AttachVolumeNegativeTest-1677376095 None] Acquiring lock "cinder-quobyte-7395aef1-1102-446b-bae4-20b004eb5c30" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:27:17 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-36f37e85-7410-475c-bb1b-09e452214844 tempest-AttachVolumeNegativeTest-1677376095 None] Lock "cinder-quobyte-7395aef1-1102-446b-bae4-20b004eb5c30" acquired by "delete_volume" :: waited 0.047s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:27:17 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[890d91d7-093e-42f2-84eb-166a64690647]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:27:17 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-36f37e85-7410-475c-bb1b-09e452214844 tempest-AttachVolumeNegativeTest-1677376095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-7395aef1-1102-446b-bae4-20b004eb5c30 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:27:17 devstack sudo[101551]: pam_unix(sudo:session): session closed for user root Jun 29 03:27:17 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-3d89322f-58e9-4114-8c72-a6f71b222efd tempest-GroupSnapshotsTest-1771286532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-927e590e-ff80-4342-be46-8d91284ec972.e0b70a18-5e8f-408c-9c02-212ceb70e9a2" returned: 0 in 1.013s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:27:17 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-3d89322f-58e9-4114-8c72-a6f71b222efd tempest-GroupSnapshotsTest-1771286532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-927e590e-ff80-4342-be46-8d91284ec972.e0b70a18-5e8f-408c-9c02-212ceb70e9a2 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:27:17 devstack sudo[101572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-927e590e-ff80-4342-be46-8d91284ec972.e0b70a18-5e8f-408c-9c02-212ceb70e9a2 Jun 29 03:27:17 devstack sudo[101572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:27:17 devstack sudo[101570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-7395aef1-1102-446b-bae4-20b004eb5c30 Jun 29 03:27:17 devstack sudo[101570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:27:17 devstack sudo[101562]: pam_unix(sudo:session): session closed for user root Jun 29 03:27:17 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-61469f32-267f-4649-959e-d6f15541e983 tempest-AttachVolumeNegativeTest-1677376095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf" returned: 0 in 0.815s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:27:17 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-61469f32-267f-4649-959e-d6f15541e983 tempest-AttachVolumeNegativeTest-1677376095 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:27:17 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-61469f32-267f-4649-959e-d6f15541e983 tempest-AttachVolumeNegativeTest-1677376095 None] Deleted volume successfully. Jun 29 03:27:17 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-61469f32-267f-4649-959e-d6f15541e983 tempest-AttachVolumeNegativeTest-1677376095 None] Lock "cinder-0c614786-b5cf-47b4-944f-a5fe920d198c-delete_volume" released by "delete_volume" :: held 2.854s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:27:17 devstack sudo[101564]: pam_unix(sudo:session): session closed for user root Jun 29 03:27:17 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b386741d-a8a3-4570-80f5-a3b8c89d1693 tempest-VolumesImageMetadata-1988334519 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-0c9a8cce-8378-4c7a-a3dc-a82599771a30" returned: 0 in 1.070s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:27:17 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b386741d-a8a3-4570-80f5-a3b8c89d1693 tempest-VolumesImageMetadata-1988334519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-0c9a8cce-8378-4c7a-a3dc-a82599771a30 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:27:18 devstack sudo[101577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-0c9a8cce-8378-4c7a-a3dc-a82599771a30 Jun 29 03:27:18 devstack sudo[101577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:27:18 devstack sudo[101572]: pam_unix(sudo:session): session closed for user root Jun 29 03:27:18 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-3d89322f-58e9-4114-8c72-a6f71b222efd tempest-GroupSnapshotsTest-1771286532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-927e590e-ff80-4342-be46-8d91284ec972.e0b70a18-5e8f-408c-9c02-212ceb70e9a2" returned: 0 in 0.867s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:27:18 devstack sudo[101570]: pam_unix(sudo:session): session closed for user root Jun 29 03:27:18 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-36f37e85-7410-475c-bb1b-09e452214844 tempest-AttachVolumeNegativeTest-1677376095 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-7395aef1-1102-446b-bae4-20b004eb5c30" returned: 0 in 0.989s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:27:18 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-36f37e85-7410-475c-bb1b-09e452214844 tempest-AttachVolumeNegativeTest-1677376095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-7395aef1-1102-446b-bae4-20b004eb5c30 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:27:18 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-3d89322f-58e9-4114-8c72-a6f71b222efd tempest-GroupSnapshotsTest-1771286532 None] Lock "cinder-quobyte-e0b70a18-5e8f-408c-9c02-212ceb70e9a2" released by "_delete_snapshot" :: held 4.055s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:27:18 devstack sudo[101587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-7395aef1-1102-446b-bae4-20b004eb5c30 Jun 29 03:27:18 devstack sudo[101587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:27:18 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-3d89322f-58e9-4114-8c72-a6f71b222efd tempest-GroupSnapshotsTest-1771286532 None] Lock "cinder-quobyte-927e590e-ff80-4342-be46-8d91284ec972" released by "delete_snapshot" :: held 4.105s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:27:18 devstack cinder-volume[93468]: WARNING cinder.quota [None req-3d89322f-58e9-4114-8c72-a6f71b222efd tempest-GroupSnapshotsTest-1771286532 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1531456762 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1531456762, it is now deprecated. Please use the default quota class for default quota. Jun 29 03:27:18 devstack cinder-volume[93468]: WARNING cinder.quota [None req-3d89322f-58e9-4114-8c72-a6f71b222efd tempest-GroupSnapshotsTest-1771286532 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1531456762 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1531456762, it is now deprecated. Please use the default quota class for default quota. Jun 29 03:27:18 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-3d89322f-58e9-4114-8c72-a6f71b222efd tempest-GroupSnapshotsTest-1771286532 None] Created reservations ['766328ee-8782-45d9-ad95-09056a5854c4', '34b7291f-85ef-48bb-85d6-bb8da9ca7e7f', '4177e4a8-c60d-4545-9cc6-bd375e12e7c5', 'eef0c0c5-b8e8-4951-83d7-4d264a67e5db'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:27:18 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-3d89322f-58e9-4114-8c72-a6f71b222efd tempest-GroupSnapshotsTest-1771286532 None] Created reservations ['e44b1d21-4224-49d9-902a-49b56f08a4c2', '82f37c31-acc3-4052-8268-9a2ed8fefc53', '600330fb-bb20-4643-83c7-32b5beea77c2', '297a8485-3f78-4c2f-ade1-4f058179fa86'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:27:18 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-3d89322f-58e9-4114-8c72-a6f71b222efd tempest-GroupSnapshotsTest-1771286532 None] group_snapshot 90e79657-6de8-470a-a2cd-30ccf469c8c7: deleted successfully Jun 29 03:27:19 devstack sudo[101577]: pam_unix(sudo:session): session closed for user root Jun 29 03:27:19 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b386741d-a8a3-4570-80f5-a3b8c89d1693 tempest-VolumesImageMetadata-1988334519 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-0c9a8cce-8378-4c7a-a3dc-a82599771a30" returned: 1 in 1.251s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:27:19 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b386741d-a8a3-4570-80f5-a3b8c89d1693 tempest-VolumesImageMetadata-1988334519 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-0c9a8cce-8378-4c7a-a3dc-a82599771a30' failed. Not Retrying. {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 29 03:27:19 devstack cinder-volume[93468]: DEBUG cinder.volume.volume_utils [None req-b386741d-a8a3-4570-80f5-a3b8c89d1693 tempest-VolumesImageMetadata-1988334519 None] Downloaded image 24cf6ce1-1d2d-493f-a115-2a39928c82fb ((None, [{'url': 'file:///opt/stack/data/glance/images/24cf6ce1-1d2d-493f-a115-2a39928c82fb', 'metadata': {}}])) to volume 0c9a8cce-8378-4c7a-a3dc-a82599771a30 successfully. {{(pid=93468) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 29 03:27:19 devstack cinder-volume[93468]: DEBUG cinder.image.image_utils [None req-b386741d-a8a3-4570-80f5-a3b8c89d1693 tempest-VolumesImageMetadata-1988334519 None] Temporary image 24cf6ce1-1d2d-493f-a115-2a39928c82fb for user 711521c383b04c2ba703bcd5a74d6e5e is deleted. {{(pid=93468) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 29 03:27:19 devstack cinder-volume[93468]: DEBUG cinder.volume.volume_utils [None req-b386741d-a8a3-4570-80f5-a3b8c89d1693 tempest-VolumesImageMetadata-1988334519 None] Marking volume 0c9a8cce-8378-4c7a-a3dc-a82599771a30 as bootable. {{(pid=93468) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 29 03:27:19 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-b386741d-a8a3-4570-80f5-a3b8c89d1693 tempest-VolumesImageMetadata-1988334519 None] Copying metadata from image 24cf6ce1-1d2d-493f-a115-2a39928c82fb to 0c9a8cce-8378-4c7a-a3dc-a82599771a30. {{(pid=93468) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 29 03:27:19 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-b386741d-a8a3-4570-80f5-a3b8c89d1693 tempest-VolumesImageMetadata-1988334519 None] Creating volume glance metadata for volume 0c9a8cce-8378-4c7a-a3dc-a82599771a30 backed by image 24cf6ce1-1d2d-493f-a115-2a39928c82fb with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '24cf6ce1-1d2d-493f-a115-2a39928c82fb', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=93468) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 29 03:27:19 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-b386741d-a8a3-4570-80f5-a3b8c89d1693 tempest-VolumesImageMetadata-1988334519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b26ba6e-9866-46e8-a3be-7d0173bbda82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c9a8cce-8378-4c7a-a3dc-a82599771a30', 'volume_size': 1, 'image_id': '24cf6ce1-1d2d-493f-a115-2a39928c82fb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/24cf6ce1-1d2d-493f-a115-2a39928c82fb', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1335b5873eea4762b9fea7f84dd1615c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '24cf6ce1-1d2d-493f-a115-2a39928c82fb', 'created_at': datetime.datetime(2026, 6, 29, 1, 13, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 29, 1, 13, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/24cf6ce1-1d2d-493f-a115-2a39928c82fb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:27:19 devstack sudo[101587]: pam_unix(sudo:session): session closed for user root Jun 29 03:27:19 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-b386741d-a8a3-4570-80f5-a3b8c89d1693 tempest-VolumesImageMetadata-1988334519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c27a4a9b-71ac-417e-8030-06e7bb5f49b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:27:19 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-36f37e85-7410-475c-bb1b-09e452214844 tempest-AttachVolumeNegativeTest-1677376095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-7395aef1-1102-446b-bae4-20b004eb5c30" returned: 0 in 1.207s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:27:19 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-36f37e85-7410-475c-bb1b-09e452214844 tempest-AttachVolumeNegativeTest-1677376095 None] Lock "cinder-quobyte-7395aef1-1102-446b-bae4-20b004eb5c30" released by "delete_volume" :: held 2.325s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:27:19 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-b386741d-a8a3-4570-80f5-a3b8c89d1693 tempest-VolumesImageMetadata-1988334519 None] Volume volume-0c9a8cce-8378-4c7a-a3dc-a82599771a30 (0c9a8cce-8378-4c7a-a3dc-a82599771a30): created successfully Jun 29 03:27:19 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-b386741d-a8a3-4570-80f5-a3b8c89d1693 tempest-VolumesImageMetadata-1988334519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c27a4a9b-71ac-417e-8030-06e7bb5f49b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:27:19 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-b386741d-a8a3-4570-80f5-a3b8c89d1693 tempest-VolumesImageMetadata-1988334519 None] Flow 'volume_create_manager' (89cc8039-2df8-4949-be3b-1715fa27c843) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:27:19 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-b386741d-a8a3-4570-80f5-a3b8c89d1693 tempest-VolumesImageMetadata-1988334519 None] Created volume successfully. Jun 29 03:27:19 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-36f37e85-7410-475c-bb1b-09e452214844 tempest-AttachVolumeNegativeTest-1677376095 None] Created reservations ['7c1101a3-f17d-46cb-ac18-18f978a2716b', '465f96ab-79b4-48df-9f82-78b1fb310cf1', '3347339d-b41c-4c9c-88a2-a8434b26ed31', 'ce7a94a3-acf5-4fe9-a07f-f1942e89520c'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:27:19 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-36f37e85-7410-475c-bb1b-09e452214844 tempest-AttachVolumeNegativeTest-1677376095 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:27:19 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-36f37e85-7410-475c-bb1b-09e452214844 tempest-AttachVolumeNegativeTest-1677376095 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:27:19 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-36f37e85-7410-475c-bb1b-09e452214844 tempest-AttachVolumeNegativeTest-1677376095 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:27:19 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-36f37e85-7410-475c-bb1b-09e452214844 tempest-AttachVolumeNegativeTest-1677376095 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:27:19 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-36f37e85-7410-475c-bb1b-09e452214844 tempest-AttachVolumeNegativeTest-1677376095 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:27:19 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-36f37e85-7410-475c-bb1b-09e452214844 tempest-AttachVolumeNegativeTest-1677376095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:27:19 devstack sudo[101643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf Jun 29 03:27:19 devstack sudo[101643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:27:20 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-467a1cb7-288b-4781-9fb3-1e0fb705fe97 tempest-GroupSnapshotsTest-1771286532 None] Acquiring lock "cinder-quobyte-927e590e-ff80-4342-be46-8d91284ec972" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:27:20 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-467a1cb7-288b-4781-9fb3-1e0fb705fe97 tempest-GroupSnapshotsTest-1771286532 None] Lock "cinder-quobyte-927e590e-ff80-4342-be46-8d91284ec972" acquired by "delete_volume" :: waited 0.030s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:27:20 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd88f504-aa8f-449c-a923-883b05e14f70]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:27:20 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-467a1cb7-288b-4781-9fb3-1e0fb705fe97 tempest-GroupSnapshotsTest-1771286532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-927e590e-ff80-4342-be46-8d91284ec972 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:27:20 devstack sudo[101645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-927e590e-ff80-4342-be46-8d91284ec972 Jun 29 03:27:20 devstack sudo[101645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:27:21 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-1ea6f523-e2c8-4b42-98d5-782456b26d09 tempest-VolumesImageMetadata-1988334519 None] Acquiring lock "cinder-0c9a8cce-8378-4c7a-a3dc-a82599771a30-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:27:21 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-1ea6f523-e2c8-4b42-98d5-782456b26d09 tempest-VolumesImageMetadata-1988334519 None] Lock "cinder-0c9a8cce-8378-4c7a-a3dc-a82599771a30-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:27:21 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-c264dd63-0076-4921-9a18-f74267844356 tempest-AttachVolumeNegativeTest-1677376095 None] Acquiring lock "cinder-87e0d255-c9c7-4f0b-a7bc-bf7f83fcbc8a-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:27:21 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-c264dd63-0076-4921-9a18-f74267844356 tempest-AttachVolumeNegativeTest-1677376095 None] Lock "cinder-87e0d255-c9c7-4f0b-a7bc-bf7f83fcbc8a-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:27:21 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-1ea6f523-e2c8-4b42-98d5-782456b26d09 tempest-VolumesImageMetadata-1988334519 None] Acquiring lock "cinder-quobyte-0c9a8cce-8378-4c7a-a3dc-a82599771a30" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:27:21 devstack sudo[101643]: pam_unix(sudo:session): session closed for user root Jun 29 03:27:21 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-36f37e85-7410-475c-bb1b-09e452214844 tempest-AttachVolumeNegativeTest-1677376095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf" returned: 0 in 1.289s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:27:21 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-36f37e85-7410-475c-bb1b-09e452214844 tempest-AttachVolumeNegativeTest-1677376095 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:27:21 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-36f37e85-7410-475c-bb1b-09e452214844 tempest-AttachVolumeNegativeTest-1677376095 None] Deleted volume successfully. Jun 29 03:27:21 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-1ea6f523-e2c8-4b42-98d5-782456b26d09 tempest-VolumesImageMetadata-1988334519 None] Lock "cinder-quobyte-0c9a8cce-8378-4c7a-a3dc-a82599771a30" acquired by "delete_volume" :: waited 0.054s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:27:21 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-36f37e85-7410-475c-bb1b-09e452214844 tempest-AttachVolumeNegativeTest-1677376095 None] Lock "cinder-7395aef1-1102-446b-bae4-20b004eb5c30-delete_volume" released by "delete_volume" :: held 4.072s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:27:21 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-c264dd63-0076-4921-9a18-f74267844356 tempest-AttachVolumeNegativeTest-1677376095 None] Acquiring lock "cinder-quobyte-87e0d255-c9c7-4f0b-a7bc-bf7f83fcbc8a" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:27:21 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-c264dd63-0076-4921-9a18-f74267844356 tempest-AttachVolumeNegativeTest-1677376095 None] Lock "cinder-quobyte-87e0d255-c9c7-4f0b-a7bc-bf7f83fcbc8a" acquired by "delete_volume" :: waited 0.024s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:27:21 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[729ddc96-9d78-4906-95b6-984b392cbb06]: (4, 'raw') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:27:21 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-1ea6f523-e2c8-4b42-98d5-782456b26d09 tempest-VolumesImageMetadata-1988334519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-0c9a8cce-8378-4c7a-a3dc-a82599771a30 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:27:21 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[24d1dd78-da62-48a7-85ae-790ce9ecaae6]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:27:21 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c264dd63-0076-4921-9a18-f74267844356 tempest-AttachVolumeNegativeTest-1677376095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-87e0d255-c9c7-4f0b-a7bc-bf7f83fcbc8a {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:27:21 devstack sudo[101652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-0c9a8cce-8378-4c7a-a3dc-a82599771a30 Jun 29 03:27:21 devstack sudo[101652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:27:21 devstack sudo[101653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-87e0d255-c9c7-4f0b-a7bc-bf7f83fcbc8a Jun 29 03:27:21 devstack sudo[101653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:27:21 devstack sudo[101645]: pam_unix(sudo:session): session closed for user root Jun 29 03:27:21 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-467a1cb7-288b-4781-9fb3-1e0fb705fe97 tempest-GroupSnapshotsTest-1771286532 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-927e590e-ff80-4342-be46-8d91284ec972" returned: 0 in 1.424s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:27:21 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-467a1cb7-288b-4781-9fb3-1e0fb705fe97 tempest-GroupSnapshotsTest-1771286532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-927e590e-ff80-4342-be46-8d91284ec972 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:27:21 devstack sudo[101659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-927e590e-ff80-4342-be46-8d91284ec972 Jun 29 03:27:21 devstack sudo[101659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:27:22 devstack sudo[101653]: pam_unix(sudo:session): session closed for user root Jun 29 03:27:22 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c264dd63-0076-4921-9a18-f74267844356 tempest-AttachVolumeNegativeTest-1677376095 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-87e0d255-c9c7-4f0b-a7bc-bf7f83fcbc8a" returned: 0 in 1.121s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:27:22 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c264dd63-0076-4921-9a18-f74267844356 tempest-AttachVolumeNegativeTest-1677376095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-87e0d255-c9c7-4f0b-a7bc-bf7f83fcbc8a {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:27:22 devstack sudo[101665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-87e0d255-c9c7-4f0b-a7bc-bf7f83fcbc8a Jun 29 03:27:22 devstack sudo[101665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:27:22 devstack sudo[101652]: pam_unix(sudo:session): session closed for user root Jun 29 03:27:22 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-1ea6f523-e2c8-4b42-98d5-782456b26d09 tempest-VolumesImageMetadata-1988334519 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-0c9a8cce-8378-4c7a-a3dc-a82599771a30" returned: 0 in 1.601s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:27:22 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-1ea6f523-e2c8-4b42-98d5-782456b26d09 tempest-VolumesImageMetadata-1988334519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-0c9a8cce-8378-4c7a-a3dc-a82599771a30 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:27:23 devstack sudo[101659]: pam_unix(sudo:session): session closed for user root Jun 29 03:27:23 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-467a1cb7-288b-4781-9fb3-1e0fb705fe97 tempest-GroupSnapshotsTest-1771286532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-927e590e-ff80-4342-be46-8d91284ec972" returned: 0 in 1.419s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:27:23 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-467a1cb7-288b-4781-9fb3-1e0fb705fe97 tempest-GroupSnapshotsTest-1771286532 None] Lock "cinder-quobyte-927e590e-ff80-4342-be46-8d91284ec972" released by "delete_volume" :: held 2.986s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:27:23 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-467a1cb7-288b-4781-9fb3-1e0fb705fe97 tempest-GroupSnapshotsTest-1771286532 None] Acquiring lock "cinder-quobyte-eb9611a2-76a1-42e9-8e9a-2827c5675094" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:27:23 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-467a1cb7-288b-4781-9fb3-1e0fb705fe97 tempest-GroupSnapshotsTest-1771286532 None] Lock "cinder-quobyte-eb9611a2-76a1-42e9-8e9a-2827c5675094" acquired by "delete_volume" :: waited 0.020s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:27:23 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[be808478-83b4-46c0-afd8-7d8d3ca1c6e6]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:27:23 devstack sudo[101670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-0c9a8cce-8378-4c7a-a3dc-a82599771a30 Jun 29 03:27:23 devstack sudo[101670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:27:23 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-467a1cb7-288b-4781-9fb3-1e0fb705fe97 tempest-GroupSnapshotsTest-1771286532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-eb9611a2-76a1-42e9-8e9a-2827c5675094 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:27:23 devstack sudo[101672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-eb9611a2-76a1-42e9-8e9a-2827c5675094 Jun 29 03:27:23 devstack sudo[101672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:27:23 devstack sudo[101665]: pam_unix(sudo:session): session closed for user root Jun 29 03:27:23 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c264dd63-0076-4921-9a18-f74267844356 tempest-AttachVolumeNegativeTest-1677376095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-87e0d255-c9c7-4f0b-a7bc-bf7f83fcbc8a" returned: 0 in 1.010s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:27:23 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-c264dd63-0076-4921-9a18-f74267844356 tempest-AttachVolumeNegativeTest-1677376095 None] Lock "cinder-quobyte-87e0d255-c9c7-4f0b-a7bc-bf7f83fcbc8a" released by "delete_volume" :: held 2.217s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:27:23 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-c264dd63-0076-4921-9a18-f74267844356 tempest-AttachVolumeNegativeTest-1677376095 None] Created reservations ['eb5fb40f-7c0c-4c15-b83c-d89a3b04d170', '96f7d1fd-8f73-46b0-a4dd-0b573ddd982d', '36e3a733-c674-4d3a-ae65-15e4ce4cb356', 'fb17271c-2494-4e25-a72c-7df33aad90e6'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:27:23 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-c264dd63-0076-4921-9a18-f74267844356 tempest-AttachVolumeNegativeTest-1677376095 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:27:23 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-c264dd63-0076-4921-9a18-f74267844356 tempest-AttachVolumeNegativeTest-1677376095 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:27:23 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-c264dd63-0076-4921-9a18-f74267844356 tempest-AttachVolumeNegativeTest-1677376095 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:27:23 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-c264dd63-0076-4921-9a18-f74267844356 tempest-AttachVolumeNegativeTest-1677376095 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:27:23 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-c264dd63-0076-4921-9a18-f74267844356 tempest-AttachVolumeNegativeTest-1677376095 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:27:23 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c264dd63-0076-4921-9a18-f74267844356 tempest-AttachVolumeNegativeTest-1677376095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:27:23 devstack sudo[101675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf Jun 29 03:27:23 devstack sudo[101675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:27:24 devstack sudo[101670]: pam_unix(sudo:session): session closed for user root Jun 29 03:27:24 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-1ea6f523-e2c8-4b42-98d5-782456b26d09 tempest-VolumesImageMetadata-1988334519 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-0c9a8cce-8378-4c7a-a3dc-a82599771a30" returned: 1 in 1.302s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:27:24 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-1ea6f523-e2c8-4b42-98d5-782456b26d09 tempest-VolumesImageMetadata-1988334519 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-0c9a8cce-8378-4c7a-a3dc-a82599771a30' failed. Not Retrying. {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 29 03:27:24 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-1ea6f523-e2c8-4b42-98d5-782456b26d09 tempest-VolumesImageMetadata-1988334519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-0c9a8cce-8378-4c7a-a3dc-a82599771a30 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:27:24 devstack sudo[101684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-0c9a8cce-8378-4c7a-a3dc-a82599771a30 Jun 29 03:27:24 devstack sudo[101684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:27:24 devstack sudo[101672]: pam_unix(sudo:session): session closed for user root Jun 29 03:27:24 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-467a1cb7-288b-4781-9fb3-1e0fb705fe97 tempest-GroupSnapshotsTest-1771286532 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-eb9611a2-76a1-42e9-8e9a-2827c5675094" returned: 0 in 1.389s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:27:24 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-467a1cb7-288b-4781-9fb3-1e0fb705fe97 tempest-GroupSnapshotsTest-1771286532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-eb9611a2-76a1-42e9-8e9a-2827c5675094 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:27:24 devstack sudo[101692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-eb9611a2-76a1-42e9-8e9a-2827c5675094 Jun 29 03:27:24 devstack sudo[101692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:27:25 devstack sudo[101675]: pam_unix(sudo:session): session closed for user root Jun 29 03:27:25 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c264dd63-0076-4921-9a18-f74267844356 tempest-AttachVolumeNegativeTest-1677376095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf" returned: 0 in 1.162s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:27:25 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-c264dd63-0076-4921-9a18-f74267844356 tempest-AttachVolumeNegativeTest-1677376095 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:27:25 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-c264dd63-0076-4921-9a18-f74267844356 tempest-AttachVolumeNegativeTest-1677376095 None] Deleted volume successfully. Jun 29 03:27:25 devstack cinder-volume[93468]: DEBUG dbcounter [-] [93468] Writing DB stats cinder:SELECT=116,cinder:UPDATE=105,cinder:INSERT=29,cinder:DELETE=7 {{(pid=93468) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 29 03:27:25 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-c264dd63-0076-4921-9a18-f74267844356 tempest-AttachVolumeNegativeTest-1677376095 None] Lock "cinder-87e0d255-c9c7-4f0b-a7bc-bf7f83fcbc8a-delete_volume" released by "delete_volume" :: held 3.926s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:27:25 devstack sudo[101684]: pam_unix(sudo:session): session closed for user root Jun 29 03:27:25 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-1ea6f523-e2c8-4b42-98d5-782456b26d09 tempest-VolumesImageMetadata-1988334519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-0c9a8cce-8378-4c7a-a3dc-a82599771a30" returned: 0 in 1.188s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:27:25 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-1ea6f523-e2c8-4b42-98d5-782456b26d09 tempest-VolumesImageMetadata-1988334519 None] Lock "cinder-quobyte-0c9a8cce-8378-4c7a-a3dc-a82599771a30" released by "delete_volume" :: held 4.220s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:27:25 devstack cinder-volume[93468]: DEBUG dbcounter [-] [93468] Writing DB stats cinder:UPDATE=110,cinder:SELECT=106,cinder:INSERT=34,cinder:DELETE=3 {{(pid=93468) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 29 03:27:25 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-1ea6f523-e2c8-4b42-98d5-782456b26d09 tempest-VolumesImageMetadata-1988334519 None] Created reservations ['f4b70ba5-313c-4077-925a-f665469c30d2', '22d6ae14-44ed-4a43-be10-c9137ee51cfe', 'e28830d8-9599-4adf-92a6-a5ae0de4174c', 'bf517b09-6610-4beb-ae87-145d147d252d'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:27:25 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-1ea6f523-e2c8-4b42-98d5-782456b26d09 tempest-VolumesImageMetadata-1988334519 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:27:25 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-1ea6f523-e2c8-4b42-98d5-782456b26d09 tempest-VolumesImageMetadata-1988334519 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:27:25 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-1ea6f523-e2c8-4b42-98d5-782456b26d09 tempest-VolumesImageMetadata-1988334519 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:27:25 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-1ea6f523-e2c8-4b42-98d5-782456b26d09 tempest-VolumesImageMetadata-1988334519 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:27:25 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-1ea6f523-e2c8-4b42-98d5-782456b26d09 tempest-VolumesImageMetadata-1988334519 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:27:25 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-1ea6f523-e2c8-4b42-98d5-782456b26d09 tempest-VolumesImageMetadata-1988334519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:27:25 devstack sudo[101692]: pam_unix(sudo:session): session closed for user root Jun 29 03:27:25 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-467a1cb7-288b-4781-9fb3-1e0fb705fe97 tempest-GroupSnapshotsTest-1771286532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-eb9611a2-76a1-42e9-8e9a-2827c5675094" returned: 0 in 1.211s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:27:25 devstack sudo[101716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf Jun 29 03:27:25 devstack sudo[101716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:27:25 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-467a1cb7-288b-4781-9fb3-1e0fb705fe97 tempest-GroupSnapshotsTest-1771286532 None] Lock "cinder-quobyte-eb9611a2-76a1-42e9-8e9a-2827c5675094" released by "delete_volume" :: held 2.699s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:27:25 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-467a1cb7-288b-4781-9fb3-1e0fb705fe97 tempest-GroupSnapshotsTest-1771286532 None] Created reservations ['99b203c5-77da-40e6-ab0e-4c023c4e0140'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:27:25 devstack cinder-volume[93468]: WARNING cinder.quota [None req-467a1cb7-288b-4781-9fb3-1e0fb705fe97 tempest-GroupSnapshotsTest-1771286532 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1531456762 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1531456762, it is now deprecated. Please use the default quota class for default quota. Jun 29 03:27:25 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-467a1cb7-288b-4781-9fb3-1e0fb705fe97 tempest-GroupSnapshotsTest-1771286532 None] Created reservations ['8c5cfa1c-cf5b-4e44-a08c-4a0e2fac825b', '5aa1baa2-6f22-4cac-ba67-b9e2d865e7d5', '452f4143-5a01-4d37-b72d-a3fa8ca00b67', '4d22fc28-35da-4d5c-8762-f345415cbf6c'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:27:26 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-467a1cb7-288b-4781-9fb3-1e0fb705fe97 tempest-GroupSnapshotsTest-1771286532 None] Created reservations ['81f2616e-d099-47ad-8368-9597da9cfe3d', '3a9ae995-b53e-4ebf-845b-1c21f06c4afa', '5f43dee3-c903-4683-a182-b49f7cff880f', '62c15825-2fd0-4be3-85ed-1ab61686a680'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:27:26 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-467a1cb7-288b-4781-9fb3-1e0fb705fe97 tempest-GroupSnapshotsTest-1771286532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:27:26 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-467a1cb7-288b-4781-9fb3-1e0fb705fe97 tempest-GroupSnapshotsTest-1771286532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:27:26 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-467a1cb7-288b-4781-9fb3-1e0fb705fe97 tempest-GroupSnapshotsTest-1771286532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:27:26 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-467a1cb7-288b-4781-9fb3-1e0fb705fe97 tempest-GroupSnapshotsTest-1771286532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:27:26 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-467a1cb7-288b-4781-9fb3-1e0fb705fe97 tempest-GroupSnapshotsTest-1771286532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:27:26 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-467a1cb7-288b-4781-9fb3-1e0fb705fe97 tempest-GroupSnapshotsTest-1771286532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:27:26 devstack sudo[101738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf Jun 29 03:27:26 devstack sudo[101738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:27:26 devstack sudo[101716]: pam_unix(sudo:session): session closed for user root Jun 29 03:27:26 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-1ea6f523-e2c8-4b42-98d5-782456b26d09 tempest-VolumesImageMetadata-1988334519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf" returned: 0 in 1.002s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:27:26 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-1ea6f523-e2c8-4b42-98d5-782456b26d09 tempest-VolumesImageMetadata-1988334519 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:27:26 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-1ea6f523-e2c8-4b42-98d5-782456b26d09 tempest-VolumesImageMetadata-1988334519 None] Deleted volume successfully. Jun 29 03:27:26 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-1ea6f523-e2c8-4b42-98d5-782456b26d09 tempest-VolumesImageMetadata-1988334519 None] Lock "cinder-0c9a8cce-8378-4c7a-a3dc-a82599771a30-delete_volume" released by "delete_volume" :: held 5.616s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:27:27 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-16c7cf38-8771-4fb9-abd2-f52f99acad5e tempest-GroupSnapshotsTest-1771286532 None] Group tempest-GroupSnapshotsTest-Group-1633989060: creating Jun 29 03:27:27 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-16c7cf38-8771-4fb9-abd2-f52f99acad5e tempest-GroupSnapshotsTest-1771286532 None] Group tempest-GroupSnapshotsTest-Group-1633989060: created successfully Jun 29 03:27:27 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-16c7cf38-8771-4fb9-abd2-f52f99acad5e tempest-GroupSnapshotsTest-1771286532 None] Create group completed successfully. Jun 29 03:27:27 devstack sudo[101738]: pam_unix(sudo:session): session closed for user root Jun 29 03:27:27 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-467a1cb7-288b-4781-9fb3-1e0fb705fe97 tempest-GroupSnapshotsTest-1771286532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf" returned: 0 in 1.146s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:27:27 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-467a1cb7-288b-4781-9fb3-1e0fb705fe97 tempest-GroupSnapshotsTest-1771286532 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:27:27 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-467a1cb7-288b-4781-9fb3-1e0fb705fe97 tempest-GroupSnapshotsTest-1771286532 None] Delete group completed successfully. Jun 29 03:27:29 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-318d854a-4918-499f-81c7-74c3775a2010 tempest-GroupSnapshotsTest-1771286532 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:27:29 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-318d854a-4918-499f-81c7-74c3775a2010 tempest-GroupSnapshotsTest-1771286532 None] Flow 'volume_create_manager' (00551ae9-2690-4a17-8dcf-e9fefa763748) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:27:29 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-318d854a-4918-499f-81c7-74c3775a2010 tempest-GroupSnapshotsTest-1771286532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (799f1096-b6f3-4f7d-80db-c574547a83b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:27:29 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-318d854a-4918-499f-81c7-74c3775a2010 tempest-GroupSnapshotsTest-1771286532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (799f1096-b6f3-4f7d-80db-c574547a83b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:27:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-437258314',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3cd58b9f-d4aa-412e-bd80-005cd24ca3c9,host='devstack@QuobyteHD#QuobyteHD',id=5e19eaf1-a05c-4b25-a244-492af7d46947,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c152379270c34f8cbfcc68d9bff1896d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:27:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:27:29Z,use_quota=True,user_id='07b5122bd8a84b24bfe42d705a4f0cd2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3caf94-7c3e-4424-8826-ac977bcfa290),volume_type_id=fd3caf94-7c3e-4424-8826-ac977bcfa290)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:27:29 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-318d854a-4918-499f-81c7-74c3775a2010 tempest-GroupSnapshotsTest-1771286532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (554ffd61-ec4c-4516-8d53-57cf669f7ea7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:27:29 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-318d854a-4918-499f-81c7-74c3775a2010 tempest-GroupSnapshotsTest-1771286532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (554ffd61-ec4c-4516-8d53-57cf669f7ea7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:27:29 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-318d854a-4918-499f-81c7-74c3775a2010 tempest-GroupSnapshotsTest-1771286532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c97de2f-ff45-4a16-824b-6f58a5eaf868) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:27:29 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-318d854a-4918-499f-81c7-74c3775a2010 tempest-GroupSnapshotsTest-1771286532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c97de2f-ff45-4a16-824b-6f58a5eaf868) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e19eaf1-a05c-4b25-a244-492af7d46947', 'volume_name': 'volume-5e19eaf1-a05c-4b25-a244-492af7d46947', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:27:29 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-318d854a-4918-499f-81c7-74c3775a2010 tempest-GroupSnapshotsTest-1771286532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9190512-0686-4957-9f8f-42887eff3ee7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:27:29 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-318d854a-4918-499f-81c7-74c3775a2010 tempest-GroupSnapshotsTest-1771286532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9190512-0686-4957-9f8f-42887eff3ee7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:27:29 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-318d854a-4918-499f-81c7-74c3775a2010 tempest-GroupSnapshotsTest-1771286532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98b92152-1551-4172-b5e1-bf7adcbb5fd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:27:29 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-318d854a-4918-499f-81c7-74c3775a2010 tempest-GroupSnapshotsTest-1771286532 None] Volume 5e19eaf1-a05c-4b25-a244-492af7d46947: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e19eaf1-a05c-4b25-a244-492af7d46947', 'volume_size': 1} Jun 29 03:27:29 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-318d854a-4918-499f-81c7-74c3775a2010 tempest-GroupSnapshotsTest-1771286532 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:27:29 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-318d854a-4918-499f-81c7-74c3775a2010 tempest-GroupSnapshotsTest-1771286532 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:27:29 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-318d854a-4918-499f-81c7-74c3775a2010 tempest-GroupSnapshotsTest-1771286532 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=3cd58b9f-d4aa-412e-bd80-005cd24ca3c9,created_at=2026-06-29T01:27:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-437258314',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3cd58b9f-d4aa-412e-bd80-005cd24ca3c9,host='devstack@QuobyteHD#QuobyteHD',id=5e19eaf1-a05c-4b25-a244-492af7d46947,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c152379270c34f8cbfcc68d9bff1896d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:27:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:27:29Z,use_quota=True,user_id='07b5122bd8a84b24bfe42d705a4f0cd2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3caf94-7c3e-4424-8826-ac977bcfa290),volume_type_id=fd3caf94-7c3e-4424-8826-ac977bcfa290)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:27:29 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-318d854a-4918-499f-81c7-74c3775a2010 tempest-GroupSnapshotsTest-1771286532 None] Creating volume 5e19eaf1-a05c-4b25-a244-492af7d46947 {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:27:29 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-318d854a-4918-499f-81c7-74c3775a2010 tempest-GroupSnapshotsTest-1771286532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:27:29 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-318d854a-4918-499f-81c7-74c3775a2010 tempest-GroupSnapshotsTest-1771286532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:27:29 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-318d854a-4918-499f-81c7-74c3775a2010 tempest-GroupSnapshotsTest-1771286532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:27:29 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-318d854a-4918-499f-81c7-74c3775a2010 tempest-GroupSnapshotsTest-1771286532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:27:29 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-318d854a-4918-499f-81c7-74c3775a2010 tempest-GroupSnapshotsTest-1771286532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:27:29 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-318d854a-4918-499f-81c7-74c3775a2010 tempest-GroupSnapshotsTest-1771286532 None] Selected osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:27:29 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-318d854a-4918-499f-81c7-74c3775a2010 tempest-GroupSnapshotsTest-1771286532 None] casted to osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f Jun 29 03:27:29 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-318d854a-4918-499f-81c7-74c3775a2010 tempest-GroupSnapshotsTest-1771286532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-5e19eaf1-a05c-4b25-a244-492af7d46947 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:27:29 devstack sudo[101748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-5e19eaf1-a05c-4b25-a244-492af7d46947 1073741824 Jun 29 03:27:29 devstack sudo[101748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:27:30 devstack sudo[101748]: pam_unix(sudo:session): session closed for user root Jun 29 03:27:30 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-318d854a-4918-499f-81c7-74c3775a2010 tempest-GroupSnapshotsTest-1771286532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-5e19eaf1-a05c-4b25-a244-492af7d46947 1073741824" returned: 0 in 1.168s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:27:30 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-318d854a-4918-499f-81c7-74c3775a2010 tempest-GroupSnapshotsTest-1771286532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-5e19eaf1-a05c-4b25-a244-492af7d46947 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:27:30 devstack sudo[101754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-5e19eaf1-a05c-4b25-a244-492af7d46947 Jun 29 03:27:30 devstack sudo[101754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:27:31 devstack sudo[101754]: pam_unix(sudo:session): session closed for user root Jun 29 03:27:31 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-318d854a-4918-499f-81c7-74c3775a2010 tempest-GroupSnapshotsTest-1771286532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-5e19eaf1-a05c-4b25-a244-492af7d46947" returned: 0 in 0.833s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:27:31 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-318d854a-4918-499f-81c7-74c3775a2010 tempest-GroupSnapshotsTest-1771286532 None] <== create_volume: return (2066ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:27:31 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-318d854a-4918-499f-81c7-74c3775a2010 tempest-GroupSnapshotsTest-1771286532 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.070s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:27:31 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-318d854a-4918-499f-81c7-74c3775a2010 tempest-GroupSnapshotsTest-1771286532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98b92152-1551-4172-b5e1-bf7adcbb5fd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e19eaf1-a05c-4b25-a244-492af7d46947', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:27:31 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-318d854a-4918-499f-81c7-74c3775a2010 tempest-GroupSnapshotsTest-1771286532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d489899f-d000-4bab-b45c-98e3238bc8b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:27:31 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-318d854a-4918-499f-81c7-74c3775a2010 tempest-GroupSnapshotsTest-1771286532 None] Volume volume-5e19eaf1-a05c-4b25-a244-492af7d46947 (5e19eaf1-a05c-4b25-a244-492af7d46947): created successfully Jun 29 03:27:31 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-318d854a-4918-499f-81c7-74c3775a2010 tempest-GroupSnapshotsTest-1771286532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d489899f-d000-4bab-b45c-98e3238bc8b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:27:31 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-318d854a-4918-499f-81c7-74c3775a2010 tempest-GroupSnapshotsTest-1771286532 None] Flow 'volume_create_manager' (00551ae9-2690-4a17-8dcf-e9fefa763748) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:27:31 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-318d854a-4918-499f-81c7-74c3775a2010 tempest-GroupSnapshotsTest-1771286532 None] Created volume successfully. Jun 29 03:27:31 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-12850808-8440-4877-987b-435f0136e2e1 tempest-GroupSnapshotsTest-1771286532 None] GroupSnapshot 84cf1dcd-8c1a-4b59-be25-2c1cb6b7d2f4: creating. Jun 29 03:27:32 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-12850808-8440-4877-987b-435f0136e2e1 tempest-GroupSnapshotsTest-1771286532 None] Group snapshot 84cf1dcd-8c1a-4b59-be25-2c1cb6b7d2f4: creating. {{(pid=93468) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jun 29 03:27:32 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-12850808-8440-4877-987b-435f0136e2e1 tempest-GroupSnapshotsTest-1771286532 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:27:32 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-12850808-8440-4877-987b-435f0136e2e1 tempest-GroupSnapshotsTest-1771286532 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:27:32 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-12850808-8440-4877-987b-435f0136e2e1 tempest-GroupSnapshotsTest-1771286532 None] Creating offline snapshot 751056f8-df44-4765-9ea0-9accb1c1bdb2 of volume 5e19eaf1-a05c-4b25-a244-492af7d46947 {{(pid=93468) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 29 03:27:32 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1534fd6-4590-4b9c-bed1-644db7d9b2d6]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:27:32 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-12850808-8440-4877-987b-435f0136e2e1 tempest-GroupSnapshotsTest-1771286532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-5e19eaf1-a05c-4b25-a244-492af7d46947 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:27:32 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-02dcc7b6-5624-4789-b403-84e608117c13 tempest-AbsoluteLimitsTests-513263155 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:27:32 devstack sudo[101759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-5e19eaf1-a05c-4b25-a244-492af7d46947 Jun 29 03:27:32 devstack sudo[101759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:27:32 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-02dcc7b6-5624-4789-b403-84e608117c13 tempest-AbsoluteLimitsTests-513263155 None] Flow 'volume_create_manager' (338e484e-ccad-4785-877e-22196e46d37c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:27:32 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-02dcc7b6-5624-4789-b403-84e608117c13 tempest-AbsoluteLimitsTests-513263155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68bd590c-d2e8-4a47-baa9-b988a743e4cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:27:32 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-02dcc7b6-5624-4789-b403-84e608117c13 tempest-AbsoluteLimitsTests-513263155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68bd590c-d2e8-4a47-baa9-b988a743e4cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:27:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-613871356',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0bd90e0b-d889-46b2-ba78-f0d2f5094456,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de4296a7025b41c0a67a4670a49c963c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:27:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:27:32Z,use_quota=True,user_id='5031bc1c849840bd9e04f31d30eb7be5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:27:32 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-02dcc7b6-5624-4789-b403-84e608117c13 tempest-AbsoluteLimitsTests-513263155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (038abdcf-f8a2-4f62-b6d4-4c9a1c775a93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:27:32 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-02dcc7b6-5624-4789-b403-84e608117c13 tempest-AbsoluteLimitsTests-513263155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (038abdcf-f8a2-4f62-b6d4-4c9a1c775a93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:27:32 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-02dcc7b6-5624-4789-b403-84e608117c13 tempest-AbsoluteLimitsTests-513263155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a132e2fe-62cb-4997-8e5b-176c76f406c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:27:32 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-02dcc7b6-5624-4789-b403-84e608117c13 tempest-AbsoluteLimitsTests-513263155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a132e2fe-62cb-4997-8e5b-176c76f406c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0bd90e0b-d889-46b2-ba78-f0d2f5094456', 'volume_name': 'volume-0bd90e0b-d889-46b2-ba78-f0d2f5094456', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:27:32 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-02dcc7b6-5624-4789-b403-84e608117c13 tempest-AbsoluteLimitsTests-513263155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55f5edd7-433c-4724-976d-20758e0ed234) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:27:32 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-02dcc7b6-5624-4789-b403-84e608117c13 tempest-AbsoluteLimitsTests-513263155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55f5edd7-433c-4724-976d-20758e0ed234) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:27:32 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-02dcc7b6-5624-4789-b403-84e608117c13 tempest-AbsoluteLimitsTests-513263155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22c1b7c1-7a5f-44a1-8999-98d65e9f54b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:27:32 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-02dcc7b6-5624-4789-b403-84e608117c13 tempest-AbsoluteLimitsTests-513263155 None] Volume 0bd90e0b-d889-46b2-ba78-f0d2f5094456: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0bd90e0b-d889-46b2-ba78-f0d2f5094456', 'volume_size': 1} Jun 29 03:27:32 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-02dcc7b6-5624-4789-b403-84e608117c13 tempest-AbsoluteLimitsTests-513263155 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:27:33 devstack sudo[101759]: pam_unix(sudo:session): session closed for user root Jun 29 03:27:33 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-12850808-8440-4877-987b-435f0136e2e1 tempest-GroupSnapshotsTest-1771286532 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-5e19eaf1-a05c-4b25-a244-492af7d46947" returned: 0 in 1.016s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:27:33 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-12850808-8440-4877-987b-435f0136e2e1 tempest-GroupSnapshotsTest-1771286532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-5e19eaf1-a05c-4b25-a244-492af7d46947,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-5e19eaf1-a05c-4b25-a244-492af7d46947.751056f8-df44-4765-9ea0-9accb1c1bdb2 1G {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:27:33 devstack sudo[101764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-5e19eaf1-a05c-4b25-a244-492af7d46947,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-5e19eaf1-a05c-4b25-a244-492af7d46947.751056f8-df44-4765-9ea0-9accb1c1bdb2 1G Jun 29 03:27:33 devstack sudo[101764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:27:33 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-86be2c25-025a-4a8e-8432-3cefe1ebfac6 tempest-ServersNegativeTestJSON-553004994 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:27:33 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-86be2c25-025a-4a8e-8432-3cefe1ebfac6 tempest-ServersNegativeTestJSON-553004994 None] Flow 'volume_create_manager' (92e8568d-2e7e-4846-aedd-b834777814c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:27:33 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-86be2c25-025a-4a8e-8432-3cefe1ebfac6 tempest-ServersNegativeTestJSON-553004994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (278f8f23-bed7-4242-befb-6029fd51dde8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:27:33 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-86be2c25-025a-4a8e-8432-3cefe1ebfac6 tempest-ServersNegativeTestJSON-553004994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (278f8f23-bed7-4242-befb-6029fd51dde8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:27:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-2088133030',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1fc3c2b-afd8-4d12-90a5-241c7e8ae8ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66f3668198c04b3cbab4fd2b74a19218',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:27:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:27:33Z,use_quota=True,user_id='26f520415e9041bcba44332c019e0818',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:27:33 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-86be2c25-025a-4a8e-8432-3cefe1ebfac6 tempest-ServersNegativeTestJSON-553004994 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93bec78e-f7da-4fe6-8559-65bc1c77e901) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:27:33 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-86be2c25-025a-4a8e-8432-3cefe1ebfac6 tempest-ServersNegativeTestJSON-553004994 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93bec78e-f7da-4fe6-8559-65bc1c77e901) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:27:33 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-86be2c25-025a-4a8e-8432-3cefe1ebfac6 tempest-ServersNegativeTestJSON-553004994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0593dc30-3872-4a39-96ae-75db147ec460) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:27:33 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-86be2c25-025a-4a8e-8432-3cefe1ebfac6 tempest-ServersNegativeTestJSON-553004994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0593dc30-3872-4a39-96ae-75db147ec460) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c1fc3c2b-afd8-4d12-90a5-241c7e8ae8ad', 'volume_name': 'volume-c1fc3c2b-afd8-4d12-90a5-241c7e8ae8ad', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:27:33 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-86be2c25-025a-4a8e-8432-3cefe1ebfac6 tempest-ServersNegativeTestJSON-553004994 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31ac77fd-543b-40f4-978d-777bdd35d7eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:27:33 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-86be2c25-025a-4a8e-8432-3cefe1ebfac6 tempest-ServersNegativeTestJSON-553004994 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31ac77fd-543b-40f4-978d-777bdd35d7eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:27:33 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-86be2c25-025a-4a8e-8432-3cefe1ebfac6 tempest-ServersNegativeTestJSON-553004994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f878d7b-6fc7-4dab-a8df-92f2807af36d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:27:33 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-86be2c25-025a-4a8e-8432-3cefe1ebfac6 tempest-ServersNegativeTestJSON-553004994 None] Volume c1fc3c2b-afd8-4d12-90a5-241c7e8ae8ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c1fc3c2b-afd8-4d12-90a5-241c7e8ae8ad', 'volume_size': 1} Jun 29 03:27:33 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-86be2c25-025a-4a8e-8432-3cefe1ebfac6 tempest-ServersNegativeTestJSON-553004994 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:27:33 devstack sudo[101764]: pam_unix(sudo:session): session closed for user root Jun 29 03:27:33 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-12850808-8440-4877-987b-435f0136e2e1 tempest-GroupSnapshotsTest-1771286532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-5e19eaf1-a05c-4b25-a244-492af7d46947,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-5e19eaf1-a05c-4b25-a244-492af7d46947.751056f8-df44-4765-9ea0-9accb1c1bdb2 1G" returned: 0 in 0.842s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:27:33 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-12850808-8440-4877-987b-435f0136e2e1 tempest-GroupSnapshotsTest-1771286532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e19eaf1-a05c-4b25-a244-492af7d46947 -F qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-5e19eaf1-a05c-4b25-a244-492af7d46947.751056f8-df44-4765-9ea0-9accb1c1bdb2 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:27:33 devstack sudo[101770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e19eaf1-a05c-4b25-a244-492af7d46947 -F qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-5e19eaf1-a05c-4b25-a244-492af7d46947.751056f8-df44-4765-9ea0-9accb1c1bdb2 Jun 29 03:27:33 devstack sudo[101770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:27:34 devstack sudo[101770]: pam_unix(sudo:session): session closed for user root Jun 29 03:27:34 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-12850808-8440-4877-987b-435f0136e2e1 tempest-GroupSnapshotsTest-1771286532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e19eaf1-a05c-4b25-a244-492af7d46947 -F qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-5e19eaf1-a05c-4b25-a244-492af7d46947.751056f8-df44-4765-9ea0-9accb1c1bdb2" returned: 0 in 0.728s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:27:34 devstack cinder-volume[93468]: WARNING cinder.volume.drivers.remotefs [None req-12850808-8440-4877-987b-435f0136e2e1 tempest-GroupSnapshotsTest-1771286532 None] /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-5e19eaf1-a05c-4b25-a244-492af7d46947.751056f8-df44-4765-9ea0-9accb1c1bdb2 is being set with open permissions: ugo+rw: NotImplementedError Jun 29 03:27:34 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-12850808-8440-4877-987b-435f0136e2e1 tempest-GroupSnapshotsTest-1771286532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-5e19eaf1-a05c-4b25-a244-492af7d46947.751056f8-df44-4765-9ea0-9accb1c1bdb2 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:27:34 devstack sudo[101775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-5e19eaf1-a05c-4b25-a244-492af7d46947.751056f8-df44-4765-9ea0-9accb1c1bdb2 Jun 29 03:27:34 devstack sudo[101775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:27:35 devstack sudo[101775]: pam_unix(sudo:session): session closed for user root Jun 29 03:27:35 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-12850808-8440-4877-987b-435f0136e2e1 tempest-GroupSnapshotsTest-1771286532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-5e19eaf1-a05c-4b25-a244-492af7d46947.751056f8-df44-4765-9ea0-9accb1c1bdb2" returned: 0 in 0.658s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:27:35 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-12850808-8440-4877-987b-435f0136e2e1 tempest-GroupSnapshotsTest-1771286532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-5e19eaf1-a05c-4b25-a244-492af7d46947.info {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:27:35 devstack sudo[101778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-5e19eaf1-a05c-4b25-a244-492af7d46947.info Jun 29 03:27:35 devstack sudo[101778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:27:36 devstack sudo[101778]: pam_unix(sudo:session): session closed for user root Jun 29 03:27:36 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-12850808-8440-4877-987b-435f0136e2e1 tempest-GroupSnapshotsTest-1771286532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-5e19eaf1-a05c-4b25-a244-492af7d46947.info" returned: 0 in 0.714s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:27:36 devstack cinder-volume[93468]: WARNING cinder.volume.drivers.remotefs [None req-12850808-8440-4877-987b-435f0136e2e1 tempest-GroupSnapshotsTest-1771286532 None] /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-5e19eaf1-a05c-4b25-a244-492af7d46947.info is being set with open permissions: ugo+rw: NotImplementedError Jun 29 03:27:36 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-12850808-8440-4877-987b-435f0136e2e1 tempest-GroupSnapshotsTest-1771286532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-5e19eaf1-a05c-4b25-a244-492af7d46947.info {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:27:36 devstack sudo[101781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-5e19eaf1-a05c-4b25-a244-492af7d46947.info Jun 29 03:27:36 devstack sudo[101781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:27:36 devstack sudo[101781]: pam_unix(sudo:session): session closed for user root Jun 29 03:27:36 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-12850808-8440-4877-987b-435f0136e2e1 tempest-GroupSnapshotsTest-1771286532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-5e19eaf1-a05c-4b25-a244-492af7d46947.info" returned: 0 in 0.661s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:27:36 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-12850808-8440-4877-987b-435f0136e2e1 tempest-GroupSnapshotsTest-1771286532 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.708s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:27:36 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-02dcc7b6-5624-4789-b403-84e608117c13 tempest-AbsoluteLimitsTests-513263155 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.403s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:27:36 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-02dcc7b6-5624-4789-b403-84e608117c13 tempest-AbsoluteLimitsTests-513263155 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:27:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-613871356',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0bd90e0b-d889-46b2-ba78-f0d2f5094456,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de4296a7025b41c0a67a4670a49c963c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:27:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:27:32Z,use_quota=True,user_id='5031bc1c849840bd9e04f31d30eb7be5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:27:36 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-02dcc7b6-5624-4789-b403-84e608117c13 tempest-AbsoluteLimitsTests-513263155 None] Creating volume 0bd90e0b-d889-46b2-ba78-f0d2f5094456 {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:27:36 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-02dcc7b6-5624-4789-b403-84e608117c13 tempest-AbsoluteLimitsTests-513263155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:27:36 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-02dcc7b6-5624-4789-b403-84e608117c13 tempest-AbsoluteLimitsTests-513263155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:27:36 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-02dcc7b6-5624-4789-b403-84e608117c13 tempest-AbsoluteLimitsTests-513263155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:27:36 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-02dcc7b6-5624-4789-b403-84e608117c13 tempest-AbsoluteLimitsTests-513263155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:27:36 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-02dcc7b6-5624-4789-b403-84e608117c13 tempest-AbsoluteLimitsTests-513263155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:27:36 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-02dcc7b6-5624-4789-b403-84e608117c13 tempest-AbsoluteLimitsTests-513263155 None] Selected osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:27:36 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-02dcc7b6-5624-4789-b403-84e608117c13 tempest-AbsoluteLimitsTests-513263155 None] casted to osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f Jun 29 03:27:36 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-02dcc7b6-5624-4789-b403-84e608117c13 tempest-AbsoluteLimitsTests-513263155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-0bd90e0b-d889-46b2-ba78-f0d2f5094456 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:27:36 devstack sudo[101784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-0bd90e0b-d889-46b2-ba78-f0d2f5094456 1073741824 Jun 29 03:27:36 devstack sudo[101784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:27:36 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-12850808-8440-4877-987b-435f0136e2e1 tempest-GroupSnapshotsTest-1771286532 None] group_snapshot 84cf1dcd-8c1a-4b59-be25-2c1cb6b7d2f4: created successfully Jun 29 03:27:37 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-aed284b9-6768-4a1c-83f7-aaaa4fb848d3 tempest-GroupSnapshotsTest-1771286532 None] group_snapshot 84cf1dcd-8c1a-4b59-be25-2c1cb6b7d2f4: deleting Jun 29 03:27:37 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-aed284b9-6768-4a1c-83f7-aaaa4fb848d3 tempest-GroupSnapshotsTest-1771286532 None] group_snapshot 84cf1dcd-8c1a-4b59-be25-2c1cb6b7d2f4: deleting {{(pid=93468) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jun 29 03:27:37 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-aed284b9-6768-4a1c-83f7-aaaa4fb848d3 tempest-GroupSnapshotsTest-1771286532 None] Acquiring lock "cinder-quobyte-5e19eaf1-a05c-4b25-a244-492af7d46947" by "delete_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:27:37 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-aed284b9-6768-4a1c-83f7-aaaa4fb848d3 tempest-GroupSnapshotsTest-1771286532 None] Lock "cinder-quobyte-5e19eaf1-a05c-4b25-a244-492af7d46947" acquired by "delete_snapshot" :: waited 0.018s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:27:37 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-aed284b9-6768-4a1c-83f7-aaaa4fb848d3 tempest-GroupSnapshotsTest-1771286532 None] Acquiring lock "cinder-quobyte-751056f8-df44-4765-9ea0-9accb1c1bdb2" by "_delete_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:27:37 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-aed284b9-6768-4a1c-83f7-aaaa4fb848d3 tempest-GroupSnapshotsTest-1771286532 None] Lock "cinder-quobyte-751056f8-df44-4765-9ea0-9accb1c1bdb2" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:27:37 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-aed284b9-6768-4a1c-83f7-aaaa4fb848d3 tempest-GroupSnapshotsTest-1771286532 None] Deleting offline snapshot 751056f8-df44-4765-9ea0-9accb1c1bdb2 of volume 5e19eaf1-a05c-4b25-a244-492af7d46947 {{(pid=93468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 29 03:27:37 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-aed284b9-6768-4a1c-83f7-aaaa4fb848d3 tempest-GroupSnapshotsTest-1771286532 None] snapshot_file for this snap is: volume-5e19eaf1-a05c-4b25-a244-492af7d46947.751056f8-df44-4765-9ea0-9accb1c1bdb2 {{(pid=93468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 29 03:27:37 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[51c1e9c0-b658-48f7-bd9d-98405b5a2e10]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:27:37 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-aed284b9-6768-4a1c-83f7-aaaa4fb848d3 tempest-GroupSnapshotsTest-1771286532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-5e19eaf1-a05c-4b25-a244-492af7d46947.751056f8-df44-4765-9ea0-9accb1c1bdb2 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:27:37 devstack sudo[101825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-5e19eaf1-a05c-4b25-a244-492af7d46947.751056f8-df44-4765-9ea0-9accb1c1bdb2 Jun 29 03:27:37 devstack sudo[101825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:27:37 devstack sudo[101784]: pam_unix(sudo:session): session closed for user root Jun 29 03:27:37 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-02dcc7b6-5624-4789-b403-84e608117c13 tempest-AbsoluteLimitsTests-513263155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-0bd90e0b-d889-46b2-ba78-f0d2f5094456 1073741824" returned: 0 in 1.077s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:27:37 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-02dcc7b6-5624-4789-b403-84e608117c13 tempest-AbsoluteLimitsTests-513263155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-0bd90e0b-d889-46b2-ba78-f0d2f5094456 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:27:37 devstack sudo[101828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-0bd90e0b-d889-46b2-ba78-f0d2f5094456 Jun 29 03:27:37 devstack sudo[101828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:27:38 devstack sudo[101825]: pam_unix(sudo:session): session closed for user root Jun 29 03:27:38 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-aed284b9-6768-4a1c-83f7-aaaa4fb848d3 tempest-GroupSnapshotsTest-1771286532 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-5e19eaf1-a05c-4b25-a244-492af7d46947.751056f8-df44-4765-9ea0-9accb1c1bdb2" returned: 0 in 0.851s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:27:38 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-aed284b9-6768-4a1c-83f7-aaaa4fb848d3 tempest-GroupSnapshotsTest-1771286532 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5e19eaf1-a05c-4b25-a244-492af7d46947(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93468) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 29 03:27:38 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3c11912-6634-4468-964b-d64055b70066]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:27:38 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-aed284b9-6768-4a1c-83f7-aaaa4fb848d3 tempest-GroupSnapshotsTest-1771286532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-5e19eaf1-a05c-4b25-a244-492af7d46947 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:27:38 devstack sudo[101828]: pam_unix(sudo:session): session closed for user root Jun 29 03:27:38 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-02dcc7b6-5624-4789-b403-84e608117c13 tempest-AbsoluteLimitsTests-513263155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-0bd90e0b-d889-46b2-ba78-f0d2f5094456" returned: 0 in 0.693s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:27:38 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-02dcc7b6-5624-4789-b403-84e608117c13 tempest-AbsoluteLimitsTests-513263155 None] <== create_volume: return (1817ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:27:38 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-02dcc7b6-5624-4789-b403-84e608117c13 tempest-AbsoluteLimitsTests-513263155 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.820s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:27:38 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-86be2c25-025a-4a8e-8432-3cefe1ebfac6 tempest-ServersNegativeTestJSON-553004994 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.368s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:27:38 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-86be2c25-025a-4a8e-8432-3cefe1ebfac6 tempest-ServersNegativeTestJSON-553004994 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:27:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-2088133030',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1fc3c2b-afd8-4d12-90a5-241c7e8ae8ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66f3668198c04b3cbab4fd2b74a19218',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:27:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:27:33Z,use_quota=True,user_id='26f520415e9041bcba44332c019e0818',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:27:38 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-86be2c25-025a-4a8e-8432-3cefe1ebfac6 tempest-ServersNegativeTestJSON-553004994 None] Creating volume c1fc3c2b-afd8-4d12-90a5-241c7e8ae8ad {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:27:38 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-86be2c25-025a-4a8e-8432-3cefe1ebfac6 tempest-ServersNegativeTestJSON-553004994 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:27:38 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-86be2c25-025a-4a8e-8432-3cefe1ebfac6 tempest-ServersNegativeTestJSON-553004994 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:27:38 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-86be2c25-025a-4a8e-8432-3cefe1ebfac6 tempest-ServersNegativeTestJSON-553004994 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:27:38 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-86be2c25-025a-4a8e-8432-3cefe1ebfac6 tempest-ServersNegativeTestJSON-553004994 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:27:38 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-86be2c25-025a-4a8e-8432-3cefe1ebfac6 tempest-ServersNegativeTestJSON-553004994 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:27:38 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-86be2c25-025a-4a8e-8432-3cefe1ebfac6 tempest-ServersNegativeTestJSON-553004994 None] Selected osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:27:38 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-86be2c25-025a-4a8e-8432-3cefe1ebfac6 tempest-ServersNegativeTestJSON-553004994 None] casted to osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f Jun 29 03:27:38 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-86be2c25-025a-4a8e-8432-3cefe1ebfac6 tempest-ServersNegativeTestJSON-553004994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-c1fc3c2b-afd8-4d12-90a5-241c7e8ae8ad 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:27:38 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-02dcc7b6-5624-4789-b403-84e608117c13 tempest-AbsoluteLimitsTests-513263155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22c1b7c1-7a5f-44a1-8999-98d65e9f54b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0bd90e0b-d889-46b2-ba78-f0d2f5094456', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:27:38 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-02dcc7b6-5624-4789-b403-84e608117c13 tempest-AbsoluteLimitsTests-513263155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f3202d8-1a94-43aa-9429-fc9ac00171f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:27:38 devstack sudo[101835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-c1fc3c2b-afd8-4d12-90a5-241c7e8ae8ad 1073741824 Jun 29 03:27:38 devstack sudo[101835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:27:38 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-02dcc7b6-5624-4789-b403-84e608117c13 tempest-AbsoluteLimitsTests-513263155 None] Volume volume-0bd90e0b-d889-46b2-ba78-f0d2f5094456 (0bd90e0b-d889-46b2-ba78-f0d2f5094456): created successfully Jun 29 03:27:38 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-02dcc7b6-5624-4789-b403-84e608117c13 tempest-AbsoluteLimitsTests-513263155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f3202d8-1a94-43aa-9429-fc9ac00171f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:27:38 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-02dcc7b6-5624-4789-b403-84e608117c13 tempest-AbsoluteLimitsTests-513263155 None] Flow 'volume_create_manager' (338e484e-ccad-4785-877e-22196e46d37c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:27:38 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-02dcc7b6-5624-4789-b403-84e608117c13 tempest-AbsoluteLimitsTests-513263155 None] Created volume successfully. Jun 29 03:27:38 devstack sudo[101834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-5e19eaf1-a05c-4b25-a244-492af7d46947 Jun 29 03:27:38 devstack sudo[101834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:27:38 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-d92ba817-f553-4795-a690-9d557e5751fd tempest-SnapshotsActionsTest-1128167461 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:27:38 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-d92ba817-f553-4795-a690-9d557e5751fd tempest-SnapshotsActionsTest-1128167461 None] Flow 'volume_create_manager' (426a86d5-d210-4026-aebe-bb701ecbe075) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:27:38 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-d92ba817-f553-4795-a690-9d557e5751fd tempest-SnapshotsActionsTest-1128167461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bb0a11c-ab60-4b70-9ef4-35604618d7ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:27:38 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-d92ba817-f553-4795-a690-9d557e5751fd tempest-SnapshotsActionsTest-1128167461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bb0a11c-ab60-4b70-9ef4-35604618d7ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:27:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-612316803',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fcb2f3de-8d93-414c-92d7-f6039a136688,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e37a773a92c34dd8ac3fbe94c08a4e34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:27:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:27:39Z,use_quota=True,user_id='af4d846c4026448bb519ffa260faedd7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:27:38 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-d92ba817-f553-4795-a690-9d557e5751fd tempest-SnapshotsActionsTest-1128167461 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13310658-1c0c-43a8-b42c-bd9106780ff7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:27:38 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-d92ba817-f553-4795-a690-9d557e5751fd tempest-SnapshotsActionsTest-1128167461 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13310658-1c0c-43a8-b42c-bd9106780ff7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:27:38 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-d92ba817-f553-4795-a690-9d557e5751fd tempest-SnapshotsActionsTest-1128167461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b16b6b7-c8c7-4d1a-be93-2e5a478729e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:27:38 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-d92ba817-f553-4795-a690-9d557e5751fd tempest-SnapshotsActionsTest-1128167461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b16b6b7-c8c7-4d1a-be93-2e5a478729e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fcb2f3de-8d93-414c-92d7-f6039a136688', 'volume_name': 'volume-fcb2f3de-8d93-414c-92d7-f6039a136688', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:27:38 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-d92ba817-f553-4795-a690-9d557e5751fd tempest-SnapshotsActionsTest-1128167461 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b283b5c7-8ac7-4f3f-b3ea-2fcf4ecb6dca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:27:38 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-d92ba817-f553-4795-a690-9d557e5751fd tempest-SnapshotsActionsTest-1128167461 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b283b5c7-8ac7-4f3f-b3ea-2fcf4ecb6dca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:27:38 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-d92ba817-f553-4795-a690-9d557e5751fd tempest-SnapshotsActionsTest-1128167461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c8e6bff-3bf1-4f39-9915-88ff3480b4c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:27:38 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-d92ba817-f553-4795-a690-9d557e5751fd tempest-SnapshotsActionsTest-1128167461 None] Volume fcb2f3de-8d93-414c-92d7-f6039a136688: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fcb2f3de-8d93-414c-92d7-f6039a136688', 'volume_size': 1} Jun 29 03:27:38 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-d92ba817-f553-4795-a690-9d557e5751fd tempest-SnapshotsActionsTest-1128167461 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:27:39 devstack sudo[101834]: pam_unix(sudo:session): session closed for user root Jun 29 03:27:39 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-aed284b9-6768-4a1c-83f7-aaaa4fb848d3 tempest-GroupSnapshotsTest-1771286532 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-5e19eaf1-a05c-4b25-a244-492af7d46947" returned: 0 in 0.866s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:27:39 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-aed284b9-6768-4a1c-83f7-aaaa4fb848d3 tempest-GroupSnapshotsTest-1771286532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-5e19eaf1-a05c-4b25-a244-492af7d46947.751056f8-df44-4765-9ea0-9accb1c1bdb2 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:27:39 devstack sudo[101845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-5e19eaf1-a05c-4b25-a244-492af7d46947.751056f8-df44-4765-9ea0-9accb1c1bdb2 Jun 29 03:27:39 devstack sudo[101845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:27:39 devstack sudo[101835]: pam_unix(sudo:session): session closed for user root Jun 29 03:27:39 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-86be2c25-025a-4a8e-8432-3cefe1ebfac6 tempest-ServersNegativeTestJSON-553004994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-c1fc3c2b-afd8-4d12-90a5-241c7e8ae8ad 1073741824" returned: 0 in 0.929s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:27:39 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-86be2c25-025a-4a8e-8432-3cefe1ebfac6 tempest-ServersNegativeTestJSON-553004994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-c1fc3c2b-afd8-4d12-90a5-241c7e8ae8ad {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:27:39 devstack sudo[101847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-c1fc3c2b-afd8-4d12-90a5-241c7e8ae8ad Jun 29 03:27:39 devstack sudo[101847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:27:39 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-0ac1967e-e6a0-4647-8aae-45a2688a79b4 tempest-AbsoluteLimitsTests-513263155 None] Acquiring lock "cinder-0bd90e0b-d889-46b2-ba78-f0d2f5094456-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:27:39 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-0ac1967e-e6a0-4647-8aae-45a2688a79b4 tempest-AbsoluteLimitsTests-513263155 None] Lock "cinder-0bd90e0b-d889-46b2-ba78-f0d2f5094456-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:27:39 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-0ac1967e-e6a0-4647-8aae-45a2688a79b4 tempest-AbsoluteLimitsTests-513263155 None] Acquiring lock "cinder-quobyte-0bd90e0b-d889-46b2-ba78-f0d2f5094456" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:27:39 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-0ac1967e-e6a0-4647-8aae-45a2688a79b4 tempest-AbsoluteLimitsTests-513263155 None] Lock "cinder-quobyte-0bd90e0b-d889-46b2-ba78-f0d2f5094456" acquired by "delete_volume" :: waited 0.023s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:27:39 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bc17732-ed22-474f-a987-19717acdece5]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:27:39 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-0ac1967e-e6a0-4647-8aae-45a2688a79b4 tempest-AbsoluteLimitsTests-513263155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-0bd90e0b-d889-46b2-ba78-f0d2f5094456 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:27:39 devstack sudo[101849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-0bd90e0b-d889-46b2-ba78-f0d2f5094456 Jun 29 03:27:39 devstack sudo[101849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:27:40 devstack sudo[101845]: pam_unix(sudo:session): session closed for user root Jun 29 03:27:40 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-aed284b9-6768-4a1c-83f7-aaaa4fb848d3 tempest-GroupSnapshotsTest-1771286532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-5e19eaf1-a05c-4b25-a244-492af7d46947.751056f8-df44-4765-9ea0-9accb1c1bdb2" returned: 0 in 0.812s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:27:40 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-aed284b9-6768-4a1c-83f7-aaaa4fb848d3 tempest-GroupSnapshotsTest-1771286532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-5e19eaf1-a05c-4b25-a244-492af7d46947.751056f8-df44-4765-9ea0-9accb1c1bdb2 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:27:40 devstack sudo[101855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-5e19eaf1-a05c-4b25-a244-492af7d46947.751056f8-df44-4765-9ea0-9accb1c1bdb2 Jun 29 03:27:40 devstack sudo[101855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:27:40 devstack sudo[101847]: pam_unix(sudo:session): session closed for user root Jun 29 03:27:40 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-86be2c25-025a-4a8e-8432-3cefe1ebfac6 tempest-ServersNegativeTestJSON-553004994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-c1fc3c2b-afd8-4d12-90a5-241c7e8ae8ad" returned: 0 in 0.702s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:27:40 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-86be2c25-025a-4a8e-8432-3cefe1ebfac6 tempest-ServersNegativeTestJSON-553004994 None] <== create_volume: return (1675ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:27:40 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-86be2c25-025a-4a8e-8432-3cefe1ebfac6 tempest-ServersNegativeTestJSON-553004994 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.684s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:27:40 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-d92ba817-f553-4795-a690-9d557e5751fd tempest-SnapshotsActionsTest-1128167461 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.395s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:27:40 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-d92ba817-f553-4795-a690-9d557e5751fd tempest-SnapshotsActionsTest-1128167461 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:27:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-612316803',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fcb2f3de-8d93-414c-92d7-f6039a136688,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e37a773a92c34dd8ac3fbe94c08a4e34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:27:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:27:39Z,use_quota=True,user_id='af4d846c4026448bb519ffa260faedd7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:27:40 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-d92ba817-f553-4795-a690-9d557e5751fd tempest-SnapshotsActionsTest-1128167461 None] Creating volume fcb2f3de-8d93-414c-92d7-f6039a136688 {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:27:40 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-d92ba817-f553-4795-a690-9d557e5751fd tempest-SnapshotsActionsTest-1128167461 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:27:40 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-d92ba817-f553-4795-a690-9d557e5751fd tempest-SnapshotsActionsTest-1128167461 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:27:40 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-d92ba817-f553-4795-a690-9d557e5751fd tempest-SnapshotsActionsTest-1128167461 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:27:40 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-d92ba817-f553-4795-a690-9d557e5751fd tempest-SnapshotsActionsTest-1128167461 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:27:40 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-d92ba817-f553-4795-a690-9d557e5751fd tempest-SnapshotsActionsTest-1128167461 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:27:40 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-d92ba817-f553-4795-a690-9d557e5751fd tempest-SnapshotsActionsTest-1128167461 None] Selected osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:27:40 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-d92ba817-f553-4795-a690-9d557e5751fd tempest-SnapshotsActionsTest-1128167461 None] casted to osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f Jun 29 03:27:40 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d92ba817-f553-4795-a690-9d557e5751fd tempest-SnapshotsActionsTest-1128167461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-fcb2f3de-8d93-414c-92d7-f6039a136688 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:27:40 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-86be2c25-025a-4a8e-8432-3cefe1ebfac6 tempest-ServersNegativeTestJSON-553004994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f878d7b-6fc7-4dab-a8df-92f2807af36d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1fc3c2b-afd8-4d12-90a5-241c7e8ae8ad', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:27:40 devstack sudo[101857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-fcb2f3de-8d93-414c-92d7-f6039a136688 1073741824 Jun 29 03:27:40 devstack sudo[101857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:27:40 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-86be2c25-025a-4a8e-8432-3cefe1ebfac6 tempest-ServersNegativeTestJSON-553004994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a182144a-0c23-4616-ae4a-ac8d515d4067) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:27:40 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-86be2c25-025a-4a8e-8432-3cefe1ebfac6 tempest-ServersNegativeTestJSON-553004994 None] Volume volume-c1fc3c2b-afd8-4d12-90a5-241c7e8ae8ad (c1fc3c2b-afd8-4d12-90a5-241c7e8ae8ad): created successfully Jun 29 03:27:40 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-86be2c25-025a-4a8e-8432-3cefe1ebfac6 tempest-ServersNegativeTestJSON-553004994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a182144a-0c23-4616-ae4a-ac8d515d4067) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:27:40 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-86be2c25-025a-4a8e-8432-3cefe1ebfac6 tempest-ServersNegativeTestJSON-553004994 None] Flow 'volume_create_manager' (92e8568d-2e7e-4846-aedd-b834777814c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:27:40 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-86be2c25-025a-4a8e-8432-3cefe1ebfac6 tempest-ServersNegativeTestJSON-553004994 None] Created volume successfully. Jun 29 03:27:40 devstack sudo[101849]: pam_unix(sudo:session): session closed for user root Jun 29 03:27:40 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-0ac1967e-e6a0-4647-8aae-45a2688a79b4 tempest-AbsoluteLimitsTests-513263155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-0bd90e0b-d889-46b2-ba78-f0d2f5094456" returned: 0 in 0.814s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:27:40 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-0ac1967e-e6a0-4647-8aae-45a2688a79b4 tempest-AbsoluteLimitsTests-513263155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-0bd90e0b-d889-46b2-ba78-f0d2f5094456 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:27:40 devstack sudo[101863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-0bd90e0b-d889-46b2-ba78-f0d2f5094456 Jun 29 03:27:40 devstack sudo[101863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:27:41 devstack sudo[101855]: pam_unix(sudo:session): session closed for user root Jun 29 03:27:41 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-aed284b9-6768-4a1c-83f7-aaaa4fb848d3 tempest-GroupSnapshotsTest-1771286532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-5e19eaf1-a05c-4b25-a244-492af7d46947.751056f8-df44-4765-9ea0-9accb1c1bdb2" returned: 0 in 0.815s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:27:41 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-aed284b9-6768-4a1c-83f7-aaaa4fb848d3 tempest-GroupSnapshotsTest-1771286532 None] Lock "cinder-quobyte-751056f8-df44-4765-9ea0-9accb1c1bdb2" released by "_delete_snapshot" :: held 3.475s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:27:41 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-aed284b9-6768-4a1c-83f7-aaaa4fb848d3 tempest-GroupSnapshotsTest-1771286532 None] Lock "cinder-quobyte-5e19eaf1-a05c-4b25-a244-492af7d46947" released by "delete_snapshot" :: held 3.511s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:27:41 devstack cinder-volume[93468]: WARNING cinder.quota [None req-aed284b9-6768-4a1c-83f7-aaaa4fb848d3 tempest-GroupSnapshotsTest-1771286532 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1486315392 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1486315392, it is now deprecated. Please use the default quota class for default quota. Jun 29 03:27:41 devstack cinder-volume[93468]: WARNING cinder.quota [None req-aed284b9-6768-4a1c-83f7-aaaa4fb848d3 tempest-GroupSnapshotsTest-1771286532 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1486315392 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1486315392, it is now deprecated. Please use the default quota class for default quota. Jun 29 03:27:41 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-aed284b9-6768-4a1c-83f7-aaaa4fb848d3 tempest-GroupSnapshotsTest-1771286532 None] Created reservations ['3ab81796-cba4-4662-9d31-5f01da11f5a7', 'edf22506-f396-4941-8651-eb33847692c1', '96d91fbe-baa0-42c4-a78e-6073c715d52b', 'b1988604-3461-4050-834f-b9d76a70bc52'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:27:41 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-aed284b9-6768-4a1c-83f7-aaaa4fb848d3 tempest-GroupSnapshotsTest-1771286532 None] group_snapshot 84cf1dcd-8c1a-4b59-be25-2c1cb6b7d2f4: deleted successfully Jun 29 03:27:41 devstack sudo[101857]: pam_unix(sudo:session): session closed for user root Jun 29 03:27:41 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d92ba817-f553-4795-a690-9d557e5751fd tempest-SnapshotsActionsTest-1128167461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-fcb2f3de-8d93-414c-92d7-f6039a136688 1073741824" returned: 0 in 1.047s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:27:41 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d92ba817-f553-4795-a690-9d557e5751fd tempest-SnapshotsActionsTest-1128167461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-fcb2f3de-8d93-414c-92d7-f6039a136688 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:27:41 devstack sudo[101871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-fcb2f3de-8d93-414c-92d7-f6039a136688 Jun 29 03:27:41 devstack sudo[101871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:27:41 devstack sudo[101863]: pam_unix(sudo:session): session closed for user root Jun 29 03:27:41 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-0ac1967e-e6a0-4647-8aae-45a2688a79b4 tempest-AbsoluteLimitsTests-513263155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-0bd90e0b-d889-46b2-ba78-f0d2f5094456" returned: 0 in 0.796s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:27:41 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-0ac1967e-e6a0-4647-8aae-45a2688a79b4 tempest-AbsoluteLimitsTests-513263155 None] Lock "cinder-quobyte-0bd90e0b-d889-46b2-ba78-f0d2f5094456" released by "delete_volume" :: held 1.655s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:27:41 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-0ac1967e-e6a0-4647-8aae-45a2688a79b4 tempest-AbsoluteLimitsTests-513263155 None] Created reservations ['e75d2f1e-bacb-43fd-8f4e-6d662a9aae39', 'd2bd9e55-75e7-46d1-b90f-e08a79952ef1', '0f2cb55a-6e5d-46ab-abbc-edfbc1c4f285', 'db4ce6d9-58ca-4eb6-9e75-3a836c25d30a'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:27:41 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-0ac1967e-e6a0-4647-8aae-45a2688a79b4 tempest-AbsoluteLimitsTests-513263155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:27:41 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-0ac1967e-e6a0-4647-8aae-45a2688a79b4 tempest-AbsoluteLimitsTests-513263155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:27:41 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-0ac1967e-e6a0-4647-8aae-45a2688a79b4 tempest-AbsoluteLimitsTests-513263155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:27:41 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-0ac1967e-e6a0-4647-8aae-45a2688a79b4 tempest-AbsoluteLimitsTests-513263155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:27:41 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-0ac1967e-e6a0-4647-8aae-45a2688a79b4 tempest-AbsoluteLimitsTests-513263155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:27:41 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-0ac1967e-e6a0-4647-8aae-45a2688a79b4 tempest-AbsoluteLimitsTests-513263155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:27:41 devstack sudo[101874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf Jun 29 03:27:41 devstack sudo[101874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:27:42 devstack sudo[101871]: pam_unix(sudo:session): session closed for user root Jun 29 03:27:42 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d92ba817-f553-4795-a690-9d557e5751fd tempest-SnapshotsActionsTest-1128167461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-fcb2f3de-8d93-414c-92d7-f6039a136688" returned: 0 in 0.864s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:27:42 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-d92ba817-f553-4795-a690-9d557e5751fd tempest-SnapshotsActionsTest-1128167461 None] <== create_volume: return (1959ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:27:42 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-d92ba817-f553-4795-a690-9d557e5751fd tempest-SnapshotsActionsTest-1128167461 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.962s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:27:42 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-d92ba817-f553-4795-a690-9d557e5751fd tempest-SnapshotsActionsTest-1128167461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c8e6bff-3bf1-4f39-9915-88ff3480b4c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fcb2f3de-8d93-414c-92d7-f6039a136688', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:27:42 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-d92ba817-f553-4795-a690-9d557e5751fd tempest-SnapshotsActionsTest-1128167461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (414895e1-2af6-43aa-ac9b-c71c8169485e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:27:42 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d807476-280b-4e83-a282-cc3aae52b80e tempest-ServersNegativeTestJSON-553004994 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:27:42 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-8d807476-280b-4e83-a282-cc3aae52b80e tempest-ServersNegativeTestJSON-553004994 None] Flow 'volume_create_manager' (fd8e5063-95ee-4295-9ffa-137b5e5698f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:27:42 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-8d807476-280b-4e83-a282-cc3aae52b80e tempest-ServersNegativeTestJSON-553004994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a38e5286-8541-49c4-86af-69d514dd60de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:27:42 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-d92ba817-f553-4795-a690-9d557e5751fd tempest-SnapshotsActionsTest-1128167461 None] Volume volume-fcb2f3de-8d93-414c-92d7-f6039a136688 (fcb2f3de-8d93-414c-92d7-f6039a136688): created successfully Jun 29 03:27:42 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-d92ba817-f553-4795-a690-9d557e5751fd tempest-SnapshotsActionsTest-1128167461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (414895e1-2af6-43aa-ac9b-c71c8169485e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:27:42 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-d92ba817-f553-4795-a690-9d557e5751fd tempest-SnapshotsActionsTest-1128167461 None] Flow 'volume_create_manager' (426a86d5-d210-4026-aebe-bb701ecbe075) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:27:42 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-8d807476-280b-4e83-a282-cc3aae52b80e tempest-ServersNegativeTestJSON-553004994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a38e5286-8541-49c4-86af-69d514dd60de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:27:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1517463689',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91898436-c60f-4a3d-b1dc-f7b3c6bf830d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66f3668198c04b3cbab4fd2b74a19218',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:27:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:27:42Z,use_quota=True,user_id='26f520415e9041bcba44332c019e0818',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:27:42 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-8d807476-280b-4e83-a282-cc3aae52b80e tempest-ServersNegativeTestJSON-553004994 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b4eb670-956b-43bb-9475-d4ffc85d4dfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:27:42 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-8d807476-280b-4e83-a282-cc3aae52b80e tempest-ServersNegativeTestJSON-553004994 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b4eb670-956b-43bb-9475-d4ffc85d4dfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:27:42 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-8d807476-280b-4e83-a282-cc3aae52b80e tempest-ServersNegativeTestJSON-553004994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cc639c5-0ee2-4121-96e3-c51542d20212) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:27:42 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-8d807476-280b-4e83-a282-cc3aae52b80e tempest-ServersNegativeTestJSON-553004994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cc639c5-0ee2-4121-96e3-c51542d20212) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '91898436-c60f-4a3d-b1dc-f7b3c6bf830d', 'volume_name': 'volume-91898436-c60f-4a3d-b1dc-f7b3c6bf830d', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:27:42 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-8d807476-280b-4e83-a282-cc3aae52b80e tempest-ServersNegativeTestJSON-553004994 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77ad3695-d799-4427-8eb3-3247a72fb7a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:27:42 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-8d807476-280b-4e83-a282-cc3aae52b80e tempest-ServersNegativeTestJSON-553004994 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77ad3695-d799-4427-8eb3-3247a72fb7a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:27:42 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-8d807476-280b-4e83-a282-cc3aae52b80e tempest-ServersNegativeTestJSON-553004994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8dee480a-f09b-455c-bd7d-1499ae426ac7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:27:42 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-8d807476-280b-4e83-a282-cc3aae52b80e tempest-ServersNegativeTestJSON-553004994 None] Volume 91898436-c60f-4a3d-b1dc-f7b3c6bf830d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-91898436-c60f-4a3d-b1dc-f7b3c6bf830d', 'volume_size': 1} Jun 29 03:27:42 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-8d807476-280b-4e83-a282-cc3aae52b80e tempest-ServersNegativeTestJSON-553004994 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:27:42 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-8d807476-280b-4e83-a282-cc3aae52b80e tempest-ServersNegativeTestJSON-553004994 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:27:42 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-8d807476-280b-4e83-a282-cc3aae52b80e tempest-ServersNegativeTestJSON-553004994 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:27:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1517463689',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91898436-c60f-4a3d-b1dc-f7b3c6bf830d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66f3668198c04b3cbab4fd2b74a19218',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:27:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:27:42Z,use_quota=True,user_id='26f520415e9041bcba44332c019e0818',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:27:42 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-8d807476-280b-4e83-a282-cc3aae52b80e tempest-ServersNegativeTestJSON-553004994 None] Creating volume 91898436-c60f-4a3d-b1dc-f7b3c6bf830d {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:27:42 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-8d807476-280b-4e83-a282-cc3aae52b80e tempest-ServersNegativeTestJSON-553004994 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:27:42 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-8d807476-280b-4e83-a282-cc3aae52b80e tempest-ServersNegativeTestJSON-553004994 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:27:42 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-8d807476-280b-4e83-a282-cc3aae52b80e tempest-ServersNegativeTestJSON-553004994 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:27:42 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-8d807476-280b-4e83-a282-cc3aae52b80e tempest-ServersNegativeTestJSON-553004994 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:27:42 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-8d807476-280b-4e83-a282-cc3aae52b80e tempest-ServersNegativeTestJSON-553004994 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:27:42 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-8d807476-280b-4e83-a282-cc3aae52b80e tempest-ServersNegativeTestJSON-553004994 None] Selected osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:27:42 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-8d807476-280b-4e83-a282-cc3aae52b80e tempest-ServersNegativeTestJSON-553004994 None] casted to osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f Jun 29 03:27:42 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-8d807476-280b-4e83-a282-cc3aae52b80e tempest-ServersNegativeTestJSON-553004994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-91898436-c60f-4a3d-b1dc-f7b3c6bf830d 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:27:42 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-d92ba817-f553-4795-a690-9d557e5751fd tempest-SnapshotsActionsTest-1128167461 None] Created volume successfully. Jun 29 03:27:42 devstack sudo[101878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-91898436-c60f-4a3d-b1dc-f7b3c6bf830d 1073741824 Jun 29 03:27:42 devstack sudo[101878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:27:42 devstack sudo[101874]: pam_unix(sudo:session): session closed for user root Jun 29 03:27:42 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-0ac1967e-e6a0-4647-8aae-45a2688a79b4 tempest-AbsoluteLimitsTests-513263155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf" returned: 0 in 0.967s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:27:42 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-0ac1967e-e6a0-4647-8aae-45a2688a79b4 tempest-AbsoluteLimitsTests-513263155 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:27:42 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-0ac1967e-e6a0-4647-8aae-45a2688a79b4 tempest-AbsoluteLimitsTests-513263155 None] Deleted volume successfully. Jun 29 03:27:42 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-d007ba8a-64a7-437c-87eb-772334fa6a79 tempest-GroupSnapshotsTest-1771286532 None] Acquiring lock "cinder-quobyte-5e19eaf1-a05c-4b25-a244-492af7d46947" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:27:42 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-d007ba8a-64a7-437c-87eb-772334fa6a79 tempest-GroupSnapshotsTest-1771286532 None] Lock "cinder-quobyte-5e19eaf1-a05c-4b25-a244-492af7d46947" acquired by "delete_volume" :: waited 0.039s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:27:42 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-0ac1967e-e6a0-4647-8aae-45a2688a79b4 tempest-AbsoluteLimitsTests-513263155 None] Lock "cinder-0bd90e0b-d889-46b2-ba78-f0d2f5094456-delete_volume" released by "delete_volume" :: held 2.956s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:27:42 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[df81a8a1-8d1c-4fc4-af74-a2230ed4f7e3]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:27:42 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d007ba8a-64a7-437c-87eb-772334fa6a79 tempest-GroupSnapshotsTest-1771286532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-5e19eaf1-a05c-4b25-a244-492af7d46947 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:27:42 devstack sudo[101880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-5e19eaf1-a05c-4b25-a244-492af7d46947 Jun 29 03:27:42 devstack sudo[101880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:27:43 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-c630e9c1-65d8-4854-ad9d-d5b6221989d4 tempest-SnapshotsActionsTest-1128167461 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:27:43 devstack sudo[101878]: pam_unix(sudo:session): session closed for user root Jun 29 03:27:43 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-8d807476-280b-4e83-a282-cc3aae52b80e tempest-ServersNegativeTestJSON-553004994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-91898436-c60f-4a3d-b1dc-f7b3c6bf830d 1073741824" returned: 0 in 1.086s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:27:43 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-8d807476-280b-4e83-a282-cc3aae52b80e tempest-ServersNegativeTestJSON-553004994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-91898436-c60f-4a3d-b1dc-f7b3c6bf830d {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:27:43 devstack sudo[101880]: pam_unix(sudo:session): session closed for user root Jun 29 03:27:43 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d007ba8a-64a7-437c-87eb-772334fa6a79 tempest-GroupSnapshotsTest-1771286532 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-5e19eaf1-a05c-4b25-a244-492af7d46947" returned: 0 in 0.915s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:27:43 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d007ba8a-64a7-437c-87eb-772334fa6a79 tempest-GroupSnapshotsTest-1771286532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-5e19eaf1-a05c-4b25-a244-492af7d46947 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:27:43 devstack sudo[101890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-91898436-c60f-4a3d-b1dc-f7b3c6bf830d Jun 29 03:27:43 devstack sudo[101890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:27:43 devstack sudo[101891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-5e19eaf1-a05c-4b25-a244-492af7d46947 Jun 29 03:27:43 devstack sudo[101891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:27:44 devstack sudo[101891]: pam_unix(sudo:session): session closed for user root Jun 29 03:27:44 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d007ba8a-64a7-437c-87eb-772334fa6a79 tempest-GroupSnapshotsTest-1771286532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-5e19eaf1-a05c-4b25-a244-492af7d46947" returned: 0 in 0.741s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:27:44 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-d007ba8a-64a7-437c-87eb-772334fa6a79 tempest-GroupSnapshotsTest-1771286532 None] Lock "cinder-quobyte-5e19eaf1-a05c-4b25-a244-492af7d46947" released by "delete_volume" :: held 1.753s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:27:44 devstack sudo[101890]: pam_unix(sudo:session): session closed for user root Jun 29 03:27:44 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-8d807476-280b-4e83-a282-cc3aae52b80e tempest-ServersNegativeTestJSON-553004994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-91898436-c60f-4a3d-b1dc-f7b3c6bf830d" returned: 0 in 0.854s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:27:44 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-8d807476-280b-4e83-a282-cc3aae52b80e tempest-ServersNegativeTestJSON-553004994 None] <== create_volume: return (2005ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:27:44 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-8d807476-280b-4e83-a282-cc3aae52b80e tempest-ServersNegativeTestJSON-553004994 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.011s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:27:44 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-c630e9c1-65d8-4854-ad9d-d5b6221989d4 tempest-SnapshotsActionsTest-1128167461 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.191s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:27:44 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-8d807476-280b-4e83-a282-cc3aae52b80e tempest-ServersNegativeTestJSON-553004994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8dee480a-f09b-455c-bd7d-1499ae426ac7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91898436-c60f-4a3d-b1dc-f7b3c6bf830d', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:27:44 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-8d807476-280b-4e83-a282-cc3aae52b80e tempest-ServersNegativeTestJSON-553004994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c11795d9-6fba-4ef7-9c16-976117f60e04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:27:44 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-d007ba8a-64a7-437c-87eb-772334fa6a79 tempest-GroupSnapshotsTest-1771286532 None] Created reservations ['e8129671-1db2-4229-80b9-35dc15b99ff3'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:27:44 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-8d807476-280b-4e83-a282-cc3aae52b80e tempest-ServersNegativeTestJSON-553004994 None] Volume volume-91898436-c60f-4a3d-b1dc-f7b3c6bf830d (91898436-c60f-4a3d-b1dc-f7b3c6bf830d): created successfully Jun 29 03:27:44 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-8d807476-280b-4e83-a282-cc3aae52b80e tempest-ServersNegativeTestJSON-553004994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c11795d9-6fba-4ef7-9c16-976117f60e04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:27:44 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-8d807476-280b-4e83-a282-cc3aae52b80e tempest-ServersNegativeTestJSON-553004994 None] Flow 'volume_create_manager' (fd8e5063-95ee-4295-9ffa-137b5e5698f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:27:44 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-c630e9c1-65d8-4854-ad9d-d5b6221989d4 tempest-SnapshotsActionsTest-1128167461 None] Creating offline snapshot c3e55f9e-2e31-4138-aceb-692b76d90d5b of volume fcb2f3de-8d93-414c-92d7-f6039a136688 {{(pid=93468) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 29 03:27:44 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-8d807476-280b-4e83-a282-cc3aae52b80e tempest-ServersNegativeTestJSON-553004994 None] Created volume successfully. Jun 29 03:27:44 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5cd868a-cb9b-4f0e-a158-94244c4cc54a]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:27:44 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c630e9c1-65d8-4854-ad9d-d5b6221989d4 tempest-SnapshotsActionsTest-1128167461 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-fcb2f3de-8d93-414c-92d7-f6039a136688 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:27:44 devstack cinder-volume[93468]: WARNING cinder.quota [None req-d007ba8a-64a7-437c-87eb-772334fa6a79 tempest-GroupSnapshotsTest-1771286532 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1486315392 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1486315392, it is now deprecated. Please use the default quota class for default quota. Jun 29 03:27:44 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-d007ba8a-64a7-437c-87eb-772334fa6a79 tempest-GroupSnapshotsTest-1771286532 None] Created reservations ['80dab4b3-3300-4b95-b835-7c209abaa11a', '12a071c9-466d-4c23-ba56-26d242507c91', '17762e44-87c8-4b8b-99eb-7213de12b177', '3063c949-71d1-48ad-a7df-c6968082b570'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:27:44 devstack sudo[101897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-fcb2f3de-8d93-414c-92d7-f6039a136688 Jun 29 03:27:44 devstack sudo[101897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:27:44 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-d007ba8a-64a7-437c-87eb-772334fa6a79 tempest-GroupSnapshotsTest-1771286532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:27:44 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-d007ba8a-64a7-437c-87eb-772334fa6a79 tempest-GroupSnapshotsTest-1771286532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:27:44 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-d007ba8a-64a7-437c-87eb-772334fa6a79 tempest-GroupSnapshotsTest-1771286532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:27:44 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-d007ba8a-64a7-437c-87eb-772334fa6a79 tempest-GroupSnapshotsTest-1771286532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:27:44 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-d007ba8a-64a7-437c-87eb-772334fa6a79 tempest-GroupSnapshotsTest-1771286532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:27:44 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d007ba8a-64a7-437c-87eb-772334fa6a79 tempest-GroupSnapshotsTest-1771286532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:27:44 devstack sudo[101899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf Jun 29 03:27:44 devstack sudo[101899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:27:45 devstack sudo[101899]: pam_unix(sudo:session): session closed for user root Jun 29 03:27:45 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d007ba8a-64a7-437c-87eb-772334fa6a79 tempest-GroupSnapshotsTest-1771286532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf" returned: 0 in 0.859s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:27:45 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-d007ba8a-64a7-437c-87eb-772334fa6a79 tempest-GroupSnapshotsTest-1771286532 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:27:45 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-d007ba8a-64a7-437c-87eb-772334fa6a79 tempest-GroupSnapshotsTest-1771286532 None] Delete group completed successfully. Jun 29 03:27:45 devstack sudo[101897]: pam_unix(sudo:session): session closed for user root Jun 29 03:27:45 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c630e9c1-65d8-4854-ad9d-d5b6221989d4 tempest-SnapshotsActionsTest-1128167461 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-fcb2f3de-8d93-414c-92d7-f6039a136688" returned: 0 in 1.228s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:27:45 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c630e9c1-65d8-4854-ad9d-d5b6221989d4 tempest-SnapshotsActionsTest-1128167461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-fcb2f3de-8d93-414c-92d7-f6039a136688,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-fcb2f3de-8d93-414c-92d7-f6039a136688.c3e55f9e-2e31-4138-aceb-692b76d90d5b 1G {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:27:45 devstack sudo[101905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-fcb2f3de-8d93-414c-92d7-f6039a136688,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-fcb2f3de-8d93-414c-92d7-f6039a136688.c3e55f9e-2e31-4138-aceb-692b76d90d5b 1G Jun 29 03:27:45 devstack sudo[101905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:27:46 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-76896647-ffcd-428d-aa9a-acde23b1c0f6 tempest-ServersNegativeTestJSON-553004994 None] Acquiring lock "cinder-91898436-c60f-4a3d-b1dc-f7b3c6bf830d-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:27:46 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-76896647-ffcd-428d-aa9a-acde23b1c0f6 tempest-ServersNegativeTestJSON-553004994 None] Lock "cinder-91898436-c60f-4a3d-b1dc-f7b3c6bf830d-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:27:46 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-76896647-ffcd-428d-aa9a-acde23b1c0f6 tempest-ServersNegativeTestJSON-553004994 None] Acquiring lock "cinder-quobyte-91898436-c60f-4a3d-b1dc-f7b3c6bf830d" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:27:46 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-76896647-ffcd-428d-aa9a-acde23b1c0f6 tempest-ServersNegativeTestJSON-553004994 None] Lock "cinder-quobyte-91898436-c60f-4a3d-b1dc-f7b3c6bf830d" acquired by "delete_volume" :: waited 0.023s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:27:46 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[15abacec-d8b1-4d2c-a35e-9af5a95db01d]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:27:46 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-76896647-ffcd-428d-aa9a-acde23b1c0f6 tempest-ServersNegativeTestJSON-553004994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-91898436-c60f-4a3d-b1dc-f7b3c6bf830d {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:27:46 devstack sudo[101907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-91898436-c60f-4a3d-b1dc-f7b3c6bf830d Jun 29 03:27:46 devstack sudo[101907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:27:47 devstack sudo[101905]: pam_unix(sudo:session): session closed for user root Jun 29 03:27:47 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c630e9c1-65d8-4854-ad9d-d5b6221989d4 tempest-SnapshotsActionsTest-1128167461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-fcb2f3de-8d93-414c-92d7-f6039a136688,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-fcb2f3de-8d93-414c-92d7-f6039a136688.c3e55f9e-2e31-4138-aceb-692b76d90d5b 1G" returned: 0 in 1.121s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:27:47 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c630e9c1-65d8-4854-ad9d-d5b6221989d4 tempest-SnapshotsActionsTest-1128167461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fcb2f3de-8d93-414c-92d7-f6039a136688 -F qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-fcb2f3de-8d93-414c-92d7-f6039a136688.c3e55f9e-2e31-4138-aceb-692b76d90d5b {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:27:47 devstack sudo[101916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fcb2f3de-8d93-414c-92d7-f6039a136688 -F qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-fcb2f3de-8d93-414c-92d7-f6039a136688.c3e55f9e-2e31-4138-aceb-692b76d90d5b Jun 29 03:27:47 devstack sudo[101916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:27:47 devstack sudo[101907]: pam_unix(sudo:session): session closed for user root Jun 29 03:27:47 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-76896647-ffcd-428d-aa9a-acde23b1c0f6 tempest-ServersNegativeTestJSON-553004994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-91898436-c60f-4a3d-b1dc-f7b3c6bf830d" returned: 0 in 0.943s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:27:47 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-76896647-ffcd-428d-aa9a-acde23b1c0f6 tempest-ServersNegativeTestJSON-553004994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-91898436-c60f-4a3d-b1dc-f7b3c6bf830d {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:27:47 devstack sudo[101918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-91898436-c60f-4a3d-b1dc-f7b3c6bf830d Jun 29 03:27:47 devstack sudo[101918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:27:47 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d9b2af2-1852-48c2-940b-b4dc8c695349 tempest-VolumesDeleteCascade-818251270 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:27:47 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-1d9b2af2-1852-48c2-940b-b4dc8c695349 tempest-VolumesDeleteCascade-818251270 None] Flow 'volume_create_manager' (5b482c26-4eaa-4b34-b972-003149931bd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:27:47 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-1d9b2af2-1852-48c2-940b-b4dc8c695349 tempest-VolumesDeleteCascade-818251270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c72a2db8-efba-4503-b1b4-85b5cf744fa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:27:47 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-1d9b2af2-1852-48c2-940b-b4dc8c695349 tempest-VolumesDeleteCascade-818251270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c72a2db8-efba-4503-b1b4-85b5cf744fa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:27:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1481737006',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4597df4d-48fc-4845-887c-8d4bf4397add,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2db1d034d17b471ba2d5088777bb0fea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:27:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:27:48Z,use_quota=True,user_id='36967ac51ba843fd97571d21908bb3e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:27:47 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-1d9b2af2-1852-48c2-940b-b4dc8c695349 tempest-VolumesDeleteCascade-818251270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (680cc9dd-767c-49b3-81bb-bf7ee947569e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:27:47 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-1d9b2af2-1852-48c2-940b-b4dc8c695349 tempest-VolumesDeleteCascade-818251270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (680cc9dd-767c-49b3-81bb-bf7ee947569e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:27:47 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-1d9b2af2-1852-48c2-940b-b4dc8c695349 tempest-VolumesDeleteCascade-818251270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ad2c208-a12f-4c1e-b414-d946b4243c9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:27:47 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-1d9b2af2-1852-48c2-940b-b4dc8c695349 tempest-VolumesDeleteCascade-818251270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ad2c208-a12f-4c1e-b414-d946b4243c9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4597df4d-48fc-4845-887c-8d4bf4397add', 'volume_name': 'volume-4597df4d-48fc-4845-887c-8d4bf4397add', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:27:47 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-1d9b2af2-1852-48c2-940b-b4dc8c695349 tempest-VolumesDeleteCascade-818251270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e092e628-5d44-4b82-8de8-9139b4b3e39d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:27:47 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-1d9b2af2-1852-48c2-940b-b4dc8c695349 tempest-VolumesDeleteCascade-818251270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e092e628-5d44-4b82-8de8-9139b4b3e39d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:27:47 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-1d9b2af2-1852-48c2-940b-b4dc8c695349 tempest-VolumesDeleteCascade-818251270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d96b4236-69c4-4efd-aa55-249aee2c4006) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:27:47 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-1d9b2af2-1852-48c2-940b-b4dc8c695349 tempest-VolumesDeleteCascade-818251270 None] Volume 4597df4d-48fc-4845-887c-8d4bf4397add: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4597df4d-48fc-4845-887c-8d4bf4397add', 'volume_size': 1} Jun 29 03:27:47 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-1d9b2af2-1852-48c2-940b-b4dc8c695349 tempest-VolumesDeleteCascade-818251270 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:27:47 devstack sudo[101918]: pam_unix(sudo:session): session closed for user root Jun 29 03:27:47 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-76896647-ffcd-428d-aa9a-acde23b1c0f6 tempest-ServersNegativeTestJSON-553004994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-91898436-c60f-4a3d-b1dc-f7b3c6bf830d" returned: 0 in 0.867s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:27:47 devstack sudo[101916]: pam_unix(sudo:session): session closed for user root Jun 29 03:27:47 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c630e9c1-65d8-4854-ad9d-d5b6221989d4 tempest-SnapshotsActionsTest-1128167461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fcb2f3de-8d93-414c-92d7-f6039a136688 -F qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-fcb2f3de-8d93-414c-92d7-f6039a136688.c3e55f9e-2e31-4138-aceb-692b76d90d5b" returned: 0 in 0.951s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:27:47 devstack cinder-volume[93468]: WARNING cinder.volume.drivers.remotefs [None req-c630e9c1-65d8-4854-ad9d-d5b6221989d4 tempest-SnapshotsActionsTest-1128167461 None] /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-fcb2f3de-8d93-414c-92d7-f6039a136688.c3e55f9e-2e31-4138-aceb-692b76d90d5b is being set with open permissions: ugo+rw Jun 29 03:27:47 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c630e9c1-65d8-4854-ad9d-d5b6221989d4 tempest-SnapshotsActionsTest-1128167461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-fcb2f3de-8d93-414c-92d7-f6039a136688.c3e55f9e-2e31-4138-aceb-692b76d90d5b {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:27:47 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-76896647-ffcd-428d-aa9a-acde23b1c0f6 tempest-ServersNegativeTestJSON-553004994 None] Lock "cinder-quobyte-91898436-c60f-4a3d-b1dc-f7b3c6bf830d" released by "delete_volume" :: held 1.870s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:27:48 devstack sudo[101925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-fcb2f3de-8d93-414c-92d7-f6039a136688.c3e55f9e-2e31-4138-aceb-692b76d90d5b Jun 29 03:27:48 devstack sudo[101925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:27:48 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-76896647-ffcd-428d-aa9a-acde23b1c0f6 tempest-ServersNegativeTestJSON-553004994 None] Created reservations ['48650cd9-d28f-41b2-96cc-4e79d76cf918', 'effed043-eb2c-4bd6-b6ff-f3df3cb14e6d', 'e255e02b-9291-4d3d-b535-1e0a33ea87bd', '58253bed-c4fe-40a2-830d-f4126893c4a5'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:27:48 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-76896647-ffcd-428d-aa9a-acde23b1c0f6 tempest-ServersNegativeTestJSON-553004994 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:27:48 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-76896647-ffcd-428d-aa9a-acde23b1c0f6 tempest-ServersNegativeTestJSON-553004994 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:27:48 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-76896647-ffcd-428d-aa9a-acde23b1c0f6 tempest-ServersNegativeTestJSON-553004994 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:27:48 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-76896647-ffcd-428d-aa9a-acde23b1c0f6 tempest-ServersNegativeTestJSON-553004994 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:27:48 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-76896647-ffcd-428d-aa9a-acde23b1c0f6 tempest-ServersNegativeTestJSON-553004994 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:27:48 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-76896647-ffcd-428d-aa9a-acde23b1c0f6 tempest-ServersNegativeTestJSON-553004994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:27:48 devstack sudo[101927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf Jun 29 03:27:48 devstack sudo[101927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:27:48 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-c33b6305-9bb6-4945-95e1-5639859be281 tempest-ServersNegativeTestJSON-553004994 None] Acquiring lock "cinder-c1fc3c2b-afd8-4d12-90a5-241c7e8ae8ad-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:27:48 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-c33b6305-9bb6-4945-95e1-5639859be281 tempest-ServersNegativeTestJSON-553004994 None] Lock "cinder-c1fc3c2b-afd8-4d12-90a5-241c7e8ae8ad-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:27:48 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-c33b6305-9bb6-4945-95e1-5639859be281 tempest-ServersNegativeTestJSON-553004994 None] Acquiring lock "cinder-quobyte-c1fc3c2b-afd8-4d12-90a5-241c7e8ae8ad" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:27:48 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-c33b6305-9bb6-4945-95e1-5639859be281 tempest-ServersNegativeTestJSON-553004994 None] Lock "cinder-quobyte-c1fc3c2b-afd8-4d12-90a5-241c7e8ae8ad" acquired by "delete_volume" :: waited 0.020s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:27:48 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6f84f43-034d-4637-812b-33c7037c8c3c]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:27:48 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c33b6305-9bb6-4945-95e1-5639859be281 tempest-ServersNegativeTestJSON-553004994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-c1fc3c2b-afd8-4d12-90a5-241c7e8ae8ad {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:27:48 devstack sudo[101929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-c1fc3c2b-afd8-4d12-90a5-241c7e8ae8ad Jun 29 03:27:48 devstack sudo[101929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:27:48 devstack sudo[101925]: pam_unix(sudo:session): session closed for user root Jun 29 03:27:48 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c630e9c1-65d8-4854-ad9d-d5b6221989d4 tempest-SnapshotsActionsTest-1128167461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-fcb2f3de-8d93-414c-92d7-f6039a136688.c3e55f9e-2e31-4138-aceb-692b76d90d5b" returned: 0 in 0.950s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:27:48 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c630e9c1-65d8-4854-ad9d-d5b6221989d4 tempest-SnapshotsActionsTest-1128167461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-fcb2f3de-8d93-414c-92d7-f6039a136688.info {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:27:49 devstack sudo[101933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-fcb2f3de-8d93-414c-92d7-f6039a136688.info Jun 29 03:27:49 devstack sudo[101933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:27:49 devstack sudo[101927]: pam_unix(sudo:session): session closed for user root Jun 29 03:27:49 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-76896647-ffcd-428d-aa9a-acde23b1c0f6 tempest-ServersNegativeTestJSON-553004994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf" returned: 0 in 0.939s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:27:49 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-76896647-ffcd-428d-aa9a-acde23b1c0f6 tempest-ServersNegativeTestJSON-553004994 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:27:49 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-76896647-ffcd-428d-aa9a-acde23b1c0f6 tempest-ServersNegativeTestJSON-553004994 None] Deleted volume successfully. Jun 29 03:27:49 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-76896647-ffcd-428d-aa9a-acde23b1c0f6 tempest-ServersNegativeTestJSON-553004994 None] Lock "cinder-91898436-c60f-4a3d-b1dc-f7b3c6bf830d-delete_volume" released by "delete_volume" :: held 3.057s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:27:49 devstack sudo[101929]: pam_unix(sudo:session): session closed for user root Jun 29 03:27:49 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c33b6305-9bb6-4945-95e1-5639859be281 tempest-ServersNegativeTestJSON-553004994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-c1fc3c2b-afd8-4d12-90a5-241c7e8ae8ad" returned: 0 in 0.917s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:27:49 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c33b6305-9bb6-4945-95e1-5639859be281 tempest-ServersNegativeTestJSON-553004994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-c1fc3c2b-afd8-4d12-90a5-241c7e8ae8ad {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:27:49 devstack sudo[101938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-c1fc3c2b-afd8-4d12-90a5-241c7e8ae8ad Jun 29 03:27:49 devstack sudo[101938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:27:49 devstack sudo[101933]: pam_unix(sudo:session): session closed for user root Jun 29 03:27:49 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c630e9c1-65d8-4854-ad9d-d5b6221989d4 tempest-SnapshotsActionsTest-1128167461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-fcb2f3de-8d93-414c-92d7-f6039a136688.info" returned: 0 in 0.739s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:27:49 devstack cinder-volume[93468]: WARNING cinder.volume.drivers.remotefs [None req-c630e9c1-65d8-4854-ad9d-d5b6221989d4 tempest-SnapshotsActionsTest-1128167461 None] /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-fcb2f3de-8d93-414c-92d7-f6039a136688.info is being set with open permissions: ugo+rw Jun 29 03:27:49 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c630e9c1-65d8-4854-ad9d-d5b6221989d4 tempest-SnapshotsActionsTest-1128167461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-fcb2f3de-8d93-414c-92d7-f6039a136688.info {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:27:49 devstack sudo[101941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-fcb2f3de-8d93-414c-92d7-f6039a136688.info Jun 29 03:27:49 devstack sudo[101941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:27:50 devstack sudo[101938]: pam_unix(sudo:session): session closed for user root Jun 29 03:27:50 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c33b6305-9bb6-4945-95e1-5639859be281 tempest-ServersNegativeTestJSON-553004994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-c1fc3c2b-afd8-4d12-90a5-241c7e8ae8ad" returned: 0 in 0.736s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:27:50 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-c33b6305-9bb6-4945-95e1-5639859be281 tempest-ServersNegativeTestJSON-553004994 None] Lock "cinder-quobyte-c1fc3c2b-afd8-4d12-90a5-241c7e8ae8ad" released by "delete_volume" :: held 1.713s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:27:50 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-c33b6305-9bb6-4945-95e1-5639859be281 tempest-ServersNegativeTestJSON-553004994 None] Created reservations ['3a3a51b5-9baa-420d-af3f-a6f1914fdb91', '05503e0b-75b5-41ae-904f-b9ef2be932d4', '039eee6c-0f48-4493-85be-3c80356e9950', 'b8fea34d-0a94-4e77-bfde-a35604cb117a'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:27:50 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-c33b6305-9bb6-4945-95e1-5639859be281 tempest-ServersNegativeTestJSON-553004994 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:27:50 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-c33b6305-9bb6-4945-95e1-5639859be281 tempest-ServersNegativeTestJSON-553004994 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:27:50 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-c33b6305-9bb6-4945-95e1-5639859be281 tempest-ServersNegativeTestJSON-553004994 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:27:50 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-c33b6305-9bb6-4945-95e1-5639859be281 tempest-ServersNegativeTestJSON-553004994 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:27:50 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-c33b6305-9bb6-4945-95e1-5639859be281 tempest-ServersNegativeTestJSON-553004994 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:27:50 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c33b6305-9bb6-4945-95e1-5639859be281 tempest-ServersNegativeTestJSON-553004994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:27:50 devstack sudo[101945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf Jun 29 03:27:50 devstack sudo[101945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:27:50 devstack sudo[101941]: pam_unix(sudo:session): session closed for user root Jun 29 03:27:50 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c630e9c1-65d8-4854-ad9d-d5b6221989d4 tempest-SnapshotsActionsTest-1128167461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-fcb2f3de-8d93-414c-92d7-f6039a136688.info" returned: 0 in 0.679s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:27:50 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-c630e9c1-65d8-4854-ad9d-d5b6221989d4 tempest-SnapshotsActionsTest-1128167461 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.900s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:27:50 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-1d9b2af2-1852-48c2-940b-b4dc8c695349 tempest-VolumesDeleteCascade-818251270 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.495s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:27:50 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-1d9b2af2-1852-48c2-940b-b4dc8c695349 tempest-VolumesDeleteCascade-818251270 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:27:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1481737006',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4597df4d-48fc-4845-887c-8d4bf4397add,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2db1d034d17b471ba2d5088777bb0fea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:27:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:27:48Z,use_quota=True,user_id='36967ac51ba843fd97571d21908bb3e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:27:50 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-1d9b2af2-1852-48c2-940b-b4dc8c695349 tempest-VolumesDeleteCascade-818251270 None] Creating volume 4597df4d-48fc-4845-887c-8d4bf4397add {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:27:50 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-1d9b2af2-1852-48c2-940b-b4dc8c695349 tempest-VolumesDeleteCascade-818251270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:27:50 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-1d9b2af2-1852-48c2-940b-b4dc8c695349 tempest-VolumesDeleteCascade-818251270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:27:50 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-1d9b2af2-1852-48c2-940b-b4dc8c695349 tempest-VolumesDeleteCascade-818251270 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:27:50 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-1d9b2af2-1852-48c2-940b-b4dc8c695349 tempest-VolumesDeleteCascade-818251270 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:27:50 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-1d9b2af2-1852-48c2-940b-b4dc8c695349 tempest-VolumesDeleteCascade-818251270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:27:50 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-1d9b2af2-1852-48c2-940b-b4dc8c695349 tempest-VolumesDeleteCascade-818251270 None] Selected osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:27:50 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-1d9b2af2-1852-48c2-940b-b4dc8c695349 tempest-VolumesDeleteCascade-818251270 None] casted to osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f Jun 29 03:27:50 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-1d9b2af2-1852-48c2-940b-b4dc8c695349 tempest-VolumesDeleteCascade-818251270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-4597df4d-48fc-4845-887c-8d4bf4397add 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:27:50 devstack sudo[101947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-4597df4d-48fc-4845-887c-8d4bf4397add 1073741824 Jun 29 03:27:50 devstack sudo[101947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:27:50 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-c630e9c1-65d8-4854-ad9d-d5b6221989d4 tempest-SnapshotsActionsTest-1128167461 None] Create snapshot completed successfully Jun 29 03:27:51 devstack sudo[101945]: pam_unix(sudo:session): session closed for user root Jun 29 03:27:51 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c33b6305-9bb6-4945-95e1-5639859be281 tempest-ServersNegativeTestJSON-553004994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf" returned: 0 in 0.889s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:27:51 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-c33b6305-9bb6-4945-95e1-5639859be281 tempest-ServersNegativeTestJSON-553004994 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:27:51 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-c33b6305-9bb6-4945-95e1-5639859be281 tempest-ServersNegativeTestJSON-553004994 None] Deleted volume successfully. Jun 29 03:27:51 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-c33b6305-9bb6-4945-95e1-5639859be281 tempest-ServersNegativeTestJSON-553004994 None] Lock "cinder-c1fc3c2b-afd8-4d12-90a5-241c7e8ae8ad-delete_volume" released by "delete_volume" :: held 2.842s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:27:51 devstack sudo[101947]: pam_unix(sudo:session): session closed for user root Jun 29 03:27:51 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-1d9b2af2-1852-48c2-940b-b4dc8c695349 tempest-VolumesDeleteCascade-818251270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-4597df4d-48fc-4845-887c-8d4bf4397add 1073741824" returned: 0 in 1.189s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:27:51 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-1d9b2af2-1852-48c2-940b-b4dc8c695349 tempest-VolumesDeleteCascade-818251270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-4597df4d-48fc-4845-887c-8d4bf4397add {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:27:51 devstack sudo[101956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-4597df4d-48fc-4845-887c-8d4bf4397add Jun 29 03:27:51 devstack sudo[101956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:27:51 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-e8fa8cbf-0a29-45b5-82f8-e39faa39a0ef tempest-SnapshotsActionsTest-1128167461 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:27:52 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-d5f672fc-69b4-4911-b12d-ed826dac1da9 tempest-GroupSnapshotsV319Test-738976124 None] Group tempest-GroupSnapshotsV319Test-Group-2086913655: creating Jun 29 03:27:52 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-d5f672fc-69b4-4911-b12d-ed826dac1da9 tempest-GroupSnapshotsV319Test-738976124 None] Group tempest-GroupSnapshotsV319Test-Group-2086913655: created successfully Jun 29 03:27:52 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-d5f672fc-69b4-4911-b12d-ed826dac1da9 tempest-GroupSnapshotsV319Test-738976124 None] Create group completed successfully. Jun 29 03:27:52 devstack sudo[101956]: pam_unix(sudo:session): session closed for user root Jun 29 03:27:52 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-1d9b2af2-1852-48c2-940b-b4dc8c695349 tempest-VolumesDeleteCascade-818251270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-4597df4d-48fc-4845-887c-8d4bf4397add" returned: 0 in 0.795s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:27:52 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-1d9b2af2-1852-48c2-940b-b4dc8c695349 tempest-VolumesDeleteCascade-818251270 None] <== create_volume: return (2046ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:27:52 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-1d9b2af2-1852-48c2-940b-b4dc8c695349 tempest-VolumesDeleteCascade-818251270 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.051s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:27:52 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-e8fa8cbf-0a29-45b5-82f8-e39faa39a0ef tempest-SnapshotsActionsTest-1128167461 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.734s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:27:52 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-1d9b2af2-1852-48c2-940b-b4dc8c695349 tempest-VolumesDeleteCascade-818251270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d96b4236-69c4-4efd-aa55-249aee2c4006) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4597df4d-48fc-4845-887c-8d4bf4397add', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:27:52 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-1d9b2af2-1852-48c2-940b-b4dc8c695349 tempest-VolumesDeleteCascade-818251270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bfd4465-3a7c-4d86-88a9-cb7e577f3cf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:27:52 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-1d9b2af2-1852-48c2-940b-b4dc8c695349 tempest-VolumesDeleteCascade-818251270 None] Volume volume-4597df4d-48fc-4845-887c-8d4bf4397add (4597df4d-48fc-4845-887c-8d4bf4397add): created successfully Jun 29 03:27:52 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-1d9b2af2-1852-48c2-940b-b4dc8c695349 tempest-VolumesDeleteCascade-818251270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bfd4465-3a7c-4d86-88a9-cb7e577f3cf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:27:52 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-1d9b2af2-1852-48c2-940b-b4dc8c695349 tempest-VolumesDeleteCascade-818251270 None] Flow 'volume_create_manager' (5b482c26-4eaa-4b34-b972-003149931bd8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:27:52 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-e8fa8cbf-0a29-45b5-82f8-e39faa39a0ef tempest-SnapshotsActionsTest-1128167461 None] Creating offline snapshot e1f072a9-ff0c-4e43-b18a-7df8d83a0896 of volume fcb2f3de-8d93-414c-92d7-f6039a136688 {{(pid=93468) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 29 03:27:52 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[c20c90bd-d0c1-403e-be07-8179dfce184f]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:27:52 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-e8fa8cbf-0a29-45b5-82f8-e39faa39a0ef tempest-SnapshotsActionsTest-1128167461 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-fcb2f3de-8d93-414c-92d7-f6039a136688.c3e55f9e-2e31-4138-aceb-692b76d90d5b {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:27:52 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-1d9b2af2-1852-48c2-940b-b4dc8c695349 tempest-VolumesDeleteCascade-818251270 None] Created volume successfully. Jun 29 03:27:52 devstack sudo[102001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-fcb2f3de-8d93-414c-92d7-f6039a136688.c3e55f9e-2e31-4138-aceb-692b76d90d5b Jun 29 03:27:52 devstack sudo[102001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:27:53 devstack sudo[102001]: pam_unix(sudo:session): session closed for user root Jun 29 03:27:53 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-e8fa8cbf-0a29-45b5-82f8-e39faa39a0ef tempest-SnapshotsActionsTest-1128167461 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-fcb2f3de-8d93-414c-92d7-f6039a136688.c3e55f9e-2e31-4138-aceb-692b76d90d5b" returned: 0 in 0.809s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:27:53 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-e8fa8cbf-0a29-45b5-82f8-e39faa39a0ef tempest-SnapshotsActionsTest-1128167461 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fcb2f3de-8d93-414c-92d7-f6039a136688(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93468) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 29 03:27:53 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-e8fa8cbf-0a29-45b5-82f8-e39faa39a0ef tempest-SnapshotsActionsTest-1128167461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-fcb2f3de-8d93-414c-92d7-f6039a136688.c3e55f9e-2e31-4138-aceb-692b76d90d5b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-fcb2f3de-8d93-414c-92d7-f6039a136688.e1f072a9-ff0c-4e43-b18a-7df8d83a0896 1G {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:27:53 devstack sudo[102007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-fcb2f3de-8d93-414c-92d7-f6039a136688.c3e55f9e-2e31-4138-aceb-692b76d90d5b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-fcb2f3de-8d93-414c-92d7-f6039a136688.e1f072a9-ff0c-4e43-b18a-7df8d83a0896 1G Jun 29 03:27:53 devstack sudo[102007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:27:53 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-226e7fe2-de14-46de-b517-078a5ae204dc tempest-VolumesDeleteCascade-818251270 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:27:53 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d2fa3db-bffe-4598-be36-b0eb4ac24b9a tempest-GroupSnapshotsV319Test-738976124 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:27:53 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-3d2fa3db-bffe-4598-be36-b0eb4ac24b9a tempest-GroupSnapshotsV319Test-738976124 None] Flow 'volume_create_manager' (b53026ee-4ddd-485b-b24c-f60aed97285f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:27:53 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-3d2fa3db-bffe-4598-be36-b0eb4ac24b9a tempest-GroupSnapshotsV319Test-738976124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90a7caa1-93c3-4063-ba87-fc68e932fe85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:27:53 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-3d2fa3db-bffe-4598-be36-b0eb4ac24b9a tempest-GroupSnapshotsV319Test-738976124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90a7caa1-93c3-4063-ba87-fc68e932fe85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:27:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-199070410',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6a4317f5-dc7c-453e-92fd-ef94b389af76,host='devstack@QuobyteHD#QuobyteHD',id=2e73952a-1861-4610-b662-1bceddc5a502,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9aef4eb9dbfe4e18a61541b893ab95e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:27:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:27:54Z,use_quota=True,user_id='b849409ca0f347a6a62a87f383b67b2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34f7c18a-2f98-43ca-8988-423aae979227),volume_type_id=34f7c18a-2f98-43ca-8988-423aae979227)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:27:53 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-3d2fa3db-bffe-4598-be36-b0eb4ac24b9a tempest-GroupSnapshotsV319Test-738976124 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7225ab9e-05cd-448a-8ea1-ef40d733e199) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:27:53 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-3d2fa3db-bffe-4598-be36-b0eb4ac24b9a tempest-GroupSnapshotsV319Test-738976124 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7225ab9e-05cd-448a-8ea1-ef40d733e199) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:27:53 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-3d2fa3db-bffe-4598-be36-b0eb4ac24b9a tempest-GroupSnapshotsV319Test-738976124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2bf05ed-fc64-4e1f-a28a-403c45f9fcac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:27:53 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-3d2fa3db-bffe-4598-be36-b0eb4ac24b9a tempest-GroupSnapshotsV319Test-738976124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2bf05ed-fc64-4e1f-a28a-403c45f9fcac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e73952a-1861-4610-b662-1bceddc5a502', 'volume_name': 'volume-2e73952a-1861-4610-b662-1bceddc5a502', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:27:53 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-3d2fa3db-bffe-4598-be36-b0eb4ac24b9a tempest-GroupSnapshotsV319Test-738976124 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5ae6c68-7405-4f15-a3ba-0bfe0004cdc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:27:53 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-3d2fa3db-bffe-4598-be36-b0eb4ac24b9a tempest-GroupSnapshotsV319Test-738976124 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5ae6c68-7405-4f15-a3ba-0bfe0004cdc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:27:53 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-3d2fa3db-bffe-4598-be36-b0eb4ac24b9a tempest-GroupSnapshotsV319Test-738976124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4135e8f7-0e3b-448e-a151-8589c653ad5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:27:53 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-3d2fa3db-bffe-4598-be36-b0eb4ac24b9a tempest-GroupSnapshotsV319Test-738976124 None] Volume 2e73952a-1861-4610-b662-1bceddc5a502: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e73952a-1861-4610-b662-1bceddc5a502', 'volume_size': 1} Jun 29 03:27:53 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-3d2fa3db-bffe-4598-be36-b0eb4ac24b9a tempest-GroupSnapshotsV319Test-738976124 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:27:54 devstack sudo[102007]: pam_unix(sudo:session): session closed for user root Jun 29 03:27:54 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-e8fa8cbf-0a29-45b5-82f8-e39faa39a0ef tempest-SnapshotsActionsTest-1128167461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-fcb2f3de-8d93-414c-92d7-f6039a136688.c3e55f9e-2e31-4138-aceb-692b76d90d5b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-fcb2f3de-8d93-414c-92d7-f6039a136688.e1f072a9-ff0c-4e43-b18a-7df8d83a0896 1G" returned: 0 in 0.966s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:27:54 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-e8fa8cbf-0a29-45b5-82f8-e39faa39a0ef tempest-SnapshotsActionsTest-1128167461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fcb2f3de-8d93-414c-92d7-f6039a136688.c3e55f9e-2e31-4138-aceb-692b76d90d5b -F qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-fcb2f3de-8d93-414c-92d7-f6039a136688.e1f072a9-ff0c-4e43-b18a-7df8d83a0896 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:27:54 devstack sudo[102015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fcb2f3de-8d93-414c-92d7-f6039a136688.c3e55f9e-2e31-4138-aceb-692b76d90d5b -F qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-fcb2f3de-8d93-414c-92d7-f6039a136688.e1f072a9-ff0c-4e43-b18a-7df8d83a0896 Jun 29 03:27:54 devstack sudo[102015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:27:55 devstack sudo[102015]: pam_unix(sudo:session): session closed for user root Jun 29 03:27:55 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-e8fa8cbf-0a29-45b5-82f8-e39faa39a0ef tempest-SnapshotsActionsTest-1128167461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fcb2f3de-8d93-414c-92d7-f6039a136688.c3e55f9e-2e31-4138-aceb-692b76d90d5b -F qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-fcb2f3de-8d93-414c-92d7-f6039a136688.e1f072a9-ff0c-4e43-b18a-7df8d83a0896" returned: 0 in 0.704s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:27:55 devstack cinder-volume[93468]: WARNING cinder.volume.drivers.remotefs [None req-e8fa8cbf-0a29-45b5-82f8-e39faa39a0ef tempest-SnapshotsActionsTest-1128167461 None] /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-fcb2f3de-8d93-414c-92d7-f6039a136688.e1f072a9-ff0c-4e43-b18a-7df8d83a0896 is being set with open permissions: ugo+rw Jun 29 03:27:55 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-e8fa8cbf-0a29-45b5-82f8-e39faa39a0ef tempest-SnapshotsActionsTest-1128167461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-fcb2f3de-8d93-414c-92d7-f6039a136688.e1f072a9-ff0c-4e43-b18a-7df8d83a0896 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:27:55 devstack sudo[102020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-fcb2f3de-8d93-414c-92d7-f6039a136688.e1f072a9-ff0c-4e43-b18a-7df8d83a0896 Jun 29 03:27:55 devstack sudo[102020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:27:55 devstack sudo[102020]: pam_unix(sudo:session): session closed for user root Jun 29 03:27:55 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-e8fa8cbf-0a29-45b5-82f8-e39faa39a0ef tempest-SnapshotsActionsTest-1128167461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-fcb2f3de-8d93-414c-92d7-f6039a136688.e1f072a9-ff0c-4e43-b18a-7df8d83a0896" returned: 0 in 0.613s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:27:55 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-e8fa8cbf-0a29-45b5-82f8-e39faa39a0ef tempest-SnapshotsActionsTest-1128167461 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.257s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:27:55 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-226e7fe2-de14-46de-b517-078a5ae204dc tempest-VolumesDeleteCascade-818251270 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.258s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:27:55 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-226e7fe2-de14-46de-b517-078a5ae204dc tempest-VolumesDeleteCascade-818251270 None] Creating offline snapshot 5ee15734-f951-4059-9184-e46f197a536b of volume 4597df4d-48fc-4845-887c-8d4bf4397add {{(pid=93468) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 29 03:27:55 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-e8fa8cbf-0a29-45b5-82f8-e39faa39a0ef tempest-SnapshotsActionsTest-1128167461 None] Create snapshot completed successfully Jun 29 03:27:55 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[506c9551-e614-4688-b63c-d07aa9a5011e]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:27:55 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-226e7fe2-de14-46de-b517-078a5ae204dc tempest-VolumesDeleteCascade-818251270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-4597df4d-48fc-4845-887c-8d4bf4397add {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:27:55 devstack sudo[102023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-4597df4d-48fc-4845-887c-8d4bf4397add Jun 29 03:27:55 devstack sudo[102023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:27:56 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-31f8bdfa-43c0-4b44-b57d-2fa76362c159 tempest-SnapshotsActionsTest-689442564 None] Acquiring lock "cinder-e1f072a9-ff0c-4e43-b18a-7df8d83a0896-delete_snapshot" by "delete_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:27:56 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-31f8bdfa-43c0-4b44-b57d-2fa76362c159 tempest-SnapshotsActionsTest-689442564 None] Lock "cinder-e1f072a9-ff0c-4e43-b18a-7df8d83a0896-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:27:56 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-31f8bdfa-43c0-4b44-b57d-2fa76362c159 tempest-SnapshotsActionsTest-689442564 None] Acquiring lock "cinder-quobyte-fcb2f3de-8d93-414c-92d7-f6039a136688" by "delete_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:27:56 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-31f8bdfa-43c0-4b44-b57d-2fa76362c159 tempest-SnapshotsActionsTest-689442564 None] Lock "cinder-quobyte-fcb2f3de-8d93-414c-92d7-f6039a136688" acquired by "delete_snapshot" :: waited 0.022s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:27:56 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-31f8bdfa-43c0-4b44-b57d-2fa76362c159 tempest-SnapshotsActionsTest-689442564 None] Acquiring lock "cinder-quobyte-e1f072a9-ff0c-4e43-b18a-7df8d83a0896" by "_delete_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:27:56 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-31f8bdfa-43c0-4b44-b57d-2fa76362c159 tempest-SnapshotsActionsTest-689442564 None] Lock "cinder-quobyte-e1f072a9-ff0c-4e43-b18a-7df8d83a0896" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:27:56 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-31f8bdfa-43c0-4b44-b57d-2fa76362c159 tempest-SnapshotsActionsTest-689442564 None] Deleting offline snapshot e1f072a9-ff0c-4e43-b18a-7df8d83a0896 of volume fcb2f3de-8d93-414c-92d7-f6039a136688 {{(pid=93468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 29 03:27:56 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-31f8bdfa-43c0-4b44-b57d-2fa76362c159 tempest-SnapshotsActionsTest-689442564 None] snapshot_file for this snap is: volume-fcb2f3de-8d93-414c-92d7-f6039a136688.e1f072a9-ff0c-4e43-b18a-7df8d83a0896 {{(pid=93468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 29 03:27:56 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8919891-fdca-4331-8436-afcb9a8c021e]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:27:56 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-31f8bdfa-43c0-4b44-b57d-2fa76362c159 tempest-SnapshotsActionsTest-689442564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-fcb2f3de-8d93-414c-92d7-f6039a136688.e1f072a9-ff0c-4e43-b18a-7df8d83a0896 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:27:56 devstack sudo[102025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-fcb2f3de-8d93-414c-92d7-f6039a136688.e1f072a9-ff0c-4e43-b18a-7df8d83a0896 Jun 29 03:27:56 devstack sudo[102025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:27:56 devstack sudo[102023]: pam_unix(sudo:session): session closed for user root Jun 29 03:27:56 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-226e7fe2-de14-46de-b517-078a5ae204dc tempest-VolumesDeleteCascade-818251270 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-4597df4d-48fc-4845-887c-8d4bf4397add" returned: 0 in 0.803s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:27:56 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-226e7fe2-de14-46de-b517-078a5ae204dc tempest-VolumesDeleteCascade-818251270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-4597df4d-48fc-4845-887c-8d4bf4397add,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-4597df4d-48fc-4845-887c-8d4bf4397add.5ee15734-f951-4059-9184-e46f197a536b 1G {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:27:56 devstack sudo[102030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-4597df4d-48fc-4845-887c-8d4bf4397add,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-4597df4d-48fc-4845-887c-8d4bf4397add.5ee15734-f951-4059-9184-e46f197a536b 1G Jun 29 03:27:56 devstack sudo[102030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:27:56 devstack sudo[102025]: pam_unix(sudo:session): session closed for user root Jun 29 03:27:56 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-31f8bdfa-43c0-4b44-b57d-2fa76362c159 tempest-SnapshotsActionsTest-689442564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-fcb2f3de-8d93-414c-92d7-f6039a136688.e1f072a9-ff0c-4e43-b18a-7df8d83a0896" returned: 0 in 0.770s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:27:56 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-31f8bdfa-43c0-4b44-b57d-2fa76362c159 tempest-SnapshotsActionsTest-689442564 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fcb2f3de-8d93-414c-92d7-f6039a136688(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93468) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 29 03:27:56 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[6385a47c-4624-4514-a7c0-cf70396e08d5]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:27:56 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-31f8bdfa-43c0-4b44-b57d-2fa76362c159 tempest-SnapshotsActionsTest-689442564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-fcb2f3de-8d93-414c-92d7-f6039a136688.c3e55f9e-2e31-4138-aceb-692b76d90d5b {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:27:57 devstack sudo[102035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-fcb2f3de-8d93-414c-92d7-f6039a136688.c3e55f9e-2e31-4138-aceb-692b76d90d5b Jun 29 03:27:57 devstack sudo[102035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:27:57 devstack sudo[102030]: pam_unix(sudo:session): session closed for user root Jun 29 03:27:57 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-226e7fe2-de14-46de-b517-078a5ae204dc tempest-VolumesDeleteCascade-818251270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-4597df4d-48fc-4845-887c-8d4bf4397add,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-4597df4d-48fc-4845-887c-8d4bf4397add.5ee15734-f951-4059-9184-e46f197a536b 1G" returned: 0 in 0.815s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:27:57 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-226e7fe2-de14-46de-b517-078a5ae204dc tempest-VolumesDeleteCascade-818251270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4597df4d-48fc-4845-887c-8d4bf4397add -F qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-4597df4d-48fc-4845-887c-8d4bf4397add.5ee15734-f951-4059-9184-e46f197a536b {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:27:57 devstack sudo[102040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4597df4d-48fc-4845-887c-8d4bf4397add -F qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-4597df4d-48fc-4845-887c-8d4bf4397add.5ee15734-f951-4059-9184-e46f197a536b Jun 29 03:27:57 devstack sudo[102040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:27:57 devstack sudo[102035]: pam_unix(sudo:session): session closed for user root Jun 29 03:27:57 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-31f8bdfa-43c0-4b44-b57d-2fa76362c159 tempest-SnapshotsActionsTest-689442564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-fcb2f3de-8d93-414c-92d7-f6039a136688.c3e55f9e-2e31-4138-aceb-692b76d90d5b" returned: 0 in 0.780s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:27:57 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-31f8bdfa-43c0-4b44-b57d-2fa76362c159 tempest-SnapshotsActionsTest-689442564 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fcb2f3de-8d93-414c-92d7-f6039a136688(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93468) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 29 03:27:57 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-31f8bdfa-43c0-4b44-b57d-2fa76362c159 tempest-SnapshotsActionsTest-689442564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-fcb2f3de-8d93-414c-92d7-f6039a136688.e1f072a9-ff0c-4e43-b18a-7df8d83a0896 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:27:57 devstack sudo[102045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-fcb2f3de-8d93-414c-92d7-f6039a136688.e1f072a9-ff0c-4e43-b18a-7df8d83a0896 Jun 29 03:27:57 devstack sudo[102045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:27:58 devstack sudo[102040]: pam_unix(sudo:session): session closed for user root Jun 29 03:27:58 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-226e7fe2-de14-46de-b517-078a5ae204dc tempest-VolumesDeleteCascade-818251270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4597df4d-48fc-4845-887c-8d4bf4397add -F qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-4597df4d-48fc-4845-887c-8d4bf4397add.5ee15734-f951-4059-9184-e46f197a536b" returned: 0 in 0.734s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:27:58 devstack cinder-volume[93468]: WARNING cinder.volume.drivers.remotefs [None req-226e7fe2-de14-46de-b517-078a5ae204dc tempest-VolumesDeleteCascade-818251270 None] /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-4597df4d-48fc-4845-887c-8d4bf4397add.5ee15734-f951-4059-9184-e46f197a536b is being set with open permissions: ugo+rw Jun 29 03:27:58 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-226e7fe2-de14-46de-b517-078a5ae204dc tempest-VolumesDeleteCascade-818251270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-4597df4d-48fc-4845-887c-8d4bf4397add.5ee15734-f951-4059-9184-e46f197a536b {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:27:58 devstack sudo[102050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-4597df4d-48fc-4845-887c-8d4bf4397add.5ee15734-f951-4059-9184-e46f197a536b Jun 29 03:27:58 devstack sudo[102050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:27:58 devstack sudo[102045]: pam_unix(sudo:session): session closed for user root Jun 29 03:27:58 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-31f8bdfa-43c0-4b44-b57d-2fa76362c159 tempest-SnapshotsActionsTest-689442564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-fcb2f3de-8d93-414c-92d7-f6039a136688.e1f072a9-ff0c-4e43-b18a-7df8d83a0896" returned: 0 in 0.752s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:27:58 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-31f8bdfa-43c0-4b44-b57d-2fa76362c159 tempest-SnapshotsActionsTest-689442564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-fcb2f3de-8d93-414c-92d7-f6039a136688.e1f072a9-ff0c-4e43-b18a-7df8d83a0896 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:27:58 devstack sudo[102055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-fcb2f3de-8d93-414c-92d7-f6039a136688.e1f072a9-ff0c-4e43-b18a-7df8d83a0896 Jun 29 03:27:58 devstack sudo[102055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:27:58 devstack sudo[102050]: pam_unix(sudo:session): session closed for user root Jun 29 03:27:58 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-226e7fe2-de14-46de-b517-078a5ae204dc tempest-VolumesDeleteCascade-818251270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-4597df4d-48fc-4845-887c-8d4bf4397add.5ee15734-f951-4059-9184-e46f197a536b" returned: 0 in 0.719s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:27:58 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-226e7fe2-de14-46de-b517-078a5ae204dc tempest-VolumesDeleteCascade-818251270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-4597df4d-48fc-4845-887c-8d4bf4397add.info {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:27:58 devstack sudo[102058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-4597df4d-48fc-4845-887c-8d4bf4397add.info Jun 29 03:27:58 devstack sudo[102058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:27:59 devstack sudo[102055]: pam_unix(sudo:session): session closed for user root Jun 29 03:27:59 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-31f8bdfa-43c0-4b44-b57d-2fa76362c159 tempest-SnapshotsActionsTest-689442564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-fcb2f3de-8d93-414c-92d7-f6039a136688.e1f072a9-ff0c-4e43-b18a-7df8d83a0896" returned: 0 in 0.715s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:27:59 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-31f8bdfa-43c0-4b44-b57d-2fa76362c159 tempest-SnapshotsActionsTest-689442564 None] Lock "cinder-quobyte-e1f072a9-ff0c-4e43-b18a-7df8d83a0896" released by "_delete_snapshot" :: held 3.139s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:27:59 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-31f8bdfa-43c0-4b44-b57d-2fa76362c159 tempest-SnapshotsActionsTest-689442564 None] Lock "cinder-quobyte-fcb2f3de-8d93-414c-92d7-f6039a136688" released by "delete_snapshot" :: held 3.166s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:27:59 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-31f8bdfa-43c0-4b44-b57d-2fa76362c159 tempest-SnapshotsActionsTest-689442564 None] Created reservations ['a2a2dfca-de5e-4258-b2de-cacb1dc3c548', 'bb245f7a-db15-435b-8a0c-e1dcab1548de', 'a3e544ba-5e51-4ea4-af94-a98c364d33a1', '8c29c990-924b-4e11-b4e7-5efbb08f3200'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:27:59 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-31f8bdfa-43c0-4b44-b57d-2fa76362c159 tempest-SnapshotsActionsTest-689442564 None] Delete snapshot completed successfully. Jun 29 03:27:59 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-31f8bdfa-43c0-4b44-b57d-2fa76362c159 tempest-SnapshotsActionsTest-689442564 None] Lock "cinder-e1f072a9-ff0c-4e43-b18a-7df8d83a0896-delete_snapshot" released by "delete_snapshot" :: held 3.328s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:27:59 devstack sudo[102058]: pam_unix(sudo:session): session closed for user root Jun 29 03:27:59 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-226e7fe2-de14-46de-b517-078a5ae204dc tempest-VolumesDeleteCascade-818251270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-4597df4d-48fc-4845-887c-8d4bf4397add.info" returned: 0 in 0.711s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:27:59 devstack cinder-volume[93468]: WARNING cinder.volume.drivers.remotefs [None req-226e7fe2-de14-46de-b517-078a5ae204dc tempest-VolumesDeleteCascade-818251270 None] /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-4597df4d-48fc-4845-887c-8d4bf4397add.info is being set with open permissions: ugo+rw Jun 29 03:27:59 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-226e7fe2-de14-46de-b517-078a5ae204dc tempest-VolumesDeleteCascade-818251270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-4597df4d-48fc-4845-887c-8d4bf4397add.info {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:27:59 devstack sudo[102062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-4597df4d-48fc-4845-887c-8d4bf4397add.info Jun 29 03:27:59 devstack sudo[102062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:28:00 devstack sudo[102062]: pam_unix(sudo:session): session closed for user root Jun 29 03:28:00 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-226e7fe2-de14-46de-b517-078a5ae204dc tempest-VolumesDeleteCascade-818251270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-4597df4d-48fc-4845-887c-8d4bf4397add.info" returned: 0 in 0.676s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:28:00 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-226e7fe2-de14-46de-b517-078a5ae204dc tempest-VolumesDeleteCascade-818251270 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.580s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:28:00 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-3d2fa3db-bffe-4598-be36-b0eb4ac24b9a tempest-GroupSnapshotsV319Test-738976124 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.445s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:28:00 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-3d2fa3db-bffe-4598-be36-b0eb4ac24b9a tempest-GroupSnapshotsV319Test-738976124 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=6a4317f5-dc7c-453e-92fd-ef94b389af76,created_at=2026-06-29T01:27:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-199070410',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6a4317f5-dc7c-453e-92fd-ef94b389af76,host='devstack@QuobyteHD#QuobyteHD',id=2e73952a-1861-4610-b662-1bceddc5a502,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9aef4eb9dbfe4e18a61541b893ab95e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:27:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:27:54Z,use_quota=True,user_id='b849409ca0f347a6a62a87f383b67b2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34f7c18a-2f98-43ca-8988-423aae979227),volume_type_id=34f7c18a-2f98-43ca-8988-423aae979227)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:28:00 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-3d2fa3db-bffe-4598-be36-b0eb4ac24b9a tempest-GroupSnapshotsV319Test-738976124 None] Creating volume 2e73952a-1861-4610-b662-1bceddc5a502 {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:28:00 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-3d2fa3db-bffe-4598-be36-b0eb4ac24b9a tempest-GroupSnapshotsV319Test-738976124 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:28:00 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-3d2fa3db-bffe-4598-be36-b0eb4ac24b9a tempest-GroupSnapshotsV319Test-738976124 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:28:00 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-3d2fa3db-bffe-4598-be36-b0eb4ac24b9a tempest-GroupSnapshotsV319Test-738976124 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:28:00 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-3d2fa3db-bffe-4598-be36-b0eb4ac24b9a tempest-GroupSnapshotsV319Test-738976124 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:28:00 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-3d2fa3db-bffe-4598-be36-b0eb4ac24b9a tempest-GroupSnapshotsV319Test-738976124 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:28:00 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-3d2fa3db-bffe-4598-be36-b0eb4ac24b9a tempest-GroupSnapshotsV319Test-738976124 None] Selected osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:28:00 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-3d2fa3db-bffe-4598-be36-b0eb4ac24b9a tempest-GroupSnapshotsV319Test-738976124 None] casted to osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f Jun 29 03:28:00 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-3d2fa3db-bffe-4598-be36-b0eb4ac24b9a tempest-GroupSnapshotsV319Test-738976124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-2e73952a-1861-4610-b662-1bceddc5a502 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:28:00 devstack sudo[102066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-2e73952a-1861-4610-b662-1bceddc5a502 1073741824 Jun 29 03:28:00 devstack sudo[102066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:28:00 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-226e7fe2-de14-46de-b517-078a5ae204dc tempest-VolumesDeleteCascade-818251270 None] Create snapshot completed successfully Jun 29 03:28:00 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-0d19b266-481b-47ab-a01e-3c1208dcbf95 tempest-SnapshotsActionsTest-1128167461 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:28:00 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-5c86b120-c164-4a20-9f56-533bc47c6a85 tempest-VolumesDeleteCascade-818251270 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:28:01 devstack sudo[102066]: pam_unix(sudo:session): session closed for user root Jun 29 03:28:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-3d2fa3db-bffe-4598-be36-b0eb4ac24b9a tempest-GroupSnapshotsV319Test-738976124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-2e73952a-1861-4610-b662-1bceddc5a502 1073741824" returned: 0 in 0.968s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:28:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-3d2fa3db-bffe-4598-be36-b0eb4ac24b9a tempest-GroupSnapshotsV319Test-738976124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-2e73952a-1861-4610-b662-1bceddc5a502 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:28:01 devstack sudo[102073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-2e73952a-1861-4610-b662-1bceddc5a502 Jun 29 03:28:01 devstack sudo[102073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:28:02 devstack sudo[102073]: pam_unix(sudo:session): session closed for user root Jun 29 03:28:02 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-3d2fa3db-bffe-4598-be36-b0eb4ac24b9a tempest-GroupSnapshotsV319Test-738976124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-2e73952a-1861-4610-b662-1bceddc5a502" returned: 0 in 0.765s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:28:02 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-3d2fa3db-bffe-4598-be36-b0eb4ac24b9a tempest-GroupSnapshotsV319Test-738976124 None] <== create_volume: return (1770ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:28:02 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-3d2fa3db-bffe-4598-be36-b0eb4ac24b9a tempest-GroupSnapshotsV319Test-738976124 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.773s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:28:02 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-0d19b266-481b-47ab-a01e-3c1208dcbf95 tempest-SnapshotsActionsTest-1128167461 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.507s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:28:02 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-0d19b266-481b-47ab-a01e-3c1208dcbf95 tempest-SnapshotsActionsTest-1128167461 None] Creating offline snapshot 0978fa85-c28a-4dfd-b22e-168500daaed5 of volume fcb2f3de-8d93-414c-92d7-f6039a136688 {{(pid=93468) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 29 03:28:02 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-3d2fa3db-bffe-4598-be36-b0eb4ac24b9a tempest-GroupSnapshotsV319Test-738976124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4135e8f7-0e3b-448e-a151-8589c653ad5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e73952a-1861-4610-b662-1bceddc5a502', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:28:02 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-3d2fa3db-bffe-4598-be36-b0eb4ac24b9a tempest-GroupSnapshotsV319Test-738976124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (badeee64-c2b9-4429-b33f-d18ae3a176a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:28:02 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a77bbbe-2b24-4310-ae9a-adf0347cc425]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:28:02 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-0d19b266-481b-47ab-a01e-3c1208dcbf95 tempest-SnapshotsActionsTest-1128167461 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-fcb2f3de-8d93-414c-92d7-f6039a136688.c3e55f9e-2e31-4138-aceb-692b76d90d5b {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:28:02 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-3d2fa3db-bffe-4598-be36-b0eb4ac24b9a tempest-GroupSnapshotsV319Test-738976124 None] Volume volume-2e73952a-1861-4610-b662-1bceddc5a502 (2e73952a-1861-4610-b662-1bceddc5a502): created successfully Jun 29 03:28:02 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-3d2fa3db-bffe-4598-be36-b0eb4ac24b9a tempest-GroupSnapshotsV319Test-738976124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (badeee64-c2b9-4429-b33f-d18ae3a176a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:28:02 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-3d2fa3db-bffe-4598-be36-b0eb4ac24b9a tempest-GroupSnapshotsV319Test-738976124 None] Flow 'volume_create_manager' (b53026ee-4ddd-485b-b24c-f60aed97285f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:28:02 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-3d2fa3db-bffe-4598-be36-b0eb4ac24b9a tempest-GroupSnapshotsV319Test-738976124 None] Created volume successfully. Jun 29 03:28:02 devstack sudo[102076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-fcb2f3de-8d93-414c-92d7-f6039a136688.c3e55f9e-2e31-4138-aceb-692b76d90d5b Jun 29 03:28:02 devstack sudo[102076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:28:02 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-ea752501-f4f1-4e18-8a75-ceec76dee658 tempest-GroupSnapshotsV319Test-738976124 None] GroupSnapshot 58564cbf-7e6d-4122-b13b-f9a8b92ee5bb: creating. Jun 29 03:28:02 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-ea752501-f4f1-4e18-8a75-ceec76dee658 tempest-GroupSnapshotsV319Test-738976124 None] Group snapshot 58564cbf-7e6d-4122-b13b-f9a8b92ee5bb: creating. {{(pid=93468) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jun 29 03:28:02 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-ea752501-f4f1-4e18-8a75-ceec76dee658 tempest-GroupSnapshotsV319Test-738976124 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:28:03 devstack sudo[102076]: pam_unix(sudo:session): session closed for user root Jun 29 03:28:03 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-0d19b266-481b-47ab-a01e-3c1208dcbf95 tempest-SnapshotsActionsTest-1128167461 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-fcb2f3de-8d93-414c-92d7-f6039a136688.c3e55f9e-2e31-4138-aceb-692b76d90d5b" returned: 0 in 0.914s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:28:03 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-0d19b266-481b-47ab-a01e-3c1208dcbf95 tempest-SnapshotsActionsTest-1128167461 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fcb2f3de-8d93-414c-92d7-f6039a136688(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93468) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 29 03:28:03 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-0d19b266-481b-47ab-a01e-3c1208dcbf95 tempest-SnapshotsActionsTest-1128167461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-fcb2f3de-8d93-414c-92d7-f6039a136688.c3e55f9e-2e31-4138-aceb-692b76d90d5b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-fcb2f3de-8d93-414c-92d7-f6039a136688.0978fa85-c28a-4dfd-b22e-168500daaed5 1G {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:28:03 devstack sudo[102082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-fcb2f3de-8d93-414c-92d7-f6039a136688.c3e55f9e-2e31-4138-aceb-692b76d90d5b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-fcb2f3de-8d93-414c-92d7-f6039a136688.0978fa85-c28a-4dfd-b22e-168500daaed5 1G Jun 29 03:28:03 devstack sudo[102082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:28:04 devstack sudo[102082]: pam_unix(sudo:session): session closed for user root Jun 29 03:28:04 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-0d19b266-481b-47ab-a01e-3c1208dcbf95 tempest-SnapshotsActionsTest-1128167461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-fcb2f3de-8d93-414c-92d7-f6039a136688.c3e55f9e-2e31-4138-aceb-692b76d90d5b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-fcb2f3de-8d93-414c-92d7-f6039a136688.0978fa85-c28a-4dfd-b22e-168500daaed5 1G" returned: 0 in 0.938s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:28:04 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-0d19b266-481b-47ab-a01e-3c1208dcbf95 tempest-SnapshotsActionsTest-1128167461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fcb2f3de-8d93-414c-92d7-f6039a136688.c3e55f9e-2e31-4138-aceb-692b76d90d5b -F qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-fcb2f3de-8d93-414c-92d7-f6039a136688.0978fa85-c28a-4dfd-b22e-168500daaed5 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:28:04 devstack sudo[102089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fcb2f3de-8d93-414c-92d7-f6039a136688.c3e55f9e-2e31-4138-aceb-692b76d90d5b -F qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-fcb2f3de-8d93-414c-92d7-f6039a136688.0978fa85-c28a-4dfd-b22e-168500daaed5 Jun 29 03:28:04 devstack sudo[102089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:28:04 devstack sudo[102089]: pam_unix(sudo:session): session closed for user root Jun 29 03:28:04 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-0d19b266-481b-47ab-a01e-3c1208dcbf95 tempest-SnapshotsActionsTest-1128167461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fcb2f3de-8d93-414c-92d7-f6039a136688.c3e55f9e-2e31-4138-aceb-692b76d90d5b -F qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-fcb2f3de-8d93-414c-92d7-f6039a136688.0978fa85-c28a-4dfd-b22e-168500daaed5" returned: 0 in 0.669s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:28:04 devstack cinder-volume[93468]: WARNING cinder.volume.drivers.remotefs [None req-0d19b266-481b-47ab-a01e-3c1208dcbf95 tempest-SnapshotsActionsTest-1128167461 None] /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-fcb2f3de-8d93-414c-92d7-f6039a136688.0978fa85-c28a-4dfd-b22e-168500daaed5 is being set with open permissions: ugo+rw Jun 29 03:28:04 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-0d19b266-481b-47ab-a01e-3c1208dcbf95 tempest-SnapshotsActionsTest-1128167461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-fcb2f3de-8d93-414c-92d7-f6039a136688.0978fa85-c28a-4dfd-b22e-168500daaed5 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:28:04 devstack sudo[102094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-fcb2f3de-8d93-414c-92d7-f6039a136688.0978fa85-c28a-4dfd-b22e-168500daaed5 Jun 29 03:28:04 devstack sudo[102094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:28:05 devstack sudo[102094]: pam_unix(sudo:session): session closed for user root Jun 29 03:28:05 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-0d19b266-481b-47ab-a01e-3c1208dcbf95 tempest-SnapshotsActionsTest-1128167461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-fcb2f3de-8d93-414c-92d7-f6039a136688.0978fa85-c28a-4dfd-b22e-168500daaed5" returned: 0 in 0.716s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:28:05 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-0d19b266-481b-47ab-a01e-3c1208dcbf95 tempest-SnapshotsActionsTest-1128167461 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.351s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:28:05 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-5c86b120-c164-4a20-9f56-533bc47c6a85 tempest-VolumesDeleteCascade-818251270 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.519s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:28:05 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-5c86b120-c164-4a20-9f56-533bc47c6a85 tempest-VolumesDeleteCascade-818251270 None] Creating offline snapshot c2f5a7ac-3dc6-45cd-b1ff-2398ad9630a8 of volume 4597df4d-48fc-4845-887c-8d4bf4397add {{(pid=93468) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 29 03:28:05 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2105bef-5611-4b8c-bd16-cd7bc7bcf49e]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:28:05 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-5c86b120-c164-4a20-9f56-533bc47c6a85 tempest-VolumesDeleteCascade-818251270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-4597df4d-48fc-4845-887c-8d4bf4397add.5ee15734-f951-4059-9184-e46f197a536b {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:28:05 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-0d19b266-481b-47ab-a01e-3c1208dcbf95 tempest-SnapshotsActionsTest-1128167461 None] Create snapshot completed successfully Jun 29 03:28:05 devstack sudo[102097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-4597df4d-48fc-4845-887c-8d4bf4397add.5ee15734-f951-4059-9184-e46f197a536b Jun 29 03:28:05 devstack sudo[102097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:28:06 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-0e23f36c-d0a0-4a68-aa15-3a5101eed295 tempest-SnapshotsActionsTest-689442564 None] Acquiring lock "cinder-0978fa85-c28a-4dfd-b22e-168500daaed5-delete_snapshot" by "delete_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:28:06 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-0e23f36c-d0a0-4a68-aa15-3a5101eed295 tempest-SnapshotsActionsTest-689442564 None] Lock "cinder-0978fa85-c28a-4dfd-b22e-168500daaed5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:28:06 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-0e23f36c-d0a0-4a68-aa15-3a5101eed295 tempest-SnapshotsActionsTest-689442564 None] Acquiring lock "cinder-quobyte-fcb2f3de-8d93-414c-92d7-f6039a136688" by "delete_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:28:06 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-0e23f36c-d0a0-4a68-aa15-3a5101eed295 tempest-SnapshotsActionsTest-689442564 None] Lock "cinder-quobyte-fcb2f3de-8d93-414c-92d7-f6039a136688" acquired by "delete_snapshot" :: waited 0.026s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:28:06 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-0e23f36c-d0a0-4a68-aa15-3a5101eed295 tempest-SnapshotsActionsTest-689442564 None] Acquiring lock "cinder-quobyte-0978fa85-c28a-4dfd-b22e-168500daaed5" by "_delete_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:28:06 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-0e23f36c-d0a0-4a68-aa15-3a5101eed295 tempest-SnapshotsActionsTest-689442564 None] Lock "cinder-quobyte-0978fa85-c28a-4dfd-b22e-168500daaed5" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:28:06 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-0e23f36c-d0a0-4a68-aa15-3a5101eed295 tempest-SnapshotsActionsTest-689442564 None] Deleting offline snapshot 0978fa85-c28a-4dfd-b22e-168500daaed5 of volume fcb2f3de-8d93-414c-92d7-f6039a136688 {{(pid=93468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 29 03:28:06 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-0e23f36c-d0a0-4a68-aa15-3a5101eed295 tempest-SnapshotsActionsTest-689442564 None] snapshot_file for this snap is: volume-fcb2f3de-8d93-414c-92d7-f6039a136688.0978fa85-c28a-4dfd-b22e-168500daaed5 {{(pid=93468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 29 03:28:06 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2f8ded7-9805-4bb9-8333-8941c6ab93ee]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:28:06 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-0e23f36c-d0a0-4a68-aa15-3a5101eed295 tempest-SnapshotsActionsTest-689442564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-fcb2f3de-8d93-414c-92d7-f6039a136688.0978fa85-c28a-4dfd-b22e-168500daaed5 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:28:06 devstack sudo[102099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-fcb2f3de-8d93-414c-92d7-f6039a136688.0978fa85-c28a-4dfd-b22e-168500daaed5 Jun 29 03:28:06 devstack sudo[102099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:28:06 devstack sudo[102097]: pam_unix(sudo:session): session closed for user root Jun 29 03:28:06 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-5c86b120-c164-4a20-9f56-533bc47c6a85 tempest-VolumesDeleteCascade-818251270 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-4597df4d-48fc-4845-887c-8d4bf4397add.5ee15734-f951-4059-9184-e46f197a536b" returned: 0 in 0.895s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:28:06 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-5c86b120-c164-4a20-9f56-533bc47c6a85 tempest-VolumesDeleteCascade-818251270 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4597df4d-48fc-4845-887c-8d4bf4397add(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93468) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 29 03:28:06 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-5c86b120-c164-4a20-9f56-533bc47c6a85 tempest-VolumesDeleteCascade-818251270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-4597df4d-48fc-4845-887c-8d4bf4397add.5ee15734-f951-4059-9184-e46f197a536b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-4597df4d-48fc-4845-887c-8d4bf4397add.c2f5a7ac-3dc6-45cd-b1ff-2398ad9630a8 1G {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:28:06 devstack sudo[102104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-4597df4d-48fc-4845-887c-8d4bf4397add.5ee15734-f951-4059-9184-e46f197a536b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-4597df4d-48fc-4845-887c-8d4bf4397add.c2f5a7ac-3dc6-45cd-b1ff-2398ad9630a8 1G Jun 29 03:28:06 devstack sudo[102104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:28:07 devstack sudo[102099]: pam_unix(sudo:session): session closed for user root Jun 29 03:28:07 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-0e23f36c-d0a0-4a68-aa15-3a5101eed295 tempest-SnapshotsActionsTest-689442564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-fcb2f3de-8d93-414c-92d7-f6039a136688.0978fa85-c28a-4dfd-b22e-168500daaed5" returned: 0 in 0.850s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:28:07 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-0e23f36c-d0a0-4a68-aa15-3a5101eed295 tempest-SnapshotsActionsTest-689442564 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fcb2f3de-8d93-414c-92d7-f6039a136688(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93468) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 29 03:28:07 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[3755794e-7aa3-4947-9ca5-4da9d6e23593]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:28:07 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-0e23f36c-d0a0-4a68-aa15-3a5101eed295 tempest-SnapshotsActionsTest-689442564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-fcb2f3de-8d93-414c-92d7-f6039a136688.c3e55f9e-2e31-4138-aceb-692b76d90d5b {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:28:07 devstack sudo[102112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-fcb2f3de-8d93-414c-92d7-f6039a136688.c3e55f9e-2e31-4138-aceb-692b76d90d5b Jun 29 03:28:07 devstack sudo[102112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:28:07 devstack sudo[102104]: pam_unix(sudo:session): session closed for user root Jun 29 03:28:07 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-5c86b120-c164-4a20-9f56-533bc47c6a85 tempest-VolumesDeleteCascade-818251270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-4597df4d-48fc-4845-887c-8d4bf4397add.5ee15734-f951-4059-9184-e46f197a536b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-4597df4d-48fc-4845-887c-8d4bf4397add.c2f5a7ac-3dc6-45cd-b1ff-2398ad9630a8 1G" returned: 0 in 0.929s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:28:07 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-5c86b120-c164-4a20-9f56-533bc47c6a85 tempest-VolumesDeleteCascade-818251270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4597df4d-48fc-4845-887c-8d4bf4397add.5ee15734-f951-4059-9184-e46f197a536b -F qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-4597df4d-48fc-4845-887c-8d4bf4397add.c2f5a7ac-3dc6-45cd-b1ff-2398ad9630a8 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:28:07 devstack sudo[102115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4597df4d-48fc-4845-887c-8d4bf4397add.5ee15734-f951-4059-9184-e46f197a536b -F qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-4597df4d-48fc-4845-887c-8d4bf4397add.c2f5a7ac-3dc6-45cd-b1ff-2398ad9630a8 Jun 29 03:28:07 devstack sudo[102115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:28:07 devstack sudo[102112]: pam_unix(sudo:session): session closed for user root Jun 29 03:28:07 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-0e23f36c-d0a0-4a68-aa15-3a5101eed295 tempest-SnapshotsActionsTest-689442564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-fcb2f3de-8d93-414c-92d7-f6039a136688.c3e55f9e-2e31-4138-aceb-692b76d90d5b" returned: 0 in 0.825s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:28:07 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-0e23f36c-d0a0-4a68-aa15-3a5101eed295 tempest-SnapshotsActionsTest-689442564 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fcb2f3de-8d93-414c-92d7-f6039a136688(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93468) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 29 03:28:07 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-0e23f36c-d0a0-4a68-aa15-3a5101eed295 tempest-SnapshotsActionsTest-689442564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-fcb2f3de-8d93-414c-92d7-f6039a136688.0978fa85-c28a-4dfd-b22e-168500daaed5 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:28:07 devstack sudo[102120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-fcb2f3de-8d93-414c-92d7-f6039a136688.0978fa85-c28a-4dfd-b22e-168500daaed5 Jun 29 03:28:07 devstack sudo[102120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:28:08 devstack sudo[102115]: pam_unix(sudo:session): session closed for user root Jun 29 03:28:08 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-5c86b120-c164-4a20-9f56-533bc47c6a85 tempest-VolumesDeleteCascade-818251270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4597df4d-48fc-4845-887c-8d4bf4397add.5ee15734-f951-4059-9184-e46f197a536b -F qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-4597df4d-48fc-4845-887c-8d4bf4397add.c2f5a7ac-3dc6-45cd-b1ff-2398ad9630a8" returned: 0 in 0.835s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:28:08 devstack cinder-volume[93468]: WARNING cinder.volume.drivers.remotefs [None req-5c86b120-c164-4a20-9f56-533bc47c6a85 tempest-VolumesDeleteCascade-818251270 None] /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-4597df4d-48fc-4845-887c-8d4bf4397add.c2f5a7ac-3dc6-45cd-b1ff-2398ad9630a8 is being set with open permissions: ugo+rw Jun 29 03:28:08 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-5c86b120-c164-4a20-9f56-533bc47c6a85 tempest-VolumesDeleteCascade-818251270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-4597df4d-48fc-4845-887c-8d4bf4397add.c2f5a7ac-3dc6-45cd-b1ff-2398ad9630a8 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:28:08 devstack sudo[102126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-4597df4d-48fc-4845-887c-8d4bf4397add.c2f5a7ac-3dc6-45cd-b1ff-2398ad9630a8 Jun 29 03:28:08 devstack sudo[102126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:28:08 devstack sudo[102120]: pam_unix(sudo:session): session closed for user root Jun 29 03:28:08 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-0e23f36c-d0a0-4a68-aa15-3a5101eed295 tempest-SnapshotsActionsTest-689442564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-fcb2f3de-8d93-414c-92d7-f6039a136688.0978fa85-c28a-4dfd-b22e-168500daaed5" returned: 0 in 0.943s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:28:08 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-0e23f36c-d0a0-4a68-aa15-3a5101eed295 tempest-SnapshotsActionsTest-689442564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-fcb2f3de-8d93-414c-92d7-f6039a136688.0978fa85-c28a-4dfd-b22e-168500daaed5 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:28:08 devstack sudo[102132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-fcb2f3de-8d93-414c-92d7-f6039a136688.0978fa85-c28a-4dfd-b22e-168500daaed5 Jun 29 03:28:08 devstack sudo[102132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:28:08 devstack sudo[102126]: pam_unix(sudo:session): session closed for user root Jun 29 03:28:08 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-5c86b120-c164-4a20-9f56-533bc47c6a85 tempest-VolumesDeleteCascade-818251270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-4597df4d-48fc-4845-887c-8d4bf4397add.c2f5a7ac-3dc6-45cd-b1ff-2398ad9630a8" returned: 0 in 0.675s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:28:08 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-5c86b120-c164-4a20-9f56-533bc47c6a85 tempest-VolumesDeleteCascade-818251270 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.457s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:28:08 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-ea752501-f4f1-4e18-8a75-ceec76dee658 tempest-GroupSnapshotsV319Test-738976124 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.170s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:28:08 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-ea752501-f4f1-4e18-8a75-ceec76dee658 tempest-GroupSnapshotsV319Test-738976124 None] Creating offline snapshot 0dbdb171-6b60-403a-af2a-87939c462f10 of volume 2e73952a-1861-4610-b662-1bceddc5a502 {{(pid=93468) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 29 03:28:08 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-5c86b120-c164-4a20-9f56-533bc47c6a85 tempest-VolumesDeleteCascade-818251270 None] Create snapshot completed successfully Jun 29 03:28:08 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e8fac30-0b54-4f06-917e-36ac6e584f52]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:28:08 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ea752501-f4f1-4e18-8a75-ceec76dee658 tempest-GroupSnapshotsV319Test-738976124 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-2e73952a-1861-4610-b662-1bceddc5a502 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:28:09 devstack sudo[102134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-2e73952a-1861-4610-b662-1bceddc5a502 Jun 29 03:28:09 devstack sudo[102134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:28:09 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-b751a700-b336-434b-9490-41532a47e170 tempest-VolumesDeleteCascade-818251270 None] Acquiring lock "cinder-4597df4d-48fc-4845-887c-8d4bf4397add-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:28:09 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-b751a700-b336-434b-9490-41532a47e170 tempest-VolumesDeleteCascade-818251270 None] Lock "cinder-4597df4d-48fc-4845-887c-8d4bf4397add-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:28:09 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-b751a700-b336-434b-9490-41532a47e170 tempest-VolumesDeleteCascade-818251270 None] Performing cascade delete. {{(pid=93468) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jun 29 03:28:09 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-b751a700-b336-434b-9490-41532a47e170 tempest-VolumesDeleteCascade-818251270 None] Acquiring lock "cinder-5ee15734-f951-4059-9184-e46f197a536b-delete_snapshot" by "delete_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:28:09 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-b751a700-b336-434b-9490-41532a47e170 tempest-VolumesDeleteCascade-818251270 None] Lock "cinder-5ee15734-f951-4059-9184-e46f197a536b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:28:09 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-b751a700-b336-434b-9490-41532a47e170 tempest-VolumesDeleteCascade-818251270 None] Acquiring lock "cinder-quobyte-4597df4d-48fc-4845-887c-8d4bf4397add" by "delete_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:28:09 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-b751a700-b336-434b-9490-41532a47e170 tempest-VolumesDeleteCascade-818251270 None] Lock "cinder-quobyte-4597df4d-48fc-4845-887c-8d4bf4397add" acquired by "delete_snapshot" :: waited 0.017s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:28:09 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-b751a700-b336-434b-9490-41532a47e170 tempest-VolumesDeleteCascade-818251270 None] Acquiring lock "cinder-quobyte-5ee15734-f951-4059-9184-e46f197a536b" by "_delete_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:28:09 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-b751a700-b336-434b-9490-41532a47e170 tempest-VolumesDeleteCascade-818251270 None] Lock "cinder-quobyte-5ee15734-f951-4059-9184-e46f197a536b" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:28:09 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-b751a700-b336-434b-9490-41532a47e170 tempest-VolumesDeleteCascade-818251270 None] Deleting offline snapshot 5ee15734-f951-4059-9184-e46f197a536b of volume 4597df4d-48fc-4845-887c-8d4bf4397add {{(pid=93468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 29 03:28:09 devstack sudo[102132]: pam_unix(sudo:session): session closed for user root Jun 29 03:28:09 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-b751a700-b336-434b-9490-41532a47e170 tempest-VolumesDeleteCascade-818251270 None] snapshot_file for this snap is: volume-4597df4d-48fc-4845-887c-8d4bf4397add.5ee15734-f951-4059-9184-e46f197a536b {{(pid=93468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 29 03:28:09 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-0e23f36c-d0a0-4a68-aa15-3a5101eed295 tempest-SnapshotsActionsTest-689442564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-fcb2f3de-8d93-414c-92d7-f6039a136688.0978fa85-c28a-4dfd-b22e-168500daaed5" returned: 0 in 0.979s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:28:09 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[3632910e-9c08-4b45-8e12-29b7fb7e6b94]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:28:09 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b751a700-b336-434b-9490-41532a47e170 tempest-VolumesDeleteCascade-818251270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-4597df4d-48fc-4845-887c-8d4bf4397add.5ee15734-f951-4059-9184-e46f197a536b {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:28:09 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-0e23f36c-d0a0-4a68-aa15-3a5101eed295 tempest-SnapshotsActionsTest-689442564 None] Lock "cinder-quobyte-0978fa85-c28a-4dfd-b22e-168500daaed5" released by "_delete_snapshot" :: held 3.736s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:28:09 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-0e23f36c-d0a0-4a68-aa15-3a5101eed295 tempest-SnapshotsActionsTest-689442564 None] Lock "cinder-quobyte-fcb2f3de-8d93-414c-92d7-f6039a136688" released by "delete_snapshot" :: held 3.775s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:28:09 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-0e23f36c-d0a0-4a68-aa15-3a5101eed295 tempest-SnapshotsActionsTest-689442564 None] Created reservations ['7242f869-1f42-4875-8528-39edaa0e1a29', '0d6fb108-99c5-4f6b-8484-83965556f52c', '0b1088ca-22a7-4817-acb4-babf1354942a', 'a8d4a48f-5452-4532-9c6b-0175d07525a3'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:28:09 devstack sudo[102137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-4597df4d-48fc-4845-887c-8d4bf4397add.5ee15734-f951-4059-9184-e46f197a536b Jun 29 03:28:09 devstack sudo[102137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:28:10 devstack sudo[102134]: pam_unix(sudo:session): session closed for user root Jun 29 03:28:10 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-0e23f36c-d0a0-4a68-aa15-3a5101eed295 tempest-SnapshotsActionsTest-689442564 None] Delete snapshot completed successfully. Jun 29 03:28:10 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ea752501-f4f1-4e18-8a75-ceec76dee658 tempest-GroupSnapshotsV319Test-738976124 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-2e73952a-1861-4610-b662-1bceddc5a502" returned: 0 in 1.092s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:28:10 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ea752501-f4f1-4e18-8a75-ceec76dee658 tempest-GroupSnapshotsV319Test-738976124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-2e73952a-1861-4610-b662-1bceddc5a502,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-2e73952a-1861-4610-b662-1bceddc5a502.0dbdb171-6b60-403a-af2a-87939c462f10 1G {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:28:10 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-0e23f36c-d0a0-4a68-aa15-3a5101eed295 tempest-SnapshotsActionsTest-689442564 None] Lock "cinder-0978fa85-c28a-4dfd-b22e-168500daaed5-delete_snapshot" released by "delete_snapshot" :: held 4.014s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:28:10 devstack sudo[102142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-2e73952a-1861-4610-b662-1bceddc5a502,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-2e73952a-1861-4610-b662-1bceddc5a502.0dbdb171-6b60-403a-af2a-87939c462f10 1G Jun 29 03:28:10 devstack sudo[102142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:28:10 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-1b175b02-45fe-4dda-94c6-ad0d5f4a428a tempest-SnapshotsActionsTest-1128167461 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:28:10 devstack sudo[102137]: pam_unix(sudo:session): session closed for user root Jun 29 03:28:10 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b751a700-b336-434b-9490-41532a47e170 tempest-VolumesDeleteCascade-818251270 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-4597df4d-48fc-4845-887c-8d4bf4397add.5ee15734-f951-4059-9184-e46f197a536b" returned: 0 in 0.999s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:28:10 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-b751a700-b336-434b-9490-41532a47e170 tempest-VolumesDeleteCascade-818251270 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4597df4d-48fc-4845-887c-8d4bf4397add(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93468) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 29 03:28:10 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[baa30782-2628-4151-a330-f27c3505b235]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:28:10 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b751a700-b336-434b-9490-41532a47e170 tempest-VolumesDeleteCascade-818251270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-4597df4d-48fc-4845-887c-8d4bf4397add {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:28:10 devstack sudo[102150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-4597df4d-48fc-4845-887c-8d4bf4397add Jun 29 03:28:10 devstack sudo[102150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:28:11 devstack sudo[102142]: pam_unix(sudo:session): session closed for user root Jun 29 03:28:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ea752501-f4f1-4e18-8a75-ceec76dee658 tempest-GroupSnapshotsV319Test-738976124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-2e73952a-1861-4610-b662-1bceddc5a502,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-2e73952a-1861-4610-b662-1bceddc5a502.0dbdb171-6b60-403a-af2a-87939c462f10 1G" returned: 0 in 1.020s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:28:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ea752501-f4f1-4e18-8a75-ceec76dee658 tempest-GroupSnapshotsV319Test-738976124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2e73952a-1861-4610-b662-1bceddc5a502 -F qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-2e73952a-1861-4610-b662-1bceddc5a502.0dbdb171-6b60-403a-af2a-87939c462f10 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:28:11 devstack sudo[102154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2e73952a-1861-4610-b662-1bceddc5a502 -F qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-2e73952a-1861-4610-b662-1bceddc5a502.0dbdb171-6b60-403a-af2a-87939c462f10 Jun 29 03:28:11 devstack sudo[102154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:28:11 devstack sudo[102150]: pam_unix(sudo:session): session closed for user root Jun 29 03:28:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b751a700-b336-434b-9490-41532a47e170 tempest-VolumesDeleteCascade-818251270 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-4597df4d-48fc-4845-887c-8d4bf4397add" returned: 0 in 0.853s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:28:11 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c3004d8-1519-4ffb-88df-b10721dac397]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:28:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b751a700-b336-434b-9490-41532a47e170 tempest-VolumesDeleteCascade-818251270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-4597df4d-48fc-4845-887c-8d4bf4397add.c2f5a7ac-3dc6-45cd-b1ff-2398ad9630a8 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:28:11 devstack cinder-volume[93468]: DEBUG oslo_service.periodic_task [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93468) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 29 03:28:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:28:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:28:11 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:28:11 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:28:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:28:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:28:11 devstack sudo[102164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf Jun 29 03:28:11 devstack sudo[102164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:28:11 devstack sudo[102154]: pam_unix(sudo:session): session closed for user root Jun 29 03:28:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ea752501-f4f1-4e18-8a75-ceec76dee658 tempest-GroupSnapshotsV319Test-738976124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2e73952a-1861-4610-b662-1bceddc5a502 -F qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-2e73952a-1861-4610-b662-1bceddc5a502.0dbdb171-6b60-403a-af2a-87939c462f10" returned: 0 in 0.855s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:28:11 devstack cinder-volume[93468]: WARNING cinder.volume.drivers.remotefs [None req-ea752501-f4f1-4e18-8a75-ceec76dee658 tempest-GroupSnapshotsV319Test-738976124 None] /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-2e73952a-1861-4610-b662-1bceddc5a502.0dbdb171-6b60-403a-af2a-87939c462f10 is being set with open permissions: ugo+rw: NotImplementedError Jun 29 03:28:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ea752501-f4f1-4e18-8a75-ceec76dee658 tempest-GroupSnapshotsV319Test-738976124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-2e73952a-1861-4610-b662-1bceddc5a502.0dbdb171-6b60-403a-af2a-87939c462f10 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:28:11 devstack sudo[102163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-4597df4d-48fc-4845-887c-8d4bf4397add.c2f5a7ac-3dc6-45cd-b1ff-2398ad9630a8 Jun 29 03:28:11 devstack sudo[102163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:28:11 devstack sudo[102166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-2e73952a-1861-4610-b662-1bceddc5a502.0dbdb171-6b60-403a-af2a-87939c462f10 Jun 29 03:28:11 devstack sudo[102166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:28:12 devstack sudo[102164]: pam_unix(sudo:session): session closed for user root Jun 29 03:28:12 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf" returned: 0 in 0.863s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:28:12 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:28:12 devstack cinder-volume[93468]: DEBUG oslo_service.periodic_task [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Running periodic task VolumeManager._thread_info {{(pid=93468) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 29 03:28:12 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] thread count: 28 {{(pid=93468) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 29 03:28:12 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] thread info: [<_MainThread(MainThread, started 132331377287296)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93468) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 29 03:28:12 devstack sudo[102166]: pam_unix(sudo:session): session closed for user root Jun 29 03:28:12 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ea752501-f4f1-4e18-8a75-ceec76dee658 tempest-GroupSnapshotsV319Test-738976124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-2e73952a-1861-4610-b662-1bceddc5a502.0dbdb171-6b60-403a-af2a-87939c462f10" returned: 0 in 0.846s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:28:12 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ea752501-f4f1-4e18-8a75-ceec76dee658 tempest-GroupSnapshotsV319Test-738976124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-2e73952a-1861-4610-b662-1bceddc5a502.info {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:28:12 devstack sudo[102178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-2e73952a-1861-4610-b662-1bceddc5a502.info Jun 29 03:28:12 devstack sudo[102178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:28:12 devstack sudo[102163]: pam_unix(sudo:session): session closed for user root Jun 29 03:28:12 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b751a700-b336-434b-9490-41532a47e170 tempest-VolumesDeleteCascade-818251270 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-4597df4d-48fc-4845-887c-8d4bf4397add.c2f5a7ac-3dc6-45cd-b1ff-2398ad9630a8" returned: 0 in 1.106s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:28:12 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-b751a700-b336-434b-9490-41532a47e170 tempest-VolumesDeleteCascade-818251270 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4597df4d-48fc-4845-887c-8d4bf4397add(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93468) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 29 03:28:12 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ad719b6-d413-48cd-be0c-a93f5da6828f]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:28:12 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b751a700-b336-434b-9490-41532a47e170 tempest-VolumesDeleteCascade-818251270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-4597df4d-48fc-4845-887c-8d4bf4397add.5ee15734-f951-4059-9184-e46f197a536b {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:28:13 devstack sudo[102180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-4597df4d-48fc-4845-887c-8d4bf4397add.5ee15734-f951-4059-9184-e46f197a536b Jun 29 03:28:13 devstack sudo[102180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:28:13 devstack sudo[102178]: pam_unix(sudo:session): session closed for user root Jun 29 03:28:13 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ea752501-f4f1-4e18-8a75-ceec76dee658 tempest-GroupSnapshotsV319Test-738976124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-2e73952a-1861-4610-b662-1bceddc5a502.info" returned: 0 in 0.686s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:28:13 devstack cinder-volume[93468]: WARNING cinder.volume.drivers.remotefs [None req-ea752501-f4f1-4e18-8a75-ceec76dee658 tempest-GroupSnapshotsV319Test-738976124 None] /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-2e73952a-1861-4610-b662-1bceddc5a502.info is being set with open permissions: ugo+rw: NotImplementedError Jun 29 03:28:13 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ea752501-f4f1-4e18-8a75-ceec76dee658 tempest-GroupSnapshotsV319Test-738976124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-2e73952a-1861-4610-b662-1bceddc5a502.info {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:28:13 devstack sudo[102183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-2e73952a-1861-4610-b662-1bceddc5a502.info Jun 29 03:28:13 devstack sudo[102183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:28:13 devstack sudo[102180]: pam_unix(sudo:session): session closed for user root Jun 29 03:28:13 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b751a700-b336-434b-9490-41532a47e170 tempest-VolumesDeleteCascade-818251270 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-4597df4d-48fc-4845-887c-8d4bf4397add.5ee15734-f951-4059-9184-e46f197a536b" returned: 0 in 0.790s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:28:13 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-b751a700-b336-434b-9490-41532a47e170 tempest-VolumesDeleteCascade-818251270 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4597df4d-48fc-4845-887c-8d4bf4397add(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93468) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 29 03:28:13 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac39f9d1-e9bf-4f3b-8149-aa9bea554b74]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:28:13 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b751a700-b336-434b-9490-41532a47e170 tempest-VolumesDeleteCascade-818251270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-4597df4d-48fc-4845-887c-8d4bf4397add {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:28:13 devstack sudo[102188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-4597df4d-48fc-4845-887c-8d4bf4397add Jun 29 03:28:13 devstack sudo[102188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:28:14 devstack sudo[102183]: pam_unix(sudo:session): session closed for user root Jun 29 03:28:14 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ea752501-f4f1-4e18-8a75-ceec76dee658 tempest-GroupSnapshotsV319Test-738976124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-2e73952a-1861-4610-b662-1bceddc5a502.info" returned: 0 in 0.737s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:28:14 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-ea752501-f4f1-4e18-8a75-ceec76dee658 tempest-GroupSnapshotsV319Test-738976124 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.386s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:28:14 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-1b175b02-45fe-4dda-94c6-ad0d5f4a428a tempest-SnapshotsActionsTest-1128167461 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.534s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:28:14 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-1b175b02-45fe-4dda-94c6-ad0d5f4a428a tempest-SnapshotsActionsTest-1128167461 None] Creating offline snapshot 95c9fa38-d693-4529-b98f-8f1618e935e3 of volume fcb2f3de-8d93-414c-92d7-f6039a136688 {{(pid=93468) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 29 03:28:14 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[02ab2250-085d-4803-8aa9-b25204bc4411]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:28:14 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-1b175b02-45fe-4dda-94c6-ad0d5f4a428a tempest-SnapshotsActionsTest-1128167461 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-fcb2f3de-8d93-414c-92d7-f6039a136688.c3e55f9e-2e31-4138-aceb-692b76d90d5b {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:28:14 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-ea752501-f4f1-4e18-8a75-ceec76dee658 tempest-GroupSnapshotsV319Test-738976124 None] group_snapshot 58564cbf-7e6d-4122-b13b-f9a8b92ee5bb: created successfully Jun 29 03:28:14 devstack sudo[102192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-fcb2f3de-8d93-414c-92d7-f6039a136688.c3e55f9e-2e31-4138-aceb-692b76d90d5b Jun 29 03:28:14 devstack sudo[102192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:28:14 devstack sudo[102188]: pam_unix(sudo:session): session closed for user root Jun 29 03:28:14 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b751a700-b336-434b-9490-41532a47e170 tempest-VolumesDeleteCascade-818251270 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-4597df4d-48fc-4845-887c-8d4bf4397add" returned: 0 in 0.867s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:28:14 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b751a700-b336-434b-9490-41532a47e170 tempest-VolumesDeleteCascade-818251270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-4597df4d-48fc-4845-887c-8d4bf4397add.5ee15734-f951-4059-9184-e46f197a536b {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:28:14 devstack sudo[102198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-4597df4d-48fc-4845-887c-8d4bf4397add.5ee15734-f951-4059-9184-e46f197a536b Jun 29 03:28:14 devstack sudo[102198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:28:15 devstack sudo[102192]: pam_unix(sudo:session): session closed for user root Jun 29 03:28:15 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-1b175b02-45fe-4dda-94c6-ad0d5f4a428a tempest-SnapshotsActionsTest-1128167461 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-fcb2f3de-8d93-414c-92d7-f6039a136688.c3e55f9e-2e31-4138-aceb-692b76d90d5b" returned: 0 in 0.861s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:28:15 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-1b175b02-45fe-4dda-94c6-ad0d5f4a428a tempest-SnapshotsActionsTest-1128167461 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fcb2f3de-8d93-414c-92d7-f6039a136688(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93468) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 29 03:28:15 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-1b175b02-45fe-4dda-94c6-ad0d5f4a428a tempest-SnapshotsActionsTest-1128167461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-fcb2f3de-8d93-414c-92d7-f6039a136688.c3e55f9e-2e31-4138-aceb-692b76d90d5b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-fcb2f3de-8d93-414c-92d7-f6039a136688.95c9fa38-d693-4529-b98f-8f1618e935e3 1G {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:28:15 devstack sudo[102206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-fcb2f3de-8d93-414c-92d7-f6039a136688.c3e55f9e-2e31-4138-aceb-692b76d90d5b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-fcb2f3de-8d93-414c-92d7-f6039a136688.95c9fa38-d693-4529-b98f-8f1618e935e3 1G Jun 29 03:28:15 devstack sudo[102206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:28:15 devstack sudo[102198]: pam_unix(sudo:session): session closed for user root Jun 29 03:28:15 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b751a700-b336-434b-9490-41532a47e170 tempest-VolumesDeleteCascade-818251270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-4597df4d-48fc-4845-887c-8d4bf4397add.5ee15734-f951-4059-9184-e46f197a536b" returned: 0 in 0.795s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:28:15 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b751a700-b336-434b-9490-41532a47e170 tempest-VolumesDeleteCascade-818251270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-4597df4d-48fc-4845-887c-8d4bf4397add.5ee15734-f951-4059-9184-e46f197a536b {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:28:15 devstack sudo[102208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-4597df4d-48fc-4845-887c-8d4bf4397add.5ee15734-f951-4059-9184-e46f197a536b Jun 29 03:28:15 devstack sudo[102208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:28:16 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-6d0ad0fb-097d-482c-8dbe-a95860fce57e tempest-GroupSnapshotsV319Test-738976124 None] group_snapshot 58564cbf-7e6d-4122-b13b-f9a8b92ee5bb: deleting Jun 29 03:28:16 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-6d0ad0fb-097d-482c-8dbe-a95860fce57e tempest-GroupSnapshotsV319Test-738976124 None] group_snapshot 58564cbf-7e6d-4122-b13b-f9a8b92ee5bb: deleting {{(pid=93468) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jun 29 03:28:16 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-6d0ad0fb-097d-482c-8dbe-a95860fce57e tempest-GroupSnapshotsV319Test-738976124 None] Acquiring lock "cinder-quobyte-2e73952a-1861-4610-b662-1bceddc5a502" by "delete_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:28:16 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-6d0ad0fb-097d-482c-8dbe-a95860fce57e tempest-GroupSnapshotsV319Test-738976124 None] Lock "cinder-quobyte-2e73952a-1861-4610-b662-1bceddc5a502" acquired by "delete_snapshot" :: waited 0.027s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:28:16 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-6d0ad0fb-097d-482c-8dbe-a95860fce57e tempest-GroupSnapshotsV319Test-738976124 None] Acquiring lock "cinder-quobyte-0dbdb171-6b60-403a-af2a-87939c462f10" by "_delete_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:28:16 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-6d0ad0fb-097d-482c-8dbe-a95860fce57e tempest-GroupSnapshotsV319Test-738976124 None] Lock "cinder-quobyte-0dbdb171-6b60-403a-af2a-87939c462f10" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:28:16 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-6d0ad0fb-097d-482c-8dbe-a95860fce57e tempest-GroupSnapshotsV319Test-738976124 None] Deleting offline snapshot 0dbdb171-6b60-403a-af2a-87939c462f10 of volume 2e73952a-1861-4610-b662-1bceddc5a502 {{(pid=93468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 29 03:28:16 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-6d0ad0fb-097d-482c-8dbe-a95860fce57e tempest-GroupSnapshotsV319Test-738976124 None] snapshot_file for this snap is: volume-2e73952a-1861-4610-b662-1bceddc5a502.0dbdb171-6b60-403a-af2a-87939c462f10 {{(pid=93468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 29 03:28:16 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[12f104c9-b023-479c-b286-06a5e8242f12]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:28:16 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-6d0ad0fb-097d-482c-8dbe-a95860fce57e tempest-GroupSnapshotsV319Test-738976124 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-2e73952a-1861-4610-b662-1bceddc5a502.0dbdb171-6b60-403a-af2a-87939c462f10 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:28:16 devstack sudo[102208]: pam_unix(sudo:session): session closed for user root Jun 29 03:28:16 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b751a700-b336-434b-9490-41532a47e170 tempest-VolumesDeleteCascade-818251270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-4597df4d-48fc-4845-887c-8d4bf4397add.5ee15734-f951-4059-9184-e46f197a536b" returned: 0 in 1.013s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:28:16 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b751a700-b336-434b-9490-41532a47e170 tempest-VolumesDeleteCascade-818251270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4597df4d-48fc-4845-887c-8d4bf4397add /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-4597df4d-48fc-4845-887c-8d4bf4397add.c2f5a7ac-3dc6-45cd-b1ff-2398ad9630a8 -F qcow2 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:28:16 devstack sudo[102215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-2e73952a-1861-4610-b662-1bceddc5a502.0dbdb171-6b60-403a-af2a-87939c462f10 Jun 29 03:28:16 devstack sudo[102215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:28:16 devstack sudo[102216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4597df4d-48fc-4845-887c-8d4bf4397add /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-4597df4d-48fc-4845-887c-8d4bf4397add.c2f5a7ac-3dc6-45cd-b1ff-2398ad9630a8 -F qcow2 Jun 29 03:28:16 devstack sudo[102216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:28:16 devstack sudo[102206]: pam_unix(sudo:session): session closed for user root Jun 29 03:28:16 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-1b175b02-45fe-4dda-94c6-ad0d5f4a428a tempest-SnapshotsActionsTest-1128167461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-fcb2f3de-8d93-414c-92d7-f6039a136688.c3e55f9e-2e31-4138-aceb-692b76d90d5b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-fcb2f3de-8d93-414c-92d7-f6039a136688.95c9fa38-d693-4529-b98f-8f1618e935e3 1G" returned: 0 in 1.241s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:28:16 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-1b175b02-45fe-4dda-94c6-ad0d5f4a428a tempest-SnapshotsActionsTest-1128167461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fcb2f3de-8d93-414c-92d7-f6039a136688.c3e55f9e-2e31-4138-aceb-692b76d90d5b -F qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-fcb2f3de-8d93-414c-92d7-f6039a136688.95c9fa38-d693-4529-b98f-8f1618e935e3 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:28:16 devstack sudo[102221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fcb2f3de-8d93-414c-92d7-f6039a136688.c3e55f9e-2e31-4138-aceb-692b76d90d5b -F qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-fcb2f3de-8d93-414c-92d7-f6039a136688.95c9fa38-d693-4529-b98f-8f1618e935e3 Jun 29 03:28:16 devstack sudo[102221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:28:17 devstack sudo[102215]: pam_unix(sudo:session): session closed for user root Jun 29 03:28:17 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-6d0ad0fb-097d-482c-8dbe-a95860fce57e tempest-GroupSnapshotsV319Test-738976124 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-2e73952a-1861-4610-b662-1bceddc5a502.0dbdb171-6b60-403a-af2a-87939c462f10" returned: 0 in 0.894s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:28:17 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-6d0ad0fb-097d-482c-8dbe-a95860fce57e tempest-GroupSnapshotsV319Test-738976124 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2e73952a-1861-4610-b662-1bceddc5a502(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93468) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 29 03:28:17 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[db16ac50-a0c9-4264-8e71-fe1775e1d73f]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:28:17 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-6d0ad0fb-097d-482c-8dbe-a95860fce57e tempest-GroupSnapshotsV319Test-738976124 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-2e73952a-1861-4610-b662-1bceddc5a502 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:28:17 devstack sudo[102216]: pam_unix(sudo:session): session closed for user root Jun 29 03:28:17 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b751a700-b336-434b-9490-41532a47e170 tempest-VolumesDeleteCascade-818251270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4597df4d-48fc-4845-887c-8d4bf4397add /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-4597df4d-48fc-4845-887c-8d4bf4397add.c2f5a7ac-3dc6-45cd-b1ff-2398ad9630a8 -F qcow2" returned: 0 in 0.821s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:28:17 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-b751a700-b336-434b-9490-41532a47e170 tempest-VolumesDeleteCascade-818251270 None] Lock "cinder-quobyte-5ee15734-f951-4059-9184-e46f197a536b" released by "_delete_snapshot" :: held 7.517s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:28:17 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-b751a700-b336-434b-9490-41532a47e170 tempest-VolumesDeleteCascade-818251270 None] Lock "cinder-quobyte-4597df4d-48fc-4845-887c-8d4bf4397add" released by "delete_snapshot" :: held 7.546s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:28:17 devstack sudo[102221]: pam_unix(sudo:session): session closed for user root Jun 29 03:28:17 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-1b175b02-45fe-4dda-94c6-ad0d5f4a428a tempest-SnapshotsActionsTest-1128167461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fcb2f3de-8d93-414c-92d7-f6039a136688.c3e55f9e-2e31-4138-aceb-692b76d90d5b -F qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-fcb2f3de-8d93-414c-92d7-f6039a136688.95c9fa38-d693-4529-b98f-8f1618e935e3" returned: 0 in 0.831s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:28:17 devstack cinder-volume[93468]: WARNING cinder.volume.drivers.remotefs [None req-1b175b02-45fe-4dda-94c6-ad0d5f4a428a tempest-SnapshotsActionsTest-1128167461 None] /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-fcb2f3de-8d93-414c-92d7-f6039a136688.95c9fa38-d693-4529-b98f-8f1618e935e3 is being set with open permissions: ugo+rw Jun 29 03:28:17 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-1b175b02-45fe-4dda-94c6-ad0d5f4a428a tempest-SnapshotsActionsTest-1128167461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-fcb2f3de-8d93-414c-92d7-f6039a136688.95c9fa38-d693-4529-b98f-8f1618e935e3 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:28:17 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-b751a700-b336-434b-9490-41532a47e170 tempest-VolumesDeleteCascade-818251270 None] Created reservations ['81cf61c1-0ea4-45be-aa22-d2e6e35c0248', '88e8aa4e-6d48-42d0-b50e-ef8b7a99d155', '3c9d06c7-16c0-4608-b4c7-a7ca8564cf5e', '8700aedd-e2d0-4b5f-9c05-3aeaa0803e33'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:28:17 devstack sudo[102232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-2e73952a-1861-4610-b662-1bceddc5a502 Jun 29 03:28:17 devstack sudo[102232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:28:17 devstack sudo[102233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-fcb2f3de-8d93-414c-92d7-f6039a136688.95c9fa38-d693-4529-b98f-8f1618e935e3 Jun 29 03:28:17 devstack sudo[102233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:28:17 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-b751a700-b336-434b-9490-41532a47e170 tempest-VolumesDeleteCascade-818251270 None] Delete snapshot completed successfully. Jun 29 03:28:17 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-b751a700-b336-434b-9490-41532a47e170 tempest-VolumesDeleteCascade-818251270 None] Lock "cinder-5ee15734-f951-4059-9184-e46f197a536b-delete_snapshot" released by "delete_snapshot" :: held 7.749s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:28:17 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-b751a700-b336-434b-9490-41532a47e170 tempest-VolumesDeleteCascade-818251270 None] Acquiring lock "cinder-c2f5a7ac-3dc6-45cd-b1ff-2398ad9630a8-delete_snapshot" by "delete_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:28:17 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-b751a700-b336-434b-9490-41532a47e170 tempest-VolumesDeleteCascade-818251270 None] Lock "cinder-c2f5a7ac-3dc6-45cd-b1ff-2398ad9630a8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:28:17 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-b751a700-b336-434b-9490-41532a47e170 tempest-VolumesDeleteCascade-818251270 None] Acquiring lock "cinder-quobyte-4597df4d-48fc-4845-887c-8d4bf4397add" by "delete_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:28:17 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-b751a700-b336-434b-9490-41532a47e170 tempest-VolumesDeleteCascade-818251270 None] Lock "cinder-quobyte-4597df4d-48fc-4845-887c-8d4bf4397add" acquired by "delete_snapshot" :: waited 0.016s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:28:17 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-b751a700-b336-434b-9490-41532a47e170 tempest-VolumesDeleteCascade-818251270 None] Acquiring lock "cinder-quobyte-c2f5a7ac-3dc6-45cd-b1ff-2398ad9630a8" by "_delete_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:28:17 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-b751a700-b336-434b-9490-41532a47e170 tempest-VolumesDeleteCascade-818251270 None] Lock "cinder-quobyte-c2f5a7ac-3dc6-45cd-b1ff-2398ad9630a8" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:28:17 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-b751a700-b336-434b-9490-41532a47e170 tempest-VolumesDeleteCascade-818251270 None] Deleting offline snapshot c2f5a7ac-3dc6-45cd-b1ff-2398ad9630a8 of volume 4597df4d-48fc-4845-887c-8d4bf4397add {{(pid=93468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 29 03:28:17 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-b751a700-b336-434b-9490-41532a47e170 tempest-VolumesDeleteCascade-818251270 None] snapshot_file for this snap is: volume-4597df4d-48fc-4845-887c-8d4bf4397add.c2f5a7ac-3dc6-45cd-b1ff-2398ad9630a8 {{(pid=93468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 29 03:28:17 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[9500cd02-1921-4ed3-b0f6-a30d6309581c]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:28:17 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b751a700-b336-434b-9490-41532a47e170 tempest-VolumesDeleteCascade-818251270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-4597df4d-48fc-4845-887c-8d4bf4397add.c2f5a7ac-3dc6-45cd-b1ff-2398ad9630a8 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:28:17 devstack sudo[102236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-4597df4d-48fc-4845-887c-8d4bf4397add.c2f5a7ac-3dc6-45cd-b1ff-2398ad9630a8 Jun 29 03:28:17 devstack sudo[102236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:28:18 devstack sudo[102233]: pam_unix(sudo:session): session closed for user root Jun 29 03:28:18 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-1b175b02-45fe-4dda-94c6-ad0d5f4a428a tempest-SnapshotsActionsTest-1128167461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-fcb2f3de-8d93-414c-92d7-f6039a136688.95c9fa38-d693-4529-b98f-8f1618e935e3" returned: 0 in 0.807s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:28:18 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-1b175b02-45fe-4dda-94c6-ad0d5f4a428a tempest-SnapshotsActionsTest-1128167461 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.896s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:28:18 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-1b175b02-45fe-4dda-94c6-ad0d5f4a428a tempest-SnapshotsActionsTest-1128167461 None] Create snapshot completed successfully Jun 29 03:28:18 devstack sudo[102232]: pam_unix(sudo:session): session closed for user root Jun 29 03:28:18 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-6d0ad0fb-097d-482c-8dbe-a95860fce57e tempest-GroupSnapshotsV319Test-738976124 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-2e73952a-1861-4610-b662-1bceddc5a502" returned: 0 in 1.093s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:28:18 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-6d0ad0fb-097d-482c-8dbe-a95860fce57e tempest-GroupSnapshotsV319Test-738976124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-2e73952a-1861-4610-b662-1bceddc5a502.0dbdb171-6b60-403a-af2a-87939c462f10 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:28:18 devstack sudo[102242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-2e73952a-1861-4610-b662-1bceddc5a502.0dbdb171-6b60-403a-af2a-87939c462f10 Jun 29 03:28:18 devstack sudo[102242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:28:18 devstack sudo[102236]: pam_unix(sudo:session): session closed for user root Jun 29 03:28:18 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b751a700-b336-434b-9490-41532a47e170 tempest-VolumesDeleteCascade-818251270 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-4597df4d-48fc-4845-887c-8d4bf4397add.c2f5a7ac-3dc6-45cd-b1ff-2398ad9630a8" returned: 0 in 0.970s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:28:18 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-b751a700-b336-434b-9490-41532a47e170 tempest-VolumesDeleteCascade-818251270 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4597df4d-48fc-4845-887c-8d4bf4397add(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93468) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 29 03:28:18 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e53a2c4-bc76-4ba5-8db5-b11dc0020066]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:28:18 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b751a700-b336-434b-9490-41532a47e170 tempest-VolumesDeleteCascade-818251270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-4597df4d-48fc-4845-887c-8d4bf4397add {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:28:18 devstack sudo[102247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-4597df4d-48fc-4845-887c-8d4bf4397add Jun 29 03:28:18 devstack sudo[102247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:28:19 devstack sudo[102242]: pam_unix(sudo:session): session closed for user root Jun 29 03:28:19 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-6d0ad0fb-097d-482c-8dbe-a95860fce57e tempest-GroupSnapshotsV319Test-738976124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-2e73952a-1861-4610-b662-1bceddc5a502.0dbdb171-6b60-403a-af2a-87939c462f10" returned: 0 in 0.896s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:28:19 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-6d0ad0fb-097d-482c-8dbe-a95860fce57e tempest-GroupSnapshotsV319Test-738976124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-2e73952a-1861-4610-b662-1bceddc5a502.0dbdb171-6b60-403a-af2a-87939c462f10 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:28:19 devstack sudo[102252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-2e73952a-1861-4610-b662-1bceddc5a502.0dbdb171-6b60-403a-af2a-87939c462f10 Jun 29 03:28:19 devstack sudo[102252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:28:19 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-b34451dc-909c-4a42-81c7-9dbc56e9a071 tempest-SnapshotsActionsTest-689442564 None] Acquiring lock "cinder-95c9fa38-d693-4529-b98f-8f1618e935e3-delete_snapshot" by "delete_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:28:19 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-b34451dc-909c-4a42-81c7-9dbc56e9a071 tempest-SnapshotsActionsTest-689442564 None] Lock "cinder-95c9fa38-d693-4529-b98f-8f1618e935e3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:28:19 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-b34451dc-909c-4a42-81c7-9dbc56e9a071 tempest-SnapshotsActionsTest-689442564 None] Acquiring lock "cinder-quobyte-fcb2f3de-8d93-414c-92d7-f6039a136688" by "delete_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:28:19 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-b34451dc-909c-4a42-81c7-9dbc56e9a071 tempest-SnapshotsActionsTest-689442564 None] Lock "cinder-quobyte-fcb2f3de-8d93-414c-92d7-f6039a136688" acquired by "delete_snapshot" :: waited 0.027s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:28:19 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-b34451dc-909c-4a42-81c7-9dbc56e9a071 tempest-SnapshotsActionsTest-689442564 None] Acquiring lock "cinder-quobyte-95c9fa38-d693-4529-b98f-8f1618e935e3" by "_delete_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:28:19 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-b34451dc-909c-4a42-81c7-9dbc56e9a071 tempest-SnapshotsActionsTest-689442564 None] Lock "cinder-quobyte-95c9fa38-d693-4529-b98f-8f1618e935e3" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:28:19 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-b34451dc-909c-4a42-81c7-9dbc56e9a071 tempest-SnapshotsActionsTest-689442564 None] Deleting offline snapshot 95c9fa38-d693-4529-b98f-8f1618e935e3 of volume fcb2f3de-8d93-414c-92d7-f6039a136688 {{(pid=93468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 29 03:28:19 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-b34451dc-909c-4a42-81c7-9dbc56e9a071 tempest-SnapshotsActionsTest-689442564 None] snapshot_file for this snap is: volume-fcb2f3de-8d93-414c-92d7-f6039a136688.95c9fa38-d693-4529-b98f-8f1618e935e3 {{(pid=93468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 29 03:28:19 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5d6517e-2d7d-4ba8-9eef-80eb8bd09b75]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:28:19 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b34451dc-909c-4a42-81c7-9dbc56e9a071 tempest-SnapshotsActionsTest-689442564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-fcb2f3de-8d93-414c-92d7-f6039a136688.95c9fa38-d693-4529-b98f-8f1618e935e3 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:28:19 devstack sudo[102247]: pam_unix(sudo:session): session closed for user root Jun 29 03:28:19 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b751a700-b336-434b-9490-41532a47e170 tempest-VolumesDeleteCascade-818251270 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-4597df4d-48fc-4845-887c-8d4bf4397add" returned: 0 in 0.957s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:28:19 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b751a700-b336-434b-9490-41532a47e170 tempest-VolumesDeleteCascade-818251270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-4597df4d-48fc-4845-887c-8d4bf4397add.c2f5a7ac-3dc6-45cd-b1ff-2398ad9630a8 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:28:19 devstack sudo[102258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-4597df4d-48fc-4845-887c-8d4bf4397add.c2f5a7ac-3dc6-45cd-b1ff-2398ad9630a8 Jun 29 03:28:19 devstack sudo[102258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:28:19 devstack sudo[102257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-fcb2f3de-8d93-414c-92d7-f6039a136688.95c9fa38-d693-4529-b98f-8f1618e935e3 Jun 29 03:28:19 devstack sudo[102257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:28:19 devstack sudo[102252]: pam_unix(sudo:session): session closed for user root Jun 29 03:28:19 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-6d0ad0fb-097d-482c-8dbe-a95860fce57e tempest-GroupSnapshotsV319Test-738976124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-2e73952a-1861-4610-b662-1bceddc5a502.0dbdb171-6b60-403a-af2a-87939c462f10" returned: 0 in 0.770s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:28:20 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-6d0ad0fb-097d-482c-8dbe-a95860fce57e tempest-GroupSnapshotsV319Test-738976124 None] Lock "cinder-quobyte-0dbdb171-6b60-403a-af2a-87939c462f10" released by "_delete_snapshot" :: held 3.771s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:28:20 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-6d0ad0fb-097d-482c-8dbe-a95860fce57e tempest-GroupSnapshotsV319Test-738976124 None] Lock "cinder-quobyte-2e73952a-1861-4610-b662-1bceddc5a502" released by "delete_snapshot" :: held 3.802s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:28:20 devstack cinder-volume[93468]: WARNING cinder.quota [None req-6d0ad0fb-097d-482c-8dbe-a95860fce57e tempest-GroupSnapshotsV319Test-738976124 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-18073288 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-18073288, it is now deprecated. Please use the default quota class for default quota. Jun 29 03:28:20 devstack cinder-volume[93468]: WARNING cinder.quota [None req-6d0ad0fb-097d-482c-8dbe-a95860fce57e tempest-GroupSnapshotsV319Test-738976124 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-18073288 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-18073288, it is now deprecated. Please use the default quota class for default quota. Jun 29 03:28:20 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-6d0ad0fb-097d-482c-8dbe-a95860fce57e tempest-GroupSnapshotsV319Test-738976124 None] Created reservations ['7a4ca414-02dc-4536-a225-8df7d80361be', '32a4a62c-320d-4b4c-89ed-13ba40e8f6d3', '4f53a21e-8352-423f-b666-c5ccf9522b52', '97e7c313-1627-4ad3-8515-5886db374efa'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:28:20 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-6d0ad0fb-097d-482c-8dbe-a95860fce57e tempest-GroupSnapshotsV319Test-738976124 None] group_snapshot 58564cbf-7e6d-4122-b13b-f9a8b92ee5bb: deleted successfully Jun 29 03:28:20 devstack sudo[102257]: pam_unix(sudo:session): session closed for user root Jun 29 03:28:20 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b34451dc-909c-4a42-81c7-9dbc56e9a071 tempest-SnapshotsActionsTest-689442564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-fcb2f3de-8d93-414c-92d7-f6039a136688.95c9fa38-d693-4529-b98f-8f1618e935e3" returned: 0 in 0.925s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:28:20 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-b34451dc-909c-4a42-81c7-9dbc56e9a071 tempest-SnapshotsActionsTest-689442564 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fcb2f3de-8d93-414c-92d7-f6039a136688(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93468) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 29 03:28:20 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[5218d383-0f52-4788-9ab1-e197fdd6114a]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:28:20 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b34451dc-909c-4a42-81c7-9dbc56e9a071 tempest-SnapshotsActionsTest-689442564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-fcb2f3de-8d93-414c-92d7-f6039a136688.c3e55f9e-2e31-4138-aceb-692b76d90d5b {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:28:20 devstack sudo[102258]: pam_unix(sudo:session): session closed for user root Jun 29 03:28:20 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b751a700-b336-434b-9490-41532a47e170 tempest-VolumesDeleteCascade-818251270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-4597df4d-48fc-4845-887c-8d4bf4397add.c2f5a7ac-3dc6-45cd-b1ff-2398ad9630a8" returned: 0 in 0.901s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:28:20 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b751a700-b336-434b-9490-41532a47e170 tempest-VolumesDeleteCascade-818251270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-4597df4d-48fc-4845-887c-8d4bf4397add.c2f5a7ac-3dc6-45cd-b1ff-2398ad9630a8 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:28:20 devstack sudo[102272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-4597df4d-48fc-4845-887c-8d4bf4397add.c2f5a7ac-3dc6-45cd-b1ff-2398ad9630a8 Jun 29 03:28:20 devstack sudo[102272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:28:20 devstack sudo[102271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-fcb2f3de-8d93-414c-92d7-f6039a136688.c3e55f9e-2e31-4138-aceb-692b76d90d5b Jun 29 03:28:20 devstack sudo[102271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:28:21 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-c33e5ae9-1e0f-474e-b9df-04c49374537e tempest-GroupSnapshotsV319Test-738976124 None] Acquiring lock "cinder-quobyte-2e73952a-1861-4610-b662-1bceddc5a502" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:28:21 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-c33e5ae9-1e0f-474e-b9df-04c49374537e tempest-GroupSnapshotsV319Test-738976124 None] Lock "cinder-quobyte-2e73952a-1861-4610-b662-1bceddc5a502" acquired by "delete_volume" :: waited 0.033s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:28:21 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fe655e7-cbb4-4c36-a151-4f43ee05c305]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:28:21 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c33e5ae9-1e0f-474e-b9df-04c49374537e tempest-GroupSnapshotsV319Test-738976124 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-2e73952a-1861-4610-b662-1bceddc5a502 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:28:21 devstack sudo[102272]: pam_unix(sudo:session): session closed for user root Jun 29 03:28:21 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b751a700-b336-434b-9490-41532a47e170 tempest-VolumesDeleteCascade-818251270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-4597df4d-48fc-4845-887c-8d4bf4397add.c2f5a7ac-3dc6-45cd-b1ff-2398ad9630a8" returned: 0 in 0.874s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:28:21 devstack sudo[102278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-2e73952a-1861-4610-b662-1bceddc5a502 Jun 29 03:28:21 devstack sudo[102278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:28:21 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-b751a700-b336-434b-9490-41532a47e170 tempest-VolumesDeleteCascade-818251270 None] Lock "cinder-quobyte-c2f5a7ac-3dc6-45cd-b1ff-2398ad9630a8" released by "_delete_snapshot" :: held 3.833s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:28:21 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-b751a700-b336-434b-9490-41532a47e170 tempest-VolumesDeleteCascade-818251270 None] Lock "cinder-quobyte-4597df4d-48fc-4845-887c-8d4bf4397add" released by "delete_snapshot" :: held 3.865s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:28:21 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-b751a700-b336-434b-9490-41532a47e170 tempest-VolumesDeleteCascade-818251270 None] Created reservations ['139d408b-f254-4478-99e5-d5721d75b952', 'dcd43efd-74ec-4ffb-a954-adc362390bc9', '64c56b60-a211-4c60-8446-d6798a723bde', '5fddf2fc-3929-4fbd-b02e-16358b62fcb5'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:28:21 devstack sudo[102271]: pam_unix(sudo:session): session closed for user root Jun 29 03:28:21 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-b751a700-b336-434b-9490-41532a47e170 tempest-VolumesDeleteCascade-818251270 None] Delete snapshot completed successfully. Jun 29 03:28:21 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b34451dc-909c-4a42-81c7-9dbc56e9a071 tempest-SnapshotsActionsTest-689442564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-fcb2f3de-8d93-414c-92d7-f6039a136688.c3e55f9e-2e31-4138-aceb-692b76d90d5b" returned: 0 in 1.089s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:28:21 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-b34451dc-909c-4a42-81c7-9dbc56e9a071 tempest-SnapshotsActionsTest-689442564 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fcb2f3de-8d93-414c-92d7-f6039a136688(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93468) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 29 03:28:21 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b34451dc-909c-4a42-81c7-9dbc56e9a071 tempest-SnapshotsActionsTest-689442564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-fcb2f3de-8d93-414c-92d7-f6039a136688.95c9fa38-d693-4529-b98f-8f1618e935e3 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:28:21 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-b751a700-b336-434b-9490-41532a47e170 tempest-VolumesDeleteCascade-818251270 None] Lock "cinder-c2f5a7ac-3dc6-45cd-b1ff-2398ad9630a8-delete_snapshot" released by "delete_snapshot" :: held 4.076s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:28:21 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-b751a700-b336-434b-9490-41532a47e170 tempest-VolumesDeleteCascade-818251270 None] Snapshots deleted, issuing volume delete {{(pid=93468) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jun 29 03:28:21 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-b751a700-b336-434b-9490-41532a47e170 tempest-VolumesDeleteCascade-818251270 None] Acquiring lock "cinder-quobyte-4597df4d-48fc-4845-887c-8d4bf4397add" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:28:21 devstack sudo[102283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-fcb2f3de-8d93-414c-92d7-f6039a136688.95c9fa38-d693-4529-b98f-8f1618e935e3 Jun 29 03:28:21 devstack sudo[102283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:28:21 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-b751a700-b336-434b-9490-41532a47e170 tempest-VolumesDeleteCascade-818251270 None] Lock "cinder-quobyte-4597df4d-48fc-4845-887c-8d4bf4397add" acquired by "delete_volume" :: waited 0.032s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:28:21 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[23fdce38-c8c3-48ce-aa50-dc8b73412fb2]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:28:21 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b751a700-b336-434b-9490-41532a47e170 tempest-VolumesDeleteCascade-818251270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-4597df4d-48fc-4845-887c-8d4bf4397add {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:28:21 devstack sudo[102285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-4597df4d-48fc-4845-887c-8d4bf4397add Jun 29 03:28:21 devstack sudo[102285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:28:22 devstack sudo[102278]: pam_unix(sudo:session): session closed for user root Jun 29 03:28:22 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c33e5ae9-1e0f-474e-b9df-04c49374537e tempest-GroupSnapshotsV319Test-738976124 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-2e73952a-1861-4610-b662-1bceddc5a502" returned: 0 in 0.854s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:28:22 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c33e5ae9-1e0f-474e-b9df-04c49374537e tempest-GroupSnapshotsV319Test-738976124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-2e73952a-1861-4610-b662-1bceddc5a502 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:28:22 devstack sudo[102290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-2e73952a-1861-4610-b662-1bceddc5a502 Jun 29 03:28:22 devstack sudo[102290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:28:22 devstack sudo[102283]: pam_unix(sudo:session): session closed for user root Jun 29 03:28:22 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b34451dc-909c-4a42-81c7-9dbc56e9a071 tempest-SnapshotsActionsTest-689442564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-fcb2f3de-8d93-414c-92d7-f6039a136688.95c9fa38-d693-4529-b98f-8f1618e935e3" returned: 0 in 0.938s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:28:22 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b34451dc-909c-4a42-81c7-9dbc56e9a071 tempest-SnapshotsActionsTest-689442564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-fcb2f3de-8d93-414c-92d7-f6039a136688.95c9fa38-d693-4529-b98f-8f1618e935e3 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:28:22 devstack sudo[102300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-fcb2f3de-8d93-414c-92d7-f6039a136688.95c9fa38-d693-4529-b98f-8f1618e935e3 Jun 29 03:28:22 devstack sudo[102300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:28:22 devstack sudo[102285]: pam_unix(sudo:session): session closed for user root Jun 29 03:28:22 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b751a700-b336-434b-9490-41532a47e170 tempest-VolumesDeleteCascade-818251270 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-4597df4d-48fc-4845-887c-8d4bf4397add" returned: 0 in 0.867s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:28:22 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b751a700-b336-434b-9490-41532a47e170 tempest-VolumesDeleteCascade-818251270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-4597df4d-48fc-4845-887c-8d4bf4397add {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:28:22 devstack sudo[102302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-4597df4d-48fc-4845-887c-8d4bf4397add Jun 29 03:28:22 devstack sudo[102302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:28:22 devstack sudo[102290]: pam_unix(sudo:session): session closed for user root Jun 29 03:28:22 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c33e5ae9-1e0f-474e-b9df-04c49374537e tempest-GroupSnapshotsV319Test-738976124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-2e73952a-1861-4610-b662-1bceddc5a502" returned: 0 in 0.780s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:28:22 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-c33e5ae9-1e0f-474e-b9df-04c49374537e tempest-GroupSnapshotsV319Test-738976124 None] Lock "cinder-quobyte-2e73952a-1861-4610-b662-1bceddc5a502" released by "delete_volume" :: held 1.726s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:28:22 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-c33e5ae9-1e0f-474e-b9df-04c49374537e tempest-GroupSnapshotsV319Test-738976124 None] Created reservations ['25d13f31-f005-4ff5-80e4-23061d1d2cdf'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:28:22 devstack cinder-volume[93468]: WARNING cinder.quota [None req-c33e5ae9-1e0f-474e-b9df-04c49374537e tempest-GroupSnapshotsV319Test-738976124 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-18073288 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-18073288, it is now deprecated. Please use the default quota class for default quota. Jun 29 03:28:22 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-c33e5ae9-1e0f-474e-b9df-04c49374537e tempest-GroupSnapshotsV319Test-738976124 None] Created reservations ['fa1be382-ca9b-4ef6-ba1c-efbb435fc39b', '07ac2827-b765-4af2-a326-3617e2081cbb', 'c6fdb1b6-15a5-4b6f-93c7-5c982674ebd9', '2e486053-2211-463e-99ab-c9d8120bea2e'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:28:23 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-c33e5ae9-1e0f-474e-b9df-04c49374537e tempest-GroupSnapshotsV319Test-738976124 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:28:23 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-c33e5ae9-1e0f-474e-b9df-04c49374537e tempest-GroupSnapshotsV319Test-738976124 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:28:23 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-c33e5ae9-1e0f-474e-b9df-04c49374537e tempest-GroupSnapshotsV319Test-738976124 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:28:23 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-c33e5ae9-1e0f-474e-b9df-04c49374537e tempest-GroupSnapshotsV319Test-738976124 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:28:23 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-c33e5ae9-1e0f-474e-b9df-04c49374537e tempest-GroupSnapshotsV319Test-738976124 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:28:23 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c33e5ae9-1e0f-474e-b9df-04c49374537e tempest-GroupSnapshotsV319Test-738976124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:28:23 devstack sudo[102306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf Jun 29 03:28:23 devstack sudo[102306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:28:23 devstack sudo[102300]: pam_unix(sudo:session): session closed for user root Jun 29 03:28:23 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b34451dc-909c-4a42-81c7-9dbc56e9a071 tempest-SnapshotsActionsTest-689442564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-fcb2f3de-8d93-414c-92d7-f6039a136688.95c9fa38-d693-4529-b98f-8f1618e935e3" returned: 0 in 0.701s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:28:23 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-b34451dc-909c-4a42-81c7-9dbc56e9a071 tempest-SnapshotsActionsTest-689442564 None] Lock "cinder-quobyte-95c9fa38-d693-4529-b98f-8f1618e935e3" released by "_delete_snapshot" :: held 3.796s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:28:23 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-b34451dc-909c-4a42-81c7-9dbc56e9a071 tempest-SnapshotsActionsTest-689442564 None] Lock "cinder-quobyte-fcb2f3de-8d93-414c-92d7-f6039a136688" released by "delete_snapshot" :: held 3.829s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:28:23 devstack sudo[102302]: pam_unix(sudo:session): session closed for user root Jun 29 03:28:23 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b751a700-b336-434b-9490-41532a47e170 tempest-VolumesDeleteCascade-818251270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-4597df4d-48fc-4845-887c-8d4bf4397add" returned: 0 in 0.708s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:28:23 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-b751a700-b336-434b-9490-41532a47e170 tempest-VolumesDeleteCascade-818251270 None] Lock "cinder-quobyte-4597df4d-48fc-4845-887c-8d4bf4397add" released by "delete_volume" :: held 1.668s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:28:23 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-b34451dc-909c-4a42-81c7-9dbc56e9a071 tempest-SnapshotsActionsTest-689442564 None] Created reservations ['3aee2b9d-6c10-4b52-9f0b-e8e589f83a50', 'ffe77c21-2fbb-4b9e-97ef-08c7b2182158', 'a1caa2d9-5910-42d1-98d4-291d159a64f1', 'fb49cc4a-1220-41b5-8585-8f3f446543d8'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:28:23 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-b751a700-b336-434b-9490-41532a47e170 tempest-VolumesDeleteCascade-818251270 None] Created reservations ['76d2129a-3fa5-45f2-b775-3386ddcd0eea', '35b02908-d118-47b3-98e9-596d281fac97', '75f5d89f-c908-4433-9d3e-4f30354e9cb4', 'b93c402e-6f75-4aea-b1aa-eb4f9b7b69c5'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:28:23 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-b34451dc-909c-4a42-81c7-9dbc56e9a071 tempest-SnapshotsActionsTest-689442564 None] Delete snapshot completed successfully. Jun 29 03:28:23 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-b34451dc-909c-4a42-81c7-9dbc56e9a071 tempest-SnapshotsActionsTest-689442564 None] Lock "cinder-95c9fa38-d693-4529-b98f-8f1618e935e3-delete_snapshot" released by "delete_snapshot" :: held 4.045s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:28:23 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-b751a700-b336-434b-9490-41532a47e170 tempest-VolumesDeleteCascade-818251270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:28:23 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-b751a700-b336-434b-9490-41532a47e170 tempest-VolumesDeleteCascade-818251270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:28:23 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-b751a700-b336-434b-9490-41532a47e170 tempest-VolumesDeleteCascade-818251270 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:28:23 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-b751a700-b336-434b-9490-41532a47e170 tempest-VolumesDeleteCascade-818251270 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:28:23 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-b751a700-b336-434b-9490-41532a47e170 tempest-VolumesDeleteCascade-818251270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:28:23 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b751a700-b336-434b-9490-41532a47e170 tempest-VolumesDeleteCascade-818251270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:28:23 devstack sudo[102309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf Jun 29 03:28:23 devstack sudo[102309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:28:23 devstack sudo[102306]: pam_unix(sudo:session): session closed for user root Jun 29 03:28:23 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c33e5ae9-1e0f-474e-b9df-04c49374537e tempest-GroupSnapshotsV319Test-738976124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf" returned: 0 in 0.833s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:28:23 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-c33e5ae9-1e0f-474e-b9df-04c49374537e tempest-GroupSnapshotsV319Test-738976124 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:28:23 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-c33e5ae9-1e0f-474e-b9df-04c49374537e tempest-GroupSnapshotsV319Test-738976124 None] Delete group completed successfully. Jun 29 03:28:24 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-7063587f-9ba6-4f0c-a53f-148f5f624c55 tempest-SnapshotsActionsTest-1128167461 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:28:24 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-7063587f-9ba6-4f0c-a53f-148f5f624c55 tempest-SnapshotsActionsTest-1128167461 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:28:24 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-7063587f-9ba6-4f0c-a53f-148f5f624c55 tempest-SnapshotsActionsTest-1128167461 None] Creating offline snapshot a08618db-9341-4433-ac91-6d8b02a23473 of volume fcb2f3de-8d93-414c-92d7-f6039a136688 {{(pid=93468) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 29 03:28:24 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[187a4911-8dfe-4e2b-b291-7f0fadd61ca3]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:28:24 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-7063587f-9ba6-4f0c-a53f-148f5f624c55 tempest-SnapshotsActionsTest-1128167461 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-fcb2f3de-8d93-414c-92d7-f6039a136688.c3e55f9e-2e31-4138-aceb-692b76d90d5b {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:28:24 devstack sudo[102312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-fcb2f3de-8d93-414c-92d7-f6039a136688.c3e55f9e-2e31-4138-aceb-692b76d90d5b Jun 29 03:28:24 devstack sudo[102312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:28:24 devstack sudo[102309]: pam_unix(sudo:session): session closed for user root Jun 29 03:28:24 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b751a700-b336-434b-9490-41532a47e170 tempest-VolumesDeleteCascade-818251270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf" returned: 0 in 0.945s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:28:24 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-b751a700-b336-434b-9490-41532a47e170 tempest-VolumesDeleteCascade-818251270 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:28:24 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-b751a700-b336-434b-9490-41532a47e170 tempest-VolumesDeleteCascade-818251270 None] Deleted volume successfully. Jun 29 03:28:24 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-b751a700-b336-434b-9490-41532a47e170 tempest-VolumesDeleteCascade-818251270 None] Lock "cinder-4597df4d-48fc-4845-887c-8d4bf4397add-delete_volume" released by "delete_volume" :: held 14.856s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:28:24 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-81178fb2-4274-46e6-ae4a-a04d6393b113 tempest-VolumesDeleteCascade-818251270 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:28:24 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-81178fb2-4274-46e6-ae4a-a04d6393b113 tempest-VolumesDeleteCascade-818251270 None] Flow 'volume_create_manager' (ba4c07c0-938b-4ea6-ae32-48f98ebc397a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:28:24 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-81178fb2-4274-46e6-ae4a-a04d6393b113 tempest-VolumesDeleteCascade-818251270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afa09fa9-5248-4885-a9d6-cd8f0e475e02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:28:24 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-81178fb2-4274-46e6-ae4a-a04d6393b113 tempest-VolumesDeleteCascade-818251270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afa09fa9-5248-4885-a9d6-cd8f0e475e02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:28:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1793097766',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7808737-749f-48ea-985b-c5c48f382013,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2db1d034d17b471ba2d5088777bb0fea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:28:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:28:25Z,use_quota=True,user_id='36967ac51ba843fd97571d21908bb3e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:28:24 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-81178fb2-4274-46e6-ae4a-a04d6393b113 tempest-VolumesDeleteCascade-818251270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d582c3a-5aa3-4c8e-aca4-1ce136163d9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:28:24 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-81178fb2-4274-46e6-ae4a-a04d6393b113 tempest-VolumesDeleteCascade-818251270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d582c3a-5aa3-4c8e-aca4-1ce136163d9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:28:24 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-81178fb2-4274-46e6-ae4a-a04d6393b113 tempest-VolumesDeleteCascade-818251270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (740ec598-5caf-4327-b9f7-fe97c0e61c98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:28:24 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-81178fb2-4274-46e6-ae4a-a04d6393b113 tempest-VolumesDeleteCascade-818251270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (740ec598-5caf-4327-b9f7-fe97c0e61c98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a7808737-749f-48ea-985b-c5c48f382013', 'volume_name': 'volume-a7808737-749f-48ea-985b-c5c48f382013', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:28:24 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-81178fb2-4274-46e6-ae4a-a04d6393b113 tempest-VolumesDeleteCascade-818251270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d41ca90-1f35-4c82-88da-ef5ad0a11995) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:28:24 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-81178fb2-4274-46e6-ae4a-a04d6393b113 tempest-VolumesDeleteCascade-818251270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d41ca90-1f35-4c82-88da-ef5ad0a11995) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:28:24 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-81178fb2-4274-46e6-ae4a-a04d6393b113 tempest-VolumesDeleteCascade-818251270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b45439d9-a81b-4b06-acc3-55b0fca52374) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:28:24 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-81178fb2-4274-46e6-ae4a-a04d6393b113 tempest-VolumesDeleteCascade-818251270 None] Volume a7808737-749f-48ea-985b-c5c48f382013: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a7808737-749f-48ea-985b-c5c48f382013', 'volume_size': 1} Jun 29 03:28:24 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-81178fb2-4274-46e6-ae4a-a04d6393b113 tempest-VolumesDeleteCascade-818251270 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:28:25 devstack sudo[102312]: pam_unix(sudo:session): session closed for user root Jun 29 03:28:25 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-7063587f-9ba6-4f0c-a53f-148f5f624c55 tempest-SnapshotsActionsTest-1128167461 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-fcb2f3de-8d93-414c-92d7-f6039a136688.c3e55f9e-2e31-4138-aceb-692b76d90d5b" returned: 0 in 1.007s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:28:25 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-7063587f-9ba6-4f0c-a53f-148f5f624c55 tempest-SnapshotsActionsTest-1128167461 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fcb2f3de-8d93-414c-92d7-f6039a136688(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93468) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 29 03:28:25 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-7063587f-9ba6-4f0c-a53f-148f5f624c55 tempest-SnapshotsActionsTest-1128167461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-fcb2f3de-8d93-414c-92d7-f6039a136688.c3e55f9e-2e31-4138-aceb-692b76d90d5b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-fcb2f3de-8d93-414c-92d7-f6039a136688.a08618db-9341-4433-ac91-6d8b02a23473 1G {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:28:25 devstack sudo[102324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-fcb2f3de-8d93-414c-92d7-f6039a136688.c3e55f9e-2e31-4138-aceb-692b76d90d5b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-fcb2f3de-8d93-414c-92d7-f6039a136688.a08618db-9341-4433-ac91-6d8b02a23473 1G Jun 29 03:28:25 devstack sudo[102324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:28:26 devstack sudo[102324]: pam_unix(sudo:session): session closed for user root Jun 29 03:28:26 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-7063587f-9ba6-4f0c-a53f-148f5f624c55 tempest-SnapshotsActionsTest-1128167461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-fcb2f3de-8d93-414c-92d7-f6039a136688.c3e55f9e-2e31-4138-aceb-692b76d90d5b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-fcb2f3de-8d93-414c-92d7-f6039a136688.a08618db-9341-4433-ac91-6d8b02a23473 1G" returned: 0 in 1.162s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:28:26 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-7063587f-9ba6-4f0c-a53f-148f5f624c55 tempest-SnapshotsActionsTest-1128167461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fcb2f3de-8d93-414c-92d7-f6039a136688.c3e55f9e-2e31-4138-aceb-692b76d90d5b -F qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-fcb2f3de-8d93-414c-92d7-f6039a136688.a08618db-9341-4433-ac91-6d8b02a23473 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:28:26 devstack sudo[102330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fcb2f3de-8d93-414c-92d7-f6039a136688.c3e55f9e-2e31-4138-aceb-692b76d90d5b -F qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-fcb2f3de-8d93-414c-92d7-f6039a136688.a08618db-9341-4433-ac91-6d8b02a23473 Jun 29 03:28:26 devstack sudo[102330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:28:27 devstack sudo[102330]: pam_unix(sudo:session): session closed for user root Jun 29 03:28:27 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-7063587f-9ba6-4f0c-a53f-148f5f624c55 tempest-SnapshotsActionsTest-1128167461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fcb2f3de-8d93-414c-92d7-f6039a136688.c3e55f9e-2e31-4138-aceb-692b76d90d5b -F qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-fcb2f3de-8d93-414c-92d7-f6039a136688.a08618db-9341-4433-ac91-6d8b02a23473" returned: 0 in 0.975s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:28:27 devstack cinder-volume[93468]: WARNING cinder.volume.drivers.remotefs [None req-7063587f-9ba6-4f0c-a53f-148f5f624c55 tempest-SnapshotsActionsTest-1128167461 None] /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-fcb2f3de-8d93-414c-92d7-f6039a136688.a08618db-9341-4433-ac91-6d8b02a23473 is being set with open permissions: ugo+rw Jun 29 03:28:27 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-7063587f-9ba6-4f0c-a53f-148f5f624c55 tempest-SnapshotsActionsTest-1128167461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-fcb2f3de-8d93-414c-92d7-f6039a136688.a08618db-9341-4433-ac91-6d8b02a23473 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:28:27 devstack sudo[102339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-fcb2f3de-8d93-414c-92d7-f6039a136688.a08618db-9341-4433-ac91-6d8b02a23473 Jun 29 03:28:27 devstack sudo[102339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:28:28 devstack sudo[102339]: pam_unix(sudo:session): session closed for user root Jun 29 03:28:28 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-7063587f-9ba6-4f0c-a53f-148f5f624c55 tempest-SnapshotsActionsTest-1128167461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-fcb2f3de-8d93-414c-92d7-f6039a136688.a08618db-9341-4433-ac91-6d8b02a23473" returned: 0 in 0.743s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:28:28 devstack cinder-volume[93468]: DEBUG dbcounter [-] [93468] Writing DB stats cinder:SELECT=133,cinder:INSERT=40,cinder:UPDATE=161,cinder:DELETE=9 {{(pid=93468) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 29 03:28:28 devstack cinder-volume[93468]: DEBUG dbcounter [-] [93468] Writing DB stats cinder:UPDATE=148,cinder:SELECT=144,cinder:INSERT=38,cinder:DELETE=9 {{(pid=93468) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 29 03:28:28 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-7063587f-9ba6-4f0c-a53f-148f5f624c55 tempest-SnapshotsActionsTest-1128167461 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.021s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:28:28 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-81178fb2-4274-46e6-ae4a-a04d6393b113 tempest-VolumesDeleteCascade-818251270 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.281s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:28:28 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-81178fb2-4274-46e6-ae4a-a04d6393b113 tempest-VolumesDeleteCascade-818251270 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:28:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1793097766',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7808737-749f-48ea-985b-c5c48f382013,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2db1d034d17b471ba2d5088777bb0fea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:28:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:28:25Z,use_quota=True,user_id='36967ac51ba843fd97571d21908bb3e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:28:28 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-81178fb2-4274-46e6-ae4a-a04d6393b113 tempest-VolumesDeleteCascade-818251270 None] Creating volume a7808737-749f-48ea-985b-c5c48f382013 {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:28:28 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-81178fb2-4274-46e6-ae4a-a04d6393b113 tempest-VolumesDeleteCascade-818251270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:28:28 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-81178fb2-4274-46e6-ae4a-a04d6393b113 tempest-VolumesDeleteCascade-818251270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:28:28 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-81178fb2-4274-46e6-ae4a-a04d6393b113 tempest-VolumesDeleteCascade-818251270 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:28:28 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-81178fb2-4274-46e6-ae4a-a04d6393b113 tempest-VolumesDeleteCascade-818251270 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:28:28 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-81178fb2-4274-46e6-ae4a-a04d6393b113 tempest-VolumesDeleteCascade-818251270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:28:28 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-81178fb2-4274-46e6-ae4a-a04d6393b113 tempest-VolumesDeleteCascade-818251270 None] Selected osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:28:28 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-81178fb2-4274-46e6-ae4a-a04d6393b113 tempest-VolumesDeleteCascade-818251270 None] casted to osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f Jun 29 03:28:28 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-81178fb2-4274-46e6-ae4a-a04d6393b113 tempest-VolumesDeleteCascade-818251270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-a7808737-749f-48ea-985b-c5c48f382013 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:28:28 devstack sudo[102356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-a7808737-749f-48ea-985b-c5c48f382013 1073741824 Jun 29 03:28:28 devstack sudo[102356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:28:28 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-7063587f-9ba6-4f0c-a53f-148f5f624c55 tempest-SnapshotsActionsTest-1128167461 None] Create snapshot completed successfully Jun 29 03:28:28 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-d6a6751d-0f89-4ac7-9bb5-414d8fe3cf70 tempest-SnapshotsActionsTest-689442564 None] Acquiring lock "cinder-a08618db-9341-4433-ac91-6d8b02a23473-delete_snapshot" by "delete_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:28:28 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-d6a6751d-0f89-4ac7-9bb5-414d8fe3cf70 tempest-SnapshotsActionsTest-689442564 None] Lock "cinder-a08618db-9341-4433-ac91-6d8b02a23473-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:28:28 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-d6a6751d-0f89-4ac7-9bb5-414d8fe3cf70 tempest-SnapshotsActionsTest-689442564 None] Acquiring lock "cinder-quobyte-fcb2f3de-8d93-414c-92d7-f6039a136688" by "delete_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:28:28 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-d6a6751d-0f89-4ac7-9bb5-414d8fe3cf70 tempest-SnapshotsActionsTest-689442564 None] Lock "cinder-quobyte-fcb2f3de-8d93-414c-92d7-f6039a136688" acquired by "delete_snapshot" :: waited 0.016s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:28:28 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-d6a6751d-0f89-4ac7-9bb5-414d8fe3cf70 tempest-SnapshotsActionsTest-689442564 None] Acquiring lock "cinder-quobyte-a08618db-9341-4433-ac91-6d8b02a23473" by "_delete_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:28:28 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-d6a6751d-0f89-4ac7-9bb5-414d8fe3cf70 tempest-SnapshotsActionsTest-689442564 None] Lock "cinder-quobyte-a08618db-9341-4433-ac91-6d8b02a23473" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:28:28 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-d6a6751d-0f89-4ac7-9bb5-414d8fe3cf70 tempest-SnapshotsActionsTest-689442564 None] Deleting offline snapshot a08618db-9341-4433-ac91-6d8b02a23473 of volume fcb2f3de-8d93-414c-92d7-f6039a136688 {{(pid=93468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 29 03:28:28 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-d6a6751d-0f89-4ac7-9bb5-414d8fe3cf70 tempest-SnapshotsActionsTest-689442564 None] snapshot_file for this snap is: volume-fcb2f3de-8d93-414c-92d7-f6039a136688.a08618db-9341-4433-ac91-6d8b02a23473 {{(pid=93468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 29 03:28:28 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[426ed6a3-48f0-4692-b9e8-5485e634e232]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:28:28 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d6a6751d-0f89-4ac7-9bb5-414d8fe3cf70 tempest-SnapshotsActionsTest-689442564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-fcb2f3de-8d93-414c-92d7-f6039a136688.a08618db-9341-4433-ac91-6d8b02a23473 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:28:28 devstack sudo[102358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-fcb2f3de-8d93-414c-92d7-f6039a136688.a08618db-9341-4433-ac91-6d8b02a23473 Jun 29 03:28:28 devstack sudo[102358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:28:29 devstack sudo[102356]: pam_unix(sudo:session): session closed for user root Jun 29 03:28:29 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-81178fb2-4274-46e6-ae4a-a04d6393b113 tempest-VolumesDeleteCascade-818251270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-a7808737-749f-48ea-985b-c5c48f382013 1073741824" returned: 0 in 1.071s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:28:29 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-81178fb2-4274-46e6-ae4a-a04d6393b113 tempest-VolumesDeleteCascade-818251270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-a7808737-749f-48ea-985b-c5c48f382013 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:28:29 devstack sudo[102364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-a7808737-749f-48ea-985b-c5c48f382013 Jun 29 03:28:29 devstack sudo[102364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:28:29 devstack sudo[102358]: pam_unix(sudo:session): session closed for user root Jun 29 03:28:29 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d6a6751d-0f89-4ac7-9bb5-414d8fe3cf70 tempest-SnapshotsActionsTest-689442564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-fcb2f3de-8d93-414c-92d7-f6039a136688.a08618db-9341-4433-ac91-6d8b02a23473" returned: 0 in 0.897s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:28:29 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-d6a6751d-0f89-4ac7-9bb5-414d8fe3cf70 tempest-SnapshotsActionsTest-689442564 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fcb2f3de-8d93-414c-92d7-f6039a136688(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93468) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 29 03:28:29 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[30606c7a-504a-4af0-b8eb-048ddfec2d6a]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:28:29 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d6a6751d-0f89-4ac7-9bb5-414d8fe3cf70 tempest-SnapshotsActionsTest-689442564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-fcb2f3de-8d93-414c-92d7-f6039a136688.c3e55f9e-2e31-4138-aceb-692b76d90d5b {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:28:29 devstack sudo[102370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-fcb2f3de-8d93-414c-92d7-f6039a136688.c3e55f9e-2e31-4138-aceb-692b76d90d5b Jun 29 03:28:29 devstack sudo[102370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:28:30 devstack sudo[102364]: pam_unix(sudo:session): session closed for user root Jun 29 03:28:30 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-81178fb2-4274-46e6-ae4a-a04d6393b113 tempest-VolumesDeleteCascade-818251270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-a7808737-749f-48ea-985b-c5c48f382013" returned: 0 in 0.808s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:28:30 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-81178fb2-4274-46e6-ae4a-a04d6393b113 tempest-VolumesDeleteCascade-818251270 None] <== create_volume: return (1927ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:28:30 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-81178fb2-4274-46e6-ae4a-a04d6393b113 tempest-VolumesDeleteCascade-818251270 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.930s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:28:30 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-81178fb2-4274-46e6-ae4a-a04d6393b113 tempest-VolumesDeleteCascade-818251270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b45439d9-a81b-4b06-acc3-55b0fca52374) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a7808737-749f-48ea-985b-c5c48f382013', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:28:30 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-81178fb2-4274-46e6-ae4a-a04d6393b113 tempest-VolumesDeleteCascade-818251270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3a68ec0-9ecb-426a-ba4e-310a176e6ddf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:28:30 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-2f6c73c1-9912-4484-be4f-4ef55bf1d0e6 tempest-GroupsV314Test-1799081870 None] Group tempest-GroupsV314Test-Group-243301729: creating Jun 29 03:28:30 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-81178fb2-4274-46e6-ae4a-a04d6393b113 tempest-VolumesDeleteCascade-818251270 None] Volume volume-a7808737-749f-48ea-985b-c5c48f382013 (a7808737-749f-48ea-985b-c5c48f382013): created successfully Jun 29 03:28:30 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-81178fb2-4274-46e6-ae4a-a04d6393b113 tempest-VolumesDeleteCascade-818251270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3a68ec0-9ecb-426a-ba4e-310a176e6ddf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:28:30 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-81178fb2-4274-46e6-ae4a-a04d6393b113 tempest-VolumesDeleteCascade-818251270 None] Flow 'volume_create_manager' (ba4c07c0-938b-4ea6-ae32-48f98ebc397a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:28:30 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-81178fb2-4274-46e6-ae4a-a04d6393b113 tempest-VolumesDeleteCascade-818251270 None] Created volume successfully. Jun 29 03:28:30 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-2f6c73c1-9912-4484-be4f-4ef55bf1d0e6 tempest-GroupsV314Test-1799081870 None] Group tempest-GroupsV314Test-Group-243301729: created successfully Jun 29 03:28:30 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-2f6c73c1-9912-4484-be4f-4ef55bf1d0e6 tempest-GroupsV314Test-1799081870 None] Create group completed successfully. Jun 29 03:28:30 devstack sudo[102370]: pam_unix(sudo:session): session closed for user root Jun 29 03:28:30 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d6a6751d-0f89-4ac7-9bb5-414d8fe3cf70 tempest-SnapshotsActionsTest-689442564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-fcb2f3de-8d93-414c-92d7-f6039a136688.c3e55f9e-2e31-4138-aceb-692b76d90d5b" returned: 0 in 0.903s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:28:30 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-d6a6751d-0f89-4ac7-9bb5-414d8fe3cf70 tempest-SnapshotsActionsTest-689442564 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fcb2f3de-8d93-414c-92d7-f6039a136688(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93468) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 29 03:28:30 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d6a6751d-0f89-4ac7-9bb5-414d8fe3cf70 tempest-SnapshotsActionsTest-689442564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-fcb2f3de-8d93-414c-92d7-f6039a136688.a08618db-9341-4433-ac91-6d8b02a23473 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:28:30 devstack sudo[102376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-fcb2f3de-8d93-414c-92d7-f6039a136688.a08618db-9341-4433-ac91-6d8b02a23473 Jun 29 03:28:30 devstack sudo[102376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:28:31 devstack sudo[102376]: pam_unix(sudo:session): session closed for user root Jun 29 03:28:31 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d6a6751d-0f89-4ac7-9bb5-414d8fe3cf70 tempest-SnapshotsActionsTest-689442564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-fcb2f3de-8d93-414c-92d7-f6039a136688.a08618db-9341-4433-ac91-6d8b02a23473" returned: 0 in 0.859s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:28:31 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d6a6751d-0f89-4ac7-9bb5-414d8fe3cf70 tempest-SnapshotsActionsTest-689442564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-fcb2f3de-8d93-414c-92d7-f6039a136688.a08618db-9341-4433-ac91-6d8b02a23473 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:28:31 devstack sudo[102386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-fcb2f3de-8d93-414c-92d7-f6039a136688.a08618db-9341-4433-ac91-6d8b02a23473 Jun 29 03:28:31 devstack sudo[102386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:28:31 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-b2d53d35-eb28-4d0e-8c8c-2a919b493e7d tempest-VolumesDeleteCascade-818251270 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:28:31 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-b2d53d35-eb28-4d0e-8c8c-2a919b493e7d tempest-VolumesDeleteCascade-818251270 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:28:31 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-b2d53d35-eb28-4d0e-8c8c-2a919b493e7d tempest-VolumesDeleteCascade-818251270 None] Creating offline snapshot 0af8b4cc-ff62-4af5-9a8d-bdc7ec87318c of volume a7808737-749f-48ea-985b-c5c48f382013 {{(pid=93468) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 29 03:28:31 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[543acb49-4427-4df3-83a8-c7e174370cb0]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:28:31 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b2d53d35-eb28-4d0e-8c8c-2a919b493e7d tempest-VolumesDeleteCascade-818251270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-a7808737-749f-48ea-985b-c5c48f382013 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:28:31 devstack sudo[102388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-a7808737-749f-48ea-985b-c5c48f382013 Jun 29 03:28:31 devstack sudo[102388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:28:31 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b2552f4-2070-4b72-a92a-4f778e82ffb9 tempest-GroupsV314Test-1799081870 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:28:31 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-3b2552f4-2070-4b72-a92a-4f778e82ffb9 tempest-GroupsV314Test-1799081870 None] Flow 'volume_create_manager' (a4e770ed-c3a2-4d8c-acae-625a4423cbc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:28:31 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-3b2552f4-2070-4b72-a92a-4f778e82ffb9 tempest-GroupsV314Test-1799081870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (127ccb4e-4193-4917-89c8-1191b5250b2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:28:31 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-3b2552f4-2070-4b72-a92a-4f778e82ffb9 tempest-GroupsV314Test-1799081870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (127ccb4e-4193-4917-89c8-1191b5250b2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:28:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1342729886',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=797efe7a-42f0-4a07-9ac7-27189c3898ee,host='devstack@QuobyteHD#QuobyteHD',id=81bc4be0-42e0-442a-90d0-81c4ad65a01d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfdb6d086d1542ae95e67c8afb0d910d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:28:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:28:32Z,use_quota=True,user_id='c5589214c7554448a99eaf36db35d3be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dad90db2-3bd5-4385-9a36-f69f4c2a4ae2),volume_type_id=dad90db2-3bd5-4385-9a36-f69f4c2a4ae2)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:28:31 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-3b2552f4-2070-4b72-a92a-4f778e82ffb9 tempest-GroupsV314Test-1799081870 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3db2c379-d791-441c-8981-bcc720bb6045) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:28:31 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-3b2552f4-2070-4b72-a92a-4f778e82ffb9 tempest-GroupsV314Test-1799081870 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3db2c379-d791-441c-8981-bcc720bb6045) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:28:31 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-3b2552f4-2070-4b72-a92a-4f778e82ffb9 tempest-GroupsV314Test-1799081870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48342845-08c0-4385-b2d2-8ae015c31332) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:28:31 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-3b2552f4-2070-4b72-a92a-4f778e82ffb9 tempest-GroupsV314Test-1799081870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48342845-08c0-4385-b2d2-8ae015c31332) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '81bc4be0-42e0-442a-90d0-81c4ad65a01d', 'volume_name': 'volume-81bc4be0-42e0-442a-90d0-81c4ad65a01d', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:28:31 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-3b2552f4-2070-4b72-a92a-4f778e82ffb9 tempest-GroupsV314Test-1799081870 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8690abc-370c-4e7d-bf14-1d8a4ede5b53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:28:31 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-3b2552f4-2070-4b72-a92a-4f778e82ffb9 tempest-GroupsV314Test-1799081870 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8690abc-370c-4e7d-bf14-1d8a4ede5b53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:28:31 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-3b2552f4-2070-4b72-a92a-4f778e82ffb9 tempest-GroupsV314Test-1799081870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74081b14-b689-4e0b-a095-8e44d14ea5cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:28:31 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-3b2552f4-2070-4b72-a92a-4f778e82ffb9 tempest-GroupsV314Test-1799081870 None] Volume 81bc4be0-42e0-442a-90d0-81c4ad65a01d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-81bc4be0-42e0-442a-90d0-81c4ad65a01d', 'volume_size': 1} Jun 29 03:28:31 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-3b2552f4-2070-4b72-a92a-4f778e82ffb9 tempest-GroupsV314Test-1799081870 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:28:32 devstack sudo[102386]: pam_unix(sudo:session): session closed for user root Jun 29 03:28:32 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d6a6751d-0f89-4ac7-9bb5-414d8fe3cf70 tempest-SnapshotsActionsTest-689442564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-fcb2f3de-8d93-414c-92d7-f6039a136688.a08618db-9341-4433-ac91-6d8b02a23473" returned: 0 in 0.750s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:28:32 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-d6a6751d-0f89-4ac7-9bb5-414d8fe3cf70 tempest-SnapshotsActionsTest-689442564 None] Lock "cinder-quobyte-a08618db-9341-4433-ac91-6d8b02a23473" released by "_delete_snapshot" :: held 3.535s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:28:32 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-d6a6751d-0f89-4ac7-9bb5-414d8fe3cf70 tempest-SnapshotsActionsTest-689442564 None] Lock "cinder-quobyte-fcb2f3de-8d93-414c-92d7-f6039a136688" released by "delete_snapshot" :: held 3.571s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:28:32 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-d6a6751d-0f89-4ac7-9bb5-414d8fe3cf70 tempest-SnapshotsActionsTest-689442564 None] Created reservations ['bcee4488-00d5-4062-8450-1f533297e9c5', '879c1af3-7d7e-47d4-9795-09ccfcb2545c', '477638c5-b440-4604-956a-764d7ffa9b13', 'ca3a9b0d-d7e9-4245-a763-f1b9acf3bea9'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:28:32 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-d6a6751d-0f89-4ac7-9bb5-414d8fe3cf70 tempest-SnapshotsActionsTest-689442564 None] Delete snapshot completed successfully. Jun 29 03:28:32 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-d6a6751d-0f89-4ac7-9bb5-414d8fe3cf70 tempest-SnapshotsActionsTest-689442564 None] Lock "cinder-a08618db-9341-4433-ac91-6d8b02a23473-delete_snapshot" released by "delete_snapshot" :: held 3.706s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:28:32 devstack sudo[102388]: pam_unix(sudo:session): session closed for user root Jun 29 03:28:32 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b2d53d35-eb28-4d0e-8c8c-2a919b493e7d tempest-VolumesDeleteCascade-818251270 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-a7808737-749f-48ea-985b-c5c48f382013" returned: 0 in 0.891s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:28:32 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b2d53d35-eb28-4d0e-8c8c-2a919b493e7d tempest-VolumesDeleteCascade-818251270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-a7808737-749f-48ea-985b-c5c48f382013,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-a7808737-749f-48ea-985b-c5c48f382013.0af8b4cc-ff62-4af5-9a8d-bdc7ec87318c 1G {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:28:32 devstack sudo[102394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-a7808737-749f-48ea-985b-c5c48f382013,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-a7808737-749f-48ea-985b-c5c48f382013.0af8b4cc-ff62-4af5-9a8d-bdc7ec87318c 1G Jun 29 03:28:32 devstack sudo[102394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:28:33 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-a5d76ca7-8b2a-4275-addb-5fe0c3a76111 tempest-SnapshotsActionsTest-1128167461 None] Acquiring lock "cinder-c3e55f9e-2e31-4138-aceb-692b76d90d5b-delete_snapshot" by "delete_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:28:33 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-a5d76ca7-8b2a-4275-addb-5fe0c3a76111 tempest-SnapshotsActionsTest-1128167461 None] Lock "cinder-c3e55f9e-2e31-4138-aceb-692b76d90d5b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:28:33 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-a5d76ca7-8b2a-4275-addb-5fe0c3a76111 tempest-SnapshotsActionsTest-1128167461 None] Acquiring lock "cinder-quobyte-fcb2f3de-8d93-414c-92d7-f6039a136688" by "delete_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:28:33 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-a5d76ca7-8b2a-4275-addb-5fe0c3a76111 tempest-SnapshotsActionsTest-1128167461 None] Lock "cinder-quobyte-fcb2f3de-8d93-414c-92d7-f6039a136688" acquired by "delete_snapshot" :: waited 0.025s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:28:33 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-a5d76ca7-8b2a-4275-addb-5fe0c3a76111 tempest-SnapshotsActionsTest-1128167461 None] Acquiring lock "cinder-quobyte-c3e55f9e-2e31-4138-aceb-692b76d90d5b" by "_delete_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:28:33 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-a5d76ca7-8b2a-4275-addb-5fe0c3a76111 tempest-SnapshotsActionsTest-1128167461 None] Lock "cinder-quobyte-c3e55f9e-2e31-4138-aceb-692b76d90d5b" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:28:33 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-a5d76ca7-8b2a-4275-addb-5fe0c3a76111 tempest-SnapshotsActionsTest-1128167461 None] Deleting offline snapshot c3e55f9e-2e31-4138-aceb-692b76d90d5b of volume fcb2f3de-8d93-414c-92d7-f6039a136688 {{(pid=93468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 29 03:28:33 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-a5d76ca7-8b2a-4275-addb-5fe0c3a76111 tempest-SnapshotsActionsTest-1128167461 None] snapshot_file for this snap is: volume-fcb2f3de-8d93-414c-92d7-f6039a136688.c3e55f9e-2e31-4138-aceb-692b76d90d5b {{(pid=93468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 29 03:28:33 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[3189efe4-5088-4515-ae71-d863422daee0]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:28:33 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a5d76ca7-8b2a-4275-addb-5fe0c3a76111 tempest-SnapshotsActionsTest-1128167461 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-fcb2f3de-8d93-414c-92d7-f6039a136688.c3e55f9e-2e31-4138-aceb-692b76d90d5b {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:28:33 devstack sudo[102394]: pam_unix(sudo:session): session closed for user root Jun 29 03:28:33 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b2d53d35-eb28-4d0e-8c8c-2a919b493e7d tempest-VolumesDeleteCascade-818251270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-a7808737-749f-48ea-985b-c5c48f382013,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-a7808737-749f-48ea-985b-c5c48f382013.0af8b4cc-ff62-4af5-9a8d-bdc7ec87318c 1G" returned: 0 in 1.042s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:28:33 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b2d53d35-eb28-4d0e-8c8c-2a919b493e7d tempest-VolumesDeleteCascade-818251270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7808737-749f-48ea-985b-c5c48f382013 -F qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-a7808737-749f-48ea-985b-c5c48f382013.0af8b4cc-ff62-4af5-9a8d-bdc7ec87318c {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:28:33 devstack sudo[102432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7808737-749f-48ea-985b-c5c48f382013 -F qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-a7808737-749f-48ea-985b-c5c48f382013.0af8b4cc-ff62-4af5-9a8d-bdc7ec87318c Jun 29 03:28:33 devstack sudo[102432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:28:33 devstack sudo[102428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-fcb2f3de-8d93-414c-92d7-f6039a136688.c3e55f9e-2e31-4138-aceb-692b76d90d5b Jun 29 03:28:33 devstack sudo[102428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:28:34 devstack sudo[102432]: pam_unix(sudo:session): session closed for user root Jun 29 03:28:34 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b2d53d35-eb28-4d0e-8c8c-2a919b493e7d tempest-VolumesDeleteCascade-818251270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7808737-749f-48ea-985b-c5c48f382013 -F qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-a7808737-749f-48ea-985b-c5c48f382013.0af8b4cc-ff62-4af5-9a8d-bdc7ec87318c" returned: 0 in 1.215s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:28:34 devstack cinder-volume[93468]: WARNING cinder.volume.drivers.remotefs [None req-b2d53d35-eb28-4d0e-8c8c-2a919b493e7d tempest-VolumesDeleteCascade-818251270 None] /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-a7808737-749f-48ea-985b-c5c48f382013.0af8b4cc-ff62-4af5-9a8d-bdc7ec87318c is being set with open permissions: ugo+rw Jun 29 03:28:34 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b2d53d35-eb28-4d0e-8c8c-2a919b493e7d tempest-VolumesDeleteCascade-818251270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-a7808737-749f-48ea-985b-c5c48f382013.0af8b4cc-ff62-4af5-9a8d-bdc7ec87318c {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:28:34 devstack sudo[102487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-a7808737-749f-48ea-985b-c5c48f382013.0af8b4cc-ff62-4af5-9a8d-bdc7ec87318c Jun 29 03:28:34 devstack sudo[102487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:28:34 devstack sudo[102428]: pam_unix(sudo:session): session closed for user root Jun 29 03:28:34 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a5d76ca7-8b2a-4275-addb-5fe0c3a76111 tempest-SnapshotsActionsTest-1128167461 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-fcb2f3de-8d93-414c-92d7-f6039a136688.c3e55f9e-2e31-4138-aceb-692b76d90d5b" returned: 0 in 1.457s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:28:34 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-a5d76ca7-8b2a-4275-addb-5fe0c3a76111 tempest-SnapshotsActionsTest-1128167461 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fcb2f3de-8d93-414c-92d7-f6039a136688(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93468) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 29 03:28:34 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4ed597c-246a-4f1f-abf4-b84647d16466]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:28:34 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a5d76ca7-8b2a-4275-addb-5fe0c3a76111 tempest-SnapshotsActionsTest-1128167461 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-fcb2f3de-8d93-414c-92d7-f6039a136688 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:28:35 devstack sudo[102493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-fcb2f3de-8d93-414c-92d7-f6039a136688 Jun 29 03:28:35 devstack sudo[102493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:28:35 devstack sudo[102487]: pam_unix(sudo:session): session closed for user root Jun 29 03:28:35 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b2d53d35-eb28-4d0e-8c8c-2a919b493e7d tempest-VolumesDeleteCascade-818251270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-a7808737-749f-48ea-985b-c5c48f382013.0af8b4cc-ff62-4af5-9a8d-bdc7ec87318c" returned: 0 in 0.720s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:28:35 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b2d53d35-eb28-4d0e-8c8c-2a919b493e7d tempest-VolumesDeleteCascade-818251270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-a7808737-749f-48ea-985b-c5c48f382013.info {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:28:35 devstack sudo[102498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-a7808737-749f-48ea-985b-c5c48f382013.info Jun 29 03:28:35 devstack sudo[102498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:28:35 devstack sudo[102493]: pam_unix(sudo:session): session closed for user root Jun 29 03:28:35 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a5d76ca7-8b2a-4275-addb-5fe0c3a76111 tempest-SnapshotsActionsTest-1128167461 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-fcb2f3de-8d93-414c-92d7-f6039a136688" returned: 0 in 1.022s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:28:35 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a5d76ca7-8b2a-4275-addb-5fe0c3a76111 tempest-SnapshotsActionsTest-1128167461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-fcb2f3de-8d93-414c-92d7-f6039a136688.c3e55f9e-2e31-4138-aceb-692b76d90d5b {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:28:35 devstack sudo[102503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-fcb2f3de-8d93-414c-92d7-f6039a136688.c3e55f9e-2e31-4138-aceb-692b76d90d5b Jun 29 03:28:35 devstack sudo[102503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:28:36 devstack sudo[102498]: pam_unix(sudo:session): session closed for user root Jun 29 03:28:36 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b2d53d35-eb28-4d0e-8c8c-2a919b493e7d tempest-VolumesDeleteCascade-818251270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-a7808737-749f-48ea-985b-c5c48f382013.info" returned: 0 in 0.857s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:28:36 devstack cinder-volume[93468]: WARNING cinder.volume.drivers.remotefs [None req-b2d53d35-eb28-4d0e-8c8c-2a919b493e7d tempest-VolumesDeleteCascade-818251270 None] /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-a7808737-749f-48ea-985b-c5c48f382013.info is being set with open permissions: ugo+rw Jun 29 03:28:36 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b2d53d35-eb28-4d0e-8c8c-2a919b493e7d tempest-VolumesDeleteCascade-818251270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-a7808737-749f-48ea-985b-c5c48f382013.info {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:28:36 devstack sudo[102506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-a7808737-749f-48ea-985b-c5c48f382013.info Jun 29 03:28:36 devstack sudo[102506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:28:36 devstack sudo[102503]: pam_unix(sudo:session): session closed for user root Jun 29 03:28:36 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a5d76ca7-8b2a-4275-addb-5fe0c3a76111 tempest-SnapshotsActionsTest-1128167461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-fcb2f3de-8d93-414c-92d7-f6039a136688.c3e55f9e-2e31-4138-aceb-692b76d90d5b" returned: 0 in 0.886s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:28:36 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a5d76ca7-8b2a-4275-addb-5fe0c3a76111 tempest-SnapshotsActionsTest-1128167461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-fcb2f3de-8d93-414c-92d7-f6039a136688.c3e55f9e-2e31-4138-aceb-692b76d90d5b {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:28:36 devstack sudo[102512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-fcb2f3de-8d93-414c-92d7-f6039a136688.c3e55f9e-2e31-4138-aceb-692b76d90d5b Jun 29 03:28:36 devstack sudo[102512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:28:37 devstack sudo[102506]: pam_unix(sudo:session): session closed for user root Jun 29 03:28:37 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b2d53d35-eb28-4d0e-8c8c-2a919b493e7d tempest-VolumesDeleteCascade-818251270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-a7808737-749f-48ea-985b-c5c48f382013.info" returned: 0 in 0.911s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:28:37 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-b2d53d35-eb28-4d0e-8c8c-2a919b493e7d tempest-VolumesDeleteCascade-818251270 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.758s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:28:37 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-3b2552f4-2070-4b72-a92a-4f778e82ffb9 tempest-GroupsV314Test-1799081870 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.296s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:28:37 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-3b2552f4-2070-4b72-a92a-4f778e82ffb9 tempest-GroupsV314Test-1799081870 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=797efe7a-42f0-4a07-9ac7-27189c3898ee,created_at=2026-06-29T01:28:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1342729886',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=797efe7a-42f0-4a07-9ac7-27189c3898ee,host='devstack@QuobyteHD#QuobyteHD',id=81bc4be0-42e0-442a-90d0-81c4ad65a01d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfdb6d086d1542ae95e67c8afb0d910d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:28:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:28:32Z,use_quota=True,user_id='c5589214c7554448a99eaf36db35d3be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dad90db2-3bd5-4385-9a36-f69f4c2a4ae2),volume_type_id=dad90db2-3bd5-4385-9a36-f69f4c2a4ae2)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:28:37 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-3b2552f4-2070-4b72-a92a-4f778e82ffb9 tempest-GroupsV314Test-1799081870 None] Creating volume 81bc4be0-42e0-442a-90d0-81c4ad65a01d {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:28:37 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-3b2552f4-2070-4b72-a92a-4f778e82ffb9 tempest-GroupsV314Test-1799081870 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:28:37 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-3b2552f4-2070-4b72-a92a-4f778e82ffb9 tempest-GroupsV314Test-1799081870 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:28:37 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-3b2552f4-2070-4b72-a92a-4f778e82ffb9 tempest-GroupsV314Test-1799081870 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:28:37 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-3b2552f4-2070-4b72-a92a-4f778e82ffb9 tempest-GroupsV314Test-1799081870 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:28:37 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-3b2552f4-2070-4b72-a92a-4f778e82ffb9 tempest-GroupsV314Test-1799081870 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:28:37 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-3b2552f4-2070-4b72-a92a-4f778e82ffb9 tempest-GroupsV314Test-1799081870 None] Selected osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:28:37 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-3b2552f4-2070-4b72-a92a-4f778e82ffb9 tempest-GroupsV314Test-1799081870 None] casted to osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f Jun 29 03:28:37 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-3b2552f4-2070-4b72-a92a-4f778e82ffb9 tempest-GroupsV314Test-1799081870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-81bc4be0-42e0-442a-90d0-81c4ad65a01d 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:28:37 devstack sudo[102515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-81bc4be0-42e0-442a-90d0-81c4ad65a01d 1073741824 Jun 29 03:28:37 devstack sudo[102515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:28:37 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-b2d53d35-eb28-4d0e-8c8c-2a919b493e7d tempest-VolumesDeleteCascade-818251270 None] Create snapshot completed successfully Jun 29 03:28:37 devstack sudo[102512]: pam_unix(sudo:session): session closed for user root Jun 29 03:28:37 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a5d76ca7-8b2a-4275-addb-5fe0c3a76111 tempest-SnapshotsActionsTest-1128167461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-fcb2f3de-8d93-414c-92d7-f6039a136688.c3e55f9e-2e31-4138-aceb-692b76d90d5b" returned: 0 in 0.892s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:28:37 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-a5d76ca7-8b2a-4275-addb-5fe0c3a76111 tempest-SnapshotsActionsTest-1128167461 None] Lock "cinder-quobyte-c3e55f9e-2e31-4138-aceb-692b76d90d5b" released by "_delete_snapshot" :: held 4.511s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:28:37 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-a5d76ca7-8b2a-4275-addb-5fe0c3a76111 tempest-SnapshotsActionsTest-1128167461 None] Lock "cinder-quobyte-fcb2f3de-8d93-414c-92d7-f6039a136688" released by "delete_snapshot" :: held 4.536s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:28:37 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-a5d76ca7-8b2a-4275-addb-5fe0c3a76111 tempest-SnapshotsActionsTest-1128167461 None] Created reservations ['07598bf6-a255-4872-967b-c72fbbb85343', 'e2e1bb13-6e46-4dfb-bab4-8691aaf20319', '56a741e1-ada1-4383-8239-6f8c81f85d8e', '7a1b2073-e3f9-4087-b8d3-477bda0f5147'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:28:38 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-a5d76ca7-8b2a-4275-addb-5fe0c3a76111 tempest-SnapshotsActionsTest-1128167461 None] Delete snapshot completed successfully. Jun 29 03:28:38 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-a5d76ca7-8b2a-4275-addb-5fe0c3a76111 tempest-SnapshotsActionsTest-1128167461 None] Lock "cinder-c3e55f9e-2e31-4138-aceb-692b76d90d5b-delete_snapshot" released by "delete_snapshot" :: held 4.886s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:28:38 devstack sudo[102515]: pam_unix(sudo:session): session closed for user root Jun 29 03:28:38 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-3b2552f4-2070-4b72-a92a-4f778e82ffb9 tempest-GroupsV314Test-1799081870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-81bc4be0-42e0-442a-90d0-81c4ad65a01d 1073741824" returned: 0 in 1.523s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:28:38 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b287b52-4908-48de-b59b-45d471e7203c tempest-VolumesDeleteCascade-818251270 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:28:38 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-3b2552f4-2070-4b72-a92a-4f778e82ffb9 tempest-GroupsV314Test-1799081870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-81bc4be0-42e0-442a-90d0-81c4ad65a01d {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:28:38 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-5b287b52-4908-48de-b59b-45d471e7203c tempest-VolumesDeleteCascade-818251270 None] Flow 'volume_create_manager' (26897758-13e4-4866-a380-a01a97c7afa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:28:38 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-5b287b52-4908-48de-b59b-45d471e7203c tempest-VolumesDeleteCascade-818251270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68e8daad-9ecb-421f-aaaf-0e1cf0466da9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:28:38 devstack sudo[102559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-81bc4be0-42e0-442a-90d0-81c4ad65a01d Jun 29 03:28:38 devstack sudo[102559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:28:38 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-d49527a4-f3f3-4261-91d3-70819e70cb27 tempest-SnapshotsActionsTest-1128167461 None] Acquiring lock "cinder-fcb2f3de-8d93-414c-92d7-f6039a136688-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:28:38 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-5b287b52-4908-48de-b59b-45d471e7203c tempest-VolumesDeleteCascade-818251270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68e8daad-9ecb-421f-aaaf-0e1cf0466da9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:28:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1506926743',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1784a2d-590d-4c7d-8d00-dac1bc356114,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2db1d034d17b471ba2d5088777bb0fea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:28:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=0af8b4cc-ff62-4af5-9a8d-bdc7ec87318c,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:28:39Z,use_quota=True,user_id='36967ac51ba843fd97571d21908bb3e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:28:38 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-5b287b52-4908-48de-b59b-45d471e7203c tempest-VolumesDeleteCascade-818251270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f596c089-d25c-47a2-8801-25e6478f7a25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:28:39 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-5b287b52-4908-48de-b59b-45d471e7203c tempest-VolumesDeleteCascade-818251270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f596c089-d25c-47a2-8801-25e6478f7a25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:28:39 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-5b287b52-4908-48de-b59b-45d471e7203c tempest-VolumesDeleteCascade-818251270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a403ebc9-71e6-46ba-982b-544eaa40782d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:28:39 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-5b287b52-4908-48de-b59b-45d471e7203c tempest-VolumesDeleteCascade-818251270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a403ebc9-71e6-46ba-982b-544eaa40782d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'f1784a2d-590d-4c7d-8d00-dac1bc356114', 'volume_name': 'volume-f1784a2d-590d-4c7d-8d00-dac1bc356114', 'volume_size': 1, 'snapshot_id': '0af8b4cc-ff62-4af5-9a8d-bdc7ec87318c'}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:28:39 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-5b287b52-4908-48de-b59b-45d471e7203c tempest-VolumesDeleteCascade-818251270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b31f09a2-683a-45c6-a746-2254b6d6e351) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:28:39 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-5b287b52-4908-48de-b59b-45d471e7203c tempest-VolumesDeleteCascade-818251270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b31f09a2-683a-45c6-a746-2254b6d6e351) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:28:39 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-5b287b52-4908-48de-b59b-45d471e7203c tempest-VolumesDeleteCascade-818251270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f618517-3e86-48b9-a518-8511772e3b2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:28:39 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-5b287b52-4908-48de-b59b-45d471e7203c tempest-VolumesDeleteCascade-818251270 None] Volume f1784a2d-590d-4c7d-8d00-dac1bc356114: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-f1784a2d-590d-4c7d-8d00-dac1bc356114', 'volume_size': 1, 'snapshot_id': '0af8b4cc-ff62-4af5-9a8d-bdc7ec87318c'} Jun 29 03:28:39 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-d49527a4-f3f3-4261-91d3-70819e70cb27 tempest-SnapshotsActionsTest-1128167461 None] Lock "cinder-fcb2f3de-8d93-414c-92d7-f6039a136688-delete_volume" acquired by "delete_volume" :: waited 0.125s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:28:39 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-5b287b52-4908-48de-b59b-45d471e7203c tempest-VolumesDeleteCascade-818251270 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:28:39 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-d49527a4-f3f3-4261-91d3-70819e70cb27 tempest-SnapshotsActionsTest-1128167461 None] Acquiring lock "cinder-quobyte-fcb2f3de-8d93-414c-92d7-f6039a136688" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:28:39 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-d49527a4-f3f3-4261-91d3-70819e70cb27 tempest-SnapshotsActionsTest-1128167461 None] Lock "cinder-quobyte-fcb2f3de-8d93-414c-92d7-f6039a136688" acquired by "delete_volume" :: waited 0.023s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:28:39 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[3744ca0b-7adb-47a3-baa7-149db30df853]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:28:39 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d49527a4-f3f3-4261-91d3-70819e70cb27 tempest-SnapshotsActionsTest-1128167461 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-fcb2f3de-8d93-414c-92d7-f6039a136688 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:28:39 devstack sudo[102562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-fcb2f3de-8d93-414c-92d7-f6039a136688 Jun 29 03:28:39 devstack sudo[102562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:28:39 devstack sudo[102559]: pam_unix(sudo:session): session closed for user root Jun 29 03:28:39 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-3b2552f4-2070-4b72-a92a-4f778e82ffb9 tempest-GroupsV314Test-1799081870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-81bc4be0-42e0-442a-90d0-81c4ad65a01d" returned: 0 in 0.861s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:28:39 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-3b2552f4-2070-4b72-a92a-4f778e82ffb9 tempest-GroupsV314Test-1799081870 None] <== create_volume: return (2469ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:28:39 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-3b2552f4-2070-4b72-a92a-4f778e82ffb9 tempest-GroupsV314Test-1799081870 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.474s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:28:39 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-5b287b52-4908-48de-b59b-45d471e7203c tempest-VolumesDeleteCascade-818251270 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.639s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:28:39 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-5b287b52-4908-48de-b59b-45d471e7203c tempest-VolumesDeleteCascade-818251270 None] Acquiring lock "cinder-quobyte-0af8b4cc-ff62-4af5-9a8d-bdc7ec87318c-f1784a2d-590d-4c7d-8d00-dac1bc356114" by "_create_volume_from_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:28:39 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-3b2552f4-2070-4b72-a92a-4f778e82ffb9 tempest-GroupsV314Test-1799081870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74081b14-b689-4e0b-a095-8e44d14ea5cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-81bc4be0-42e0-442a-90d0-81c4ad65a01d', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:28:39 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-3b2552f4-2070-4b72-a92a-4f778e82ffb9 tempest-GroupsV314Test-1799081870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92f54ce7-eadf-4569-b8bb-31f6b2762426) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:28:39 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-5b287b52-4908-48de-b59b-45d471e7203c tempest-VolumesDeleteCascade-818251270 None] Lock "cinder-quobyte-0af8b4cc-ff62-4af5-9a8d-bdc7ec87318c-f1784a2d-590d-4c7d-8d00-dac1bc356114" acquired by "_create_volume_from_snapshot" :: waited 0.042s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:28:39 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-5b287b52-4908-48de-b59b-45d471e7203c tempest-VolumesDeleteCascade-818251270 None] Creating volume f1784a2d-590d-4c7d-8d00-dac1bc356114 from snapshot 0af8b4cc-ff62-4af5-9a8d-bdc7ec87318c {{(pid=93468) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 29 03:28:39 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-5b287b52-4908-48de-b59b-45d471e7203c tempest-VolumesDeleteCascade-818251270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:28:39 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-5b287b52-4908-48de-b59b-45d471e7203c tempest-VolumesDeleteCascade-818251270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:28:39 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-5b287b52-4908-48de-b59b-45d471e7203c tempest-VolumesDeleteCascade-818251270 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:28:39 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-5b287b52-4908-48de-b59b-45d471e7203c tempest-VolumesDeleteCascade-818251270 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:28:39 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-5b287b52-4908-48de-b59b-45d471e7203c tempest-VolumesDeleteCascade-818251270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:28:39 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-5b287b52-4908-48de-b59b-45d471e7203c tempest-VolumesDeleteCascade-818251270 None] Selected osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:28:39 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-5b287b52-4908-48de-b59b-45d471e7203c tempest-VolumesDeleteCascade-818251270 None] Acquiring lock "cinder-quobyte-f1784a2d-590d-4c7d-8d00-dac1bc356114" by "_copy_volume_from_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:28:39 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-3b2552f4-2070-4b72-a92a-4f778e82ffb9 tempest-GroupsV314Test-1799081870 None] Volume volume-81bc4be0-42e0-442a-90d0-81c4ad65a01d (81bc4be0-42e0-442a-90d0-81c4ad65a01d): created successfully Jun 29 03:28:39 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-3b2552f4-2070-4b72-a92a-4f778e82ffb9 tempest-GroupsV314Test-1799081870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92f54ce7-eadf-4569-b8bb-31f6b2762426) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:28:39 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-3b2552f4-2070-4b72-a92a-4f778e82ffb9 tempest-GroupsV314Test-1799081870 None] Flow 'volume_create_manager' (a4e770ed-c3a2-4d8c-acae-625a4423cbc3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:28:39 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-5b287b52-4908-48de-b59b-45d471e7203c tempest-VolumesDeleteCascade-818251270 None] Lock "cinder-quobyte-f1784a2d-590d-4c7d-8d00-dac1bc356114" acquired by "_copy_volume_from_snapshot" :: waited 0.058s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:28:39 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-5b287b52-4908-48de-b59b-45d471e7203c tempest-VolumesDeleteCascade-818251270 None] snapshot: 0af8b4cc-ff62-4af5-9a8d-bdc7ec87318c, volume: f1784a2d-590d-4c7d-8d00-dac1bc356114, {{(pid=93468) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 29 03:28:39 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-5b287b52-4908-48de-b59b-45d471e7203c tempest-VolumesDeleteCascade-818251270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:28:39 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-5b287b52-4908-48de-b59b-45d471e7203c tempest-VolumesDeleteCascade-818251270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:28:39 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-5b287b52-4908-48de-b59b-45d471e7203c tempest-VolumesDeleteCascade-818251270 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:28:39 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-5b287b52-4908-48de-b59b-45d471e7203c tempest-VolumesDeleteCascade-818251270 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:28:39 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-5b287b52-4908-48de-b59b-45d471e7203c tempest-VolumesDeleteCascade-818251270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:28:39 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-3b2552f4-2070-4b72-a92a-4f778e82ffb9 tempest-GroupsV314Test-1799081870 None] Created volume successfully. Jun 29 03:28:39 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[05bd069e-8eb6-4fe0-a99b-746ea444efe8]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:28:39 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-5b287b52-4908-48de-b59b-45d471e7203c tempest-VolumesDeleteCascade-818251270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-a7808737-749f-48ea-985b-c5c48f382013.0af8b4cc-ff62-4af5-9a8d-bdc7ec87318c {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:28:40 devstack sudo[102567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-a7808737-749f-48ea-985b-c5c48f382013.0af8b4cc-ff62-4af5-9a8d-bdc7ec87318c Jun 29 03:28:40 devstack sudo[102567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:28:40 devstack sudo[102562]: pam_unix(sudo:session): session closed for user root Jun 29 03:28:40 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d49527a4-f3f3-4261-91d3-70819e70cb27 tempest-SnapshotsActionsTest-1128167461 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-fcb2f3de-8d93-414c-92d7-f6039a136688" returned: 0 in 0.937s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:28:40 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d49527a4-f3f3-4261-91d3-70819e70cb27 tempest-SnapshotsActionsTest-1128167461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-fcb2f3de-8d93-414c-92d7-f6039a136688 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:28:40 devstack sudo[102570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-fcb2f3de-8d93-414c-92d7-f6039a136688 Jun 29 03:28:40 devstack sudo[102570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:28:40 devstack sudo[102567]: pam_unix(sudo:session): session closed for user root Jun 29 03:28:40 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-5b287b52-4908-48de-b59b-45d471e7203c tempest-VolumesDeleteCascade-818251270 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-a7808737-749f-48ea-985b-c5c48f382013.0af8b4cc-ff62-4af5-9a8d-bdc7ec87318c" returned: 0 in 0.880s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:28:40 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-5b287b52-4908-48de-b59b-45d471e7203c tempest-VolumesDeleteCascade-818251270 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a7808737-749f-48ea-985b-c5c48f382013(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93468) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 29 03:28:40 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-5b287b52-4908-48de-b59b-45d471e7203c tempest-VolumesDeleteCascade-818251270 None] will copy from snapshot at /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-a7808737-749f-48ea-985b-c5c48f382013 {{(pid=93468) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 29 03:28:40 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-5b287b52-4908-48de-b59b-45d471e7203c tempest-VolumesDeleteCascade-818251270 None] Creating direct copy from snapshot {{(pid=93468) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 29 03:28:40 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b01f4ca-0690-4f79-9a16-2c6ee2eac28b]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:28:40 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-5b287b52-4908-48de-b59b-45d471e7203c tempest-VolumesDeleteCascade-818251270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-a7808737-749f-48ea-985b-c5c48f382013 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:28:40 devstack sudo[102570]: pam_unix(sudo:session): session closed for user root Jun 29 03:28:40 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d49527a4-f3f3-4261-91d3-70819e70cb27 tempest-SnapshotsActionsTest-1128167461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-fcb2f3de-8d93-414c-92d7-f6039a136688" returned: 0 in 0.819s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:28:40 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-d49527a4-f3f3-4261-91d3-70819e70cb27 tempest-SnapshotsActionsTest-1128167461 None] Lock "cinder-quobyte-fcb2f3de-8d93-414c-92d7-f6039a136688" released by "delete_volume" :: held 1.849s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:28:40 devstack sudo[102576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-a7808737-749f-48ea-985b-c5c48f382013 Jun 29 03:28:40 devstack sudo[102576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:28:41 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-d49527a4-f3f3-4261-91d3-70819e70cb27 tempest-SnapshotsActionsTest-1128167461 None] Created reservations ['c367b98f-13ff-49eb-86c6-a5ed3eec57af', '8bd057dc-090b-4242-b7ba-2fe5a067ce37', 'dced408f-fc11-4931-b23b-c67d4370c8cc', '1261b517-857b-40f7-a448-908c4d299ba0'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:28:41 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-d49527a4-f3f3-4261-91d3-70819e70cb27 tempest-SnapshotsActionsTest-1128167461 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:28:41 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-d49527a4-f3f3-4261-91d3-70819e70cb27 tempest-SnapshotsActionsTest-1128167461 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:28:41 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-d49527a4-f3f3-4261-91d3-70819e70cb27 tempest-SnapshotsActionsTest-1128167461 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:28:41 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-d49527a4-f3f3-4261-91d3-70819e70cb27 tempest-SnapshotsActionsTest-1128167461 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:28:41 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-d49527a4-f3f3-4261-91d3-70819e70cb27 tempest-SnapshotsActionsTest-1128167461 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:28:41 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d49527a4-f3f3-4261-91d3-70819e70cb27 tempest-SnapshotsActionsTest-1128167461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:28:41 devstack sudo[102579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf Jun 29 03:28:41 devstack sudo[102579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:28:41 devstack sudo[102576]: pam_unix(sudo:session): session closed for user root Jun 29 03:28:41 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-5b287b52-4908-48de-b59b-45d471e7203c tempest-VolumesDeleteCascade-818251270 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-a7808737-749f-48ea-985b-c5c48f382013" returned: 0 in 0.971s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:28:41 devstack cinder-volume[93468]: DEBUG cinder.utils [None req-5b287b52-4908-48de-b59b-45d471e7203c tempest-VolumesDeleteCascade-818251270 None] Path /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-f1784a2d-590d-4c7d-8d00-dac1bc356114 not found in is_blk_device check {{(pid=93468) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 29 03:28:41 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-5b287b52-4908-48de-b59b-45d471e7203c tempest-VolumesDeleteCascade-818251270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-a7808737-749f-48ea-985b-c5c48f382013 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-f1784a2d-590d-4c7d-8d00-dac1bc356114 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:28:41 devstack sudo[102585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-a7808737-749f-48ea-985b-c5c48f382013 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-f1784a2d-590d-4c7d-8d00-dac1bc356114 Jun 29 03:28:41 devstack sudo[102585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:28:42 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-2d198e54-6442-4ca0-81dc-15ad88e815a0 tempest-GroupsV314Test-1799081870 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:28:42 devstack sudo[102579]: pam_unix(sudo:session): session closed for user root Jun 29 03:28:42 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d49527a4-f3f3-4261-91d3-70819e70cb27 tempest-SnapshotsActionsTest-1128167461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf" returned: 0 in 1.163s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:28:42 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-d49527a4-f3f3-4261-91d3-70819e70cb27 tempest-SnapshotsActionsTest-1128167461 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:28:42 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-d49527a4-f3f3-4261-91d3-70819e70cb27 tempest-SnapshotsActionsTest-1128167461 None] Deleted volume successfully. Jun 29 03:28:42 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-d49527a4-f3f3-4261-91d3-70819e70cb27 tempest-SnapshotsActionsTest-1128167461 None] Lock "cinder-fcb2f3de-8d93-414c-92d7-f6039a136688-delete_volume" released by "delete_volume" :: held 3.270s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:28:49 devstack sudo[102585]: pam_unix(sudo:session): session closed for user root Jun 29 03:28:49 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-5b287b52-4908-48de-b59b-45d471e7203c tempest-VolumesDeleteCascade-818251270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-a7808737-749f-48ea-985b-c5c48f382013 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-f1784a2d-590d-4c7d-8d00-dac1bc356114" returned: 0 in 7.260s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:28:49 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[f788f837-0a2d-428d-8b1a-618b055f3689]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:28:49 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-5b287b52-4908-48de-b59b-45d471e7203c tempest-VolumesDeleteCascade-818251270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-a7808737-749f-48ea-985b-c5c48f382013 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:28:49 devstack sudo[102617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-a7808737-749f-48ea-985b-c5c48f382013 Jun 29 03:28:49 devstack sudo[102617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:28:50 devstack sudo[102617]: pam_unix(sudo:session): session closed for user root Jun 29 03:28:50 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-5b287b52-4908-48de-b59b-45d471e7203c tempest-VolumesDeleteCascade-818251270 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-a7808737-749f-48ea-985b-c5c48f382013" returned: 0 in 0.948s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:28:50 devstack cinder-volume[93468]: DEBUG cinder.image.image_utils [None req-5b287b52-4908-48de-b59b-45d471e7203c tempest-VolumesDeleteCascade-818251270 None] Image conversion details: src /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-a7808737-749f-48ea-985b-c5c48f382013, size 1024.00 MB, duration 7.26 sec, destination /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-f1784a2d-590d-4c7d-8d00-dac1bc356114 {{(pid=93468) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 29 03:28:50 devstack cinder-volume[93468]: INFO cinder.image.image_utils [None req-5b287b52-4908-48de-b59b-45d471e7203c tempest-VolumesDeleteCascade-818251270 None] Converted 1024.00 MB image at 141.03 MB/s Jun 29 03:28:50 devstack cinder-volume[93468]: WARNING cinder.volume.drivers.remotefs [None req-5b287b52-4908-48de-b59b-45d471e7203c tempest-VolumesDeleteCascade-818251270 None] /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-f1784a2d-590d-4c7d-8d00-dac1bc356114 is being set with open permissions: ugo+rw Jun 29 03:28:50 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-5b287b52-4908-48de-b59b-45d471e7203c tempest-VolumesDeleteCascade-818251270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-f1784a2d-590d-4c7d-8d00-dac1bc356114 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:28:50 devstack sudo[102622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-f1784a2d-590d-4c7d-8d00-dac1bc356114 Jun 29 03:28:50 devstack sudo[102622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:28:50 devstack sudo[102622]: pam_unix(sudo:session): session closed for user root Jun 29 03:28:50 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-5b287b52-4908-48de-b59b-45d471e7203c tempest-VolumesDeleteCascade-818251270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-f1784a2d-590d-4c7d-8d00-dac1bc356114" returned: 0 in 0.695s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:28:50 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-5b287b52-4908-48de-b59b-45d471e7203c tempest-VolumesDeleteCascade-818251270 None] Lock "cinder-quobyte-f1784a2d-590d-4c7d-8d00-dac1bc356114" released by "_copy_volume_from_snapshot" :: held 10.919s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:28:50 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-5b287b52-4908-48de-b59b-45d471e7203c tempest-VolumesDeleteCascade-818251270 None] Lock "cinder-quobyte-0af8b4cc-ff62-4af5-9a8d-bdc7ec87318c-f1784a2d-590d-4c7d-8d00-dac1bc356114" released by "_create_volume_from_snapshot" :: held 10.993s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:28:50 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-5b287b52-4908-48de-b59b-45d471e7203c tempest-VolumesDeleteCascade-818251270 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.036s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:28:50 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-2d198e54-6442-4ca0-81dc-15ad88e815a0 tempest-GroupsV314Test-1799081870 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 8.651s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:28:50 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-2d198e54-6442-4ca0-81dc-15ad88e815a0 tempest-GroupsV314Test-1799081870 None] Cloning volume 81bc4be0-42e0-442a-90d0-81c4ad65a01d to volume 55ff3e1a-6b5f-4dfd-8134-f9f95b4ce4e8 Jun 29 03:28:50 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-5b287b52-4908-48de-b59b-45d471e7203c tempest-VolumesDeleteCascade-818251270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f618517-3e86-48b9-a518-8511772e3b2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f1784a2d-590d-4c7d-8d00-dac1bc356114', 'volume_size': 1, 'snapshot_id': '0af8b4cc-ff62-4af5-9a8d-bdc7ec87318c'}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:28:50 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-5b287b52-4908-48de-b59b-45d471e7203c tempest-VolumesDeleteCascade-818251270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4966ae63-6039-437e-b00f-fe2f1e269aa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:28:50 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-2d198e54-6442-4ca0-81dc-15ad88e815a0 tempest-GroupsV314Test-1799081870 None] Creating offline snapshot a3910b11-6658-4ea1-907c-93e1bbe2452a of volume 81bc4be0-42e0-442a-90d0-81c4ad65a01d {{(pid=93468) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 29 03:28:50 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-5b287b52-4908-48de-b59b-45d471e7203c tempest-VolumesDeleteCascade-818251270 None] Volume volume-f1784a2d-590d-4c7d-8d00-dac1bc356114 (f1784a2d-590d-4c7d-8d00-dac1bc356114): created successfully Jun 29 03:28:50 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-5b287b52-4908-48de-b59b-45d471e7203c tempest-VolumesDeleteCascade-818251270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4966ae63-6039-437e-b00f-fe2f1e269aa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:28:50 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-5b287b52-4908-48de-b59b-45d471e7203c tempest-VolumesDeleteCascade-818251270 None] Flow 'volume_create_manager' (26897758-13e4-4866-a380-a01a97c7afa1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:28:50 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[6acfddd5-7c0d-4a9b-b7a4-26d6aa30dc72]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:28:50 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2d198e54-6442-4ca0-81dc-15ad88e815a0 tempest-GroupsV314Test-1799081870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-81bc4be0-42e0-442a-90d0-81c4ad65a01d {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:28:50 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-5b287b52-4908-48de-b59b-45d471e7203c tempest-VolumesDeleteCascade-818251270 None] Created volume successfully. Jun 29 03:28:50 devstack sudo[102625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-81bc4be0-42e0-442a-90d0-81c4ad65a01d Jun 29 03:28:50 devstack sudo[102625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:28:51 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-d523ef16-15a8-4d41-b87a-b0000df6ecbe tempest-VolumesDeleteCascade-818251270 None] Acquiring lock "cinder-a7808737-749f-48ea-985b-c5c48f382013-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:28:51 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-d523ef16-15a8-4d41-b87a-b0000df6ecbe tempest-VolumesDeleteCascade-818251270 None] Lock "cinder-a7808737-749f-48ea-985b-c5c48f382013-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:28:51 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-d523ef16-15a8-4d41-b87a-b0000df6ecbe tempest-VolumesDeleteCascade-818251270 None] Performing cascade delete. {{(pid=93468) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jun 29 03:28:51 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-d523ef16-15a8-4d41-b87a-b0000df6ecbe tempest-VolumesDeleteCascade-818251270 None] Acquiring lock "cinder-0af8b4cc-ff62-4af5-9a8d-bdc7ec87318c-delete_snapshot" by "delete_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:28:51 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-d523ef16-15a8-4d41-b87a-b0000df6ecbe tempest-VolumesDeleteCascade-818251270 None] Lock "cinder-0af8b4cc-ff62-4af5-9a8d-bdc7ec87318c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:28:51 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-d523ef16-15a8-4d41-b87a-b0000df6ecbe tempest-VolumesDeleteCascade-818251270 None] Acquiring lock "cinder-quobyte-a7808737-749f-48ea-985b-c5c48f382013" by "delete_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:28:51 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-d523ef16-15a8-4d41-b87a-b0000df6ecbe tempest-VolumesDeleteCascade-818251270 None] Lock "cinder-quobyte-a7808737-749f-48ea-985b-c5c48f382013" acquired by "delete_snapshot" :: waited 0.014s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:28:51 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-d523ef16-15a8-4d41-b87a-b0000df6ecbe tempest-VolumesDeleteCascade-818251270 None] Acquiring lock "cinder-quobyte-0af8b4cc-ff62-4af5-9a8d-bdc7ec87318c" by "_delete_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:28:51 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-d523ef16-15a8-4d41-b87a-b0000df6ecbe tempest-VolumesDeleteCascade-818251270 None] Lock "cinder-quobyte-0af8b4cc-ff62-4af5-9a8d-bdc7ec87318c" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:28:51 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-d523ef16-15a8-4d41-b87a-b0000df6ecbe tempest-VolumesDeleteCascade-818251270 None] Deleting offline snapshot 0af8b4cc-ff62-4af5-9a8d-bdc7ec87318c of volume a7808737-749f-48ea-985b-c5c48f382013 {{(pid=93468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 29 03:28:51 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-d523ef16-15a8-4d41-b87a-b0000df6ecbe tempest-VolumesDeleteCascade-818251270 None] snapshot_file for this snap is: volume-a7808737-749f-48ea-985b-c5c48f382013.0af8b4cc-ff62-4af5-9a8d-bdc7ec87318c {{(pid=93468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 29 03:28:51 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[4becff36-ca04-4de8-80d5-ddb52d659c83]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:28:51 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d523ef16-15a8-4d41-b87a-b0000df6ecbe tempest-VolumesDeleteCascade-818251270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-a7808737-749f-48ea-985b-c5c48f382013.0af8b4cc-ff62-4af5-9a8d-bdc7ec87318c {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:28:51 devstack sudo[102628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-a7808737-749f-48ea-985b-c5c48f382013.0af8b4cc-ff62-4af5-9a8d-bdc7ec87318c Jun 29 03:28:51 devstack sudo[102628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:28:51 devstack sudo[102625]: pam_unix(sudo:session): session closed for user root Jun 29 03:28:51 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2d198e54-6442-4ca0-81dc-15ad88e815a0 tempest-GroupsV314Test-1799081870 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-81bc4be0-42e0-442a-90d0-81c4ad65a01d" returned: 0 in 0.789s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:28:51 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2d198e54-6442-4ca0-81dc-15ad88e815a0 tempest-GroupsV314Test-1799081870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-81bc4be0-42e0-442a-90d0-81c4ad65a01d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-81bc4be0-42e0-442a-90d0-81c4ad65a01d.a3910b11-6658-4ea1-907c-93e1bbe2452a 1G {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:28:51 devstack sudo[102633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-81bc4be0-42e0-442a-90d0-81c4ad65a01d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-81bc4be0-42e0-442a-90d0-81c4ad65a01d.a3910b11-6658-4ea1-907c-93e1bbe2452a 1G Jun 29 03:28:51 devstack sudo[102633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:28:52 devstack sudo[102628]: pam_unix(sudo:session): session closed for user root Jun 29 03:28:52 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d523ef16-15a8-4d41-b87a-b0000df6ecbe tempest-VolumesDeleteCascade-818251270 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-a7808737-749f-48ea-985b-c5c48f382013.0af8b4cc-ff62-4af5-9a8d-bdc7ec87318c" returned: 0 in 0.822s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:28:52 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-d523ef16-15a8-4d41-b87a-b0000df6ecbe tempest-VolumesDeleteCascade-818251270 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a7808737-749f-48ea-985b-c5c48f382013(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93468) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 29 03:28:52 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[56d79423-0386-4cc3-8e90-7283afe31c7b]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:28:52 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d523ef16-15a8-4d41-b87a-b0000df6ecbe tempest-VolumesDeleteCascade-818251270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-a7808737-749f-48ea-985b-c5c48f382013 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:28:52 devstack sudo[102641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-a7808737-749f-48ea-985b-c5c48f382013 Jun 29 03:28:52 devstack sudo[102641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:28:52 devstack sudo[102633]: pam_unix(sudo:session): session closed for user root Jun 29 03:28:52 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2d198e54-6442-4ca0-81dc-15ad88e815a0 tempest-GroupsV314Test-1799081870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-81bc4be0-42e0-442a-90d0-81c4ad65a01d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-81bc4be0-42e0-442a-90d0-81c4ad65a01d.a3910b11-6658-4ea1-907c-93e1bbe2452a 1G" returned: 0 in 0.976s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:28:52 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2d198e54-6442-4ca0-81dc-15ad88e815a0 tempest-GroupsV314Test-1799081870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-81bc4be0-42e0-442a-90d0-81c4ad65a01d -F qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-81bc4be0-42e0-442a-90d0-81c4ad65a01d.a3910b11-6658-4ea1-907c-93e1bbe2452a {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:28:52 devstack sudo[102643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-81bc4be0-42e0-442a-90d0-81c4ad65a01d -F qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-81bc4be0-42e0-442a-90d0-81c4ad65a01d.a3910b11-6658-4ea1-907c-93e1bbe2452a Jun 29 03:28:52 devstack sudo[102643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:28:53 devstack sudo[102641]: pam_unix(sudo:session): session closed for user root Jun 29 03:28:53 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d523ef16-15a8-4d41-b87a-b0000df6ecbe tempest-VolumesDeleteCascade-818251270 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-a7808737-749f-48ea-985b-c5c48f382013" returned: 0 in 0.866s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:28:53 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d523ef16-15a8-4d41-b87a-b0000df6ecbe tempest-VolumesDeleteCascade-818251270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-a7808737-749f-48ea-985b-c5c48f382013.0af8b4cc-ff62-4af5-9a8d-bdc7ec87318c {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:28:53 devstack sudo[102648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-a7808737-749f-48ea-985b-c5c48f382013.0af8b4cc-ff62-4af5-9a8d-bdc7ec87318c Jun 29 03:28:53 devstack sudo[102648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:28:53 devstack sudo[102643]: pam_unix(sudo:session): session closed for user root Jun 29 03:28:53 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2d198e54-6442-4ca0-81dc-15ad88e815a0 tempest-GroupsV314Test-1799081870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-81bc4be0-42e0-442a-90d0-81c4ad65a01d -F qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-81bc4be0-42e0-442a-90d0-81c4ad65a01d.a3910b11-6658-4ea1-907c-93e1bbe2452a" returned: 0 in 0.815s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:28:53 devstack cinder-volume[93468]: WARNING cinder.volume.drivers.remotefs [None req-2d198e54-6442-4ca0-81dc-15ad88e815a0 tempest-GroupsV314Test-1799081870 None] /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-81bc4be0-42e0-442a-90d0-81c4ad65a01d.a3910b11-6658-4ea1-907c-93e1bbe2452a is being set with open permissions: ugo+rw: NotImplementedError Jun 29 03:28:53 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2d198e54-6442-4ca0-81dc-15ad88e815a0 tempest-GroupsV314Test-1799081870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-81bc4be0-42e0-442a-90d0-81c4ad65a01d.a3910b11-6658-4ea1-907c-93e1bbe2452a {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:28:53 devstack sudo[102653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-81bc4be0-42e0-442a-90d0-81c4ad65a01d.a3910b11-6658-4ea1-907c-93e1bbe2452a Jun 29 03:28:53 devstack sudo[102653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:28:54 devstack sudo[102648]: pam_unix(sudo:session): session closed for user root Jun 29 03:28:54 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d523ef16-15a8-4d41-b87a-b0000df6ecbe tempest-VolumesDeleteCascade-818251270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-a7808737-749f-48ea-985b-c5c48f382013.0af8b4cc-ff62-4af5-9a8d-bdc7ec87318c" returned: 0 in 0.913s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:28:54 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d523ef16-15a8-4d41-b87a-b0000df6ecbe tempest-VolumesDeleteCascade-818251270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-a7808737-749f-48ea-985b-c5c48f382013.0af8b4cc-ff62-4af5-9a8d-bdc7ec87318c {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:28:54 devstack sudo[102659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-a7808737-749f-48ea-985b-c5c48f382013.0af8b4cc-ff62-4af5-9a8d-bdc7ec87318c Jun 29 03:28:54 devstack sudo[102659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:28:54 devstack sudo[102653]: pam_unix(sudo:session): session closed for user root Jun 29 03:28:54 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2d198e54-6442-4ca0-81dc-15ad88e815a0 tempest-GroupsV314Test-1799081870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-81bc4be0-42e0-442a-90d0-81c4ad65a01d.a3910b11-6658-4ea1-907c-93e1bbe2452a" returned: 0 in 0.747s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:28:54 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2d198e54-6442-4ca0-81dc-15ad88e815a0 tempest-GroupsV314Test-1799081870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-81bc4be0-42e0-442a-90d0-81c4ad65a01d.info {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:28:54 devstack sudo[102661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-81bc4be0-42e0-442a-90d0-81c4ad65a01d.info Jun 29 03:28:54 devstack sudo[102661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:28:54 devstack sudo[102659]: pam_unix(sudo:session): session closed for user root Jun 29 03:28:54 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d523ef16-15a8-4d41-b87a-b0000df6ecbe tempest-VolumesDeleteCascade-818251270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-a7808737-749f-48ea-985b-c5c48f382013.0af8b4cc-ff62-4af5-9a8d-bdc7ec87318c" returned: 0 in 0.718s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:28:54 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-d523ef16-15a8-4d41-b87a-b0000df6ecbe tempest-VolumesDeleteCascade-818251270 None] Lock "cinder-quobyte-0af8b4cc-ff62-4af5-9a8d-bdc7ec87318c" released by "_delete_snapshot" :: held 3.438s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:28:54 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-d523ef16-15a8-4d41-b87a-b0000df6ecbe tempest-VolumesDeleteCascade-818251270 None] Lock "cinder-quobyte-a7808737-749f-48ea-985b-c5c48f382013" released by "delete_snapshot" :: held 3.478s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:28:54 devstack sudo[102661]: pam_unix(sudo:session): session closed for user root Jun 29 03:28:54 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2d198e54-6442-4ca0-81dc-15ad88e815a0 tempest-GroupsV314Test-1799081870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-81bc4be0-42e0-442a-90d0-81c4ad65a01d.info" returned: 0 in 0.681s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:28:54 devstack cinder-volume[93468]: WARNING cinder.volume.drivers.remotefs [None req-2d198e54-6442-4ca0-81dc-15ad88e815a0 tempest-GroupsV314Test-1799081870 None] /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-81bc4be0-42e0-442a-90d0-81c4ad65a01d.info is being set with open permissions: ugo+rw: NotImplementedError Jun 29 03:28:54 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2d198e54-6442-4ca0-81dc-15ad88e815a0 tempest-GroupsV314Test-1799081870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-81bc4be0-42e0-442a-90d0-81c4ad65a01d.info {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:28:54 devstack sudo[102665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-81bc4be0-42e0-442a-90d0-81c4ad65a01d.info Jun 29 03:28:54 devstack sudo[102665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:28:55 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-d523ef16-15a8-4d41-b87a-b0000df6ecbe tempest-VolumesDeleteCascade-818251270 None] Created reservations ['3ade43cd-70b8-4768-bcfb-2d972eaf7cbb', 'ed385a7f-005e-4733-89b0-772e1e4288cd', '2b4ad5b8-7e6a-414b-8581-8a0e0bb14e3b', '73afd25a-227a-4f1e-ab8a-7d54076b5aac'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:28:55 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-d523ef16-15a8-4d41-b87a-b0000df6ecbe tempest-VolumesDeleteCascade-818251270 None] Delete snapshot completed successfully. Jun 29 03:28:55 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-d523ef16-15a8-4d41-b87a-b0000df6ecbe tempest-VolumesDeleteCascade-818251270 None] Lock "cinder-0af8b4cc-ff62-4af5-9a8d-bdc7ec87318c-delete_snapshot" released by "delete_snapshot" :: held 3.726s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:28:55 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-d523ef16-15a8-4d41-b87a-b0000df6ecbe tempest-VolumesDeleteCascade-818251270 None] Snapshots deleted, issuing volume delete {{(pid=93468) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jun 29 03:28:55 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-d523ef16-15a8-4d41-b87a-b0000df6ecbe tempest-VolumesDeleteCascade-818251270 None] Acquiring lock "cinder-quobyte-a7808737-749f-48ea-985b-c5c48f382013" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:28:55 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-d523ef16-15a8-4d41-b87a-b0000df6ecbe tempest-VolumesDeleteCascade-818251270 None] Lock "cinder-quobyte-a7808737-749f-48ea-985b-c5c48f382013" acquired by "delete_volume" :: waited 0.018s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:28:55 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a7792f7-8cb2-4afb-9b2b-7a0dc58b1001]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:28:55 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d523ef16-15a8-4d41-b87a-b0000df6ecbe tempest-VolumesDeleteCascade-818251270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-a7808737-749f-48ea-985b-c5c48f382013 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:28:55 devstack sudo[102667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-a7808737-749f-48ea-985b-c5c48f382013 Jun 29 03:28:55 devstack sudo[102667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:28:55 devstack sudo[102665]: pam_unix(sudo:session): session closed for user root Jun 29 03:28:55 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2d198e54-6442-4ca0-81dc-15ad88e815a0 tempest-GroupsV314Test-1799081870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-81bc4be0-42e0-442a-90d0-81c4ad65a01d.info" returned: 0 in 0.900s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:28:55 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-2d198e54-6442-4ca0-81dc-15ad88e815a0 tempest-GroupsV314Test-1799081870 None] Acquiring lock "cinder-quobyte-55ff3e1a-6b5f-4dfd-8134-f9f95b4ce4e8" by "_copy_volume_from_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:28:55 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-2d198e54-6442-4ca0-81dc-15ad88e815a0 tempest-GroupsV314Test-1799081870 None] Lock "cinder-quobyte-55ff3e1a-6b5f-4dfd-8134-f9f95b4ce4e8" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:28:55 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-2d198e54-6442-4ca0-81dc-15ad88e815a0 tempest-GroupsV314Test-1799081870 None] snapshot: a3910b11-6658-4ea1-907c-93e1bbe2452a, volume: 55ff3e1a-6b5f-4dfd-8134-f9f95b4ce4e8, {{(pid=93468) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 29 03:28:55 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-2d198e54-6442-4ca0-81dc-15ad88e815a0 tempest-GroupsV314Test-1799081870 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:28:55 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-2d198e54-6442-4ca0-81dc-15ad88e815a0 tempest-GroupsV314Test-1799081870 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:28:55 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-2d198e54-6442-4ca0-81dc-15ad88e815a0 tempest-GroupsV314Test-1799081870 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:28:55 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-2d198e54-6442-4ca0-81dc-15ad88e815a0 tempest-GroupsV314Test-1799081870 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:28:55 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-2d198e54-6442-4ca0-81dc-15ad88e815a0 tempest-GroupsV314Test-1799081870 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:28:55 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[2519e56c-8ba2-4aed-8fc9-df7d54771e3f]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:28:55 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2d198e54-6442-4ca0-81dc-15ad88e815a0 tempest-GroupsV314Test-1799081870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-81bc4be0-42e0-442a-90d0-81c4ad65a01d.a3910b11-6658-4ea1-907c-93e1bbe2452a {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:28:56 devstack sudo[102671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-81bc4be0-42e0-442a-90d0-81c4ad65a01d.a3910b11-6658-4ea1-907c-93e1bbe2452a Jun 29 03:28:56 devstack sudo[102671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:28:56 devstack sudo[102667]: pam_unix(sudo:session): session closed for user root Jun 29 03:28:56 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d523ef16-15a8-4d41-b87a-b0000df6ecbe tempest-VolumesDeleteCascade-818251270 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-a7808737-749f-48ea-985b-c5c48f382013" returned: 0 in 0.985s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:28:56 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d523ef16-15a8-4d41-b87a-b0000df6ecbe tempest-VolumesDeleteCascade-818251270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-a7808737-749f-48ea-985b-c5c48f382013 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:28:56 devstack sudo[102675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-a7808737-749f-48ea-985b-c5c48f382013 Jun 29 03:28:56 devstack sudo[102675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:28:56 devstack sudo[102671]: pam_unix(sudo:session): session closed for user root Jun 29 03:28:56 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2d198e54-6442-4ca0-81dc-15ad88e815a0 tempest-GroupsV314Test-1799081870 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-81bc4be0-42e0-442a-90d0-81c4ad65a01d.a3910b11-6658-4ea1-907c-93e1bbe2452a" returned: 0 in 0.915s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:28:56 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-2d198e54-6442-4ca0-81dc-15ad88e815a0 tempest-GroupsV314Test-1799081870 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-81bc4be0-42e0-442a-90d0-81c4ad65a01d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93468) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 29 03:28:56 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-2d198e54-6442-4ca0-81dc-15ad88e815a0 tempest-GroupsV314Test-1799081870 None] will copy from snapshot at /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-81bc4be0-42e0-442a-90d0-81c4ad65a01d {{(pid=93468) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 29 03:28:56 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-2d198e54-6442-4ca0-81dc-15ad88e815a0 tempest-GroupsV314Test-1799081870 None] Creating direct copy from snapshot {{(pid=93468) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 29 03:28:56 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7d12bac-7a7d-4724-aa5e-3e2d2c5a5dae]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:28:56 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2d198e54-6442-4ca0-81dc-15ad88e815a0 tempest-GroupsV314Test-1799081870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-81bc4be0-42e0-442a-90d0-81c4ad65a01d {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:28:56 devstack sudo[102675]: pam_unix(sudo:session): session closed for user root Jun 29 03:28:56 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d523ef16-15a8-4d41-b87a-b0000df6ecbe tempest-VolumesDeleteCascade-818251270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-a7808737-749f-48ea-985b-c5c48f382013" returned: 0 in 0.830s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:28:57 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-d523ef16-15a8-4d41-b87a-b0000df6ecbe tempest-VolumesDeleteCascade-818251270 None] Lock "cinder-quobyte-a7808737-749f-48ea-985b-c5c48f382013" released by "delete_volume" :: held 1.897s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:28:57 devstack sudo[102681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-81bc4be0-42e0-442a-90d0-81c4ad65a01d Jun 29 03:28:57 devstack sudo[102681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:28:57 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-d523ef16-15a8-4d41-b87a-b0000df6ecbe tempest-VolumesDeleteCascade-818251270 None] Created reservations ['05f66408-ea6e-44dc-9c52-e8631d540228', '2a9b57a0-6c58-4e2e-9fed-bf6dc3bf38a7', 'c9c76219-14a1-483e-b66b-a0c6bf3ad217', 'cf71b024-0054-4b22-90a4-8675f895126c'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:28:57 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-d523ef16-15a8-4d41-b87a-b0000df6ecbe tempest-VolumesDeleteCascade-818251270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:28:57 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-d523ef16-15a8-4d41-b87a-b0000df6ecbe tempest-VolumesDeleteCascade-818251270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:28:57 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-d523ef16-15a8-4d41-b87a-b0000df6ecbe tempest-VolumesDeleteCascade-818251270 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:28:57 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-d523ef16-15a8-4d41-b87a-b0000df6ecbe tempest-VolumesDeleteCascade-818251270 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:28:57 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-d523ef16-15a8-4d41-b87a-b0000df6ecbe tempest-VolumesDeleteCascade-818251270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:28:57 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d523ef16-15a8-4d41-b87a-b0000df6ecbe tempest-VolumesDeleteCascade-818251270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:28:57 devstack sudo[102683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf Jun 29 03:28:57 devstack sudo[102683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:28:57 devstack sudo[102681]: pam_unix(sudo:session): session closed for user root Jun 29 03:28:57 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2d198e54-6442-4ca0-81dc-15ad88e815a0 tempest-GroupsV314Test-1799081870 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-81bc4be0-42e0-442a-90d0-81c4ad65a01d" returned: 0 in 1.011s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:28:57 devstack cinder-volume[93468]: DEBUG cinder.utils [None req-2d198e54-6442-4ca0-81dc-15ad88e815a0 tempest-GroupsV314Test-1799081870 None] Path /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-55ff3e1a-6b5f-4dfd-8134-f9f95b4ce4e8 not found in is_blk_device check {{(pid=93468) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 29 03:28:57 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2d198e54-6442-4ca0-81dc-15ad88e815a0 tempest-GroupsV314Test-1799081870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-81bc4be0-42e0-442a-90d0-81c4ad65a01d /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-55ff3e1a-6b5f-4dfd-8134-f9f95b4ce4e8 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:28:57 devstack sudo[102689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-81bc4be0-42e0-442a-90d0-81c4ad65a01d /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-55ff3e1a-6b5f-4dfd-8134-f9f95b4ce4e8 Jun 29 03:28:57 devstack sudo[102689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:28:58 devstack sudo[102683]: pam_unix(sudo:session): session closed for user root Jun 29 03:28:58 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d523ef16-15a8-4d41-b87a-b0000df6ecbe tempest-VolumesDeleteCascade-818251270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf" returned: 0 in 0.925s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:28:58 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-d523ef16-15a8-4d41-b87a-b0000df6ecbe tempest-VolumesDeleteCascade-818251270 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:28:58 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-d523ef16-15a8-4d41-b87a-b0000df6ecbe tempest-VolumesDeleteCascade-818251270 None] Deleted volume successfully. Jun 29 03:28:58 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-d523ef16-15a8-4d41-b87a-b0000df6ecbe tempest-VolumesDeleteCascade-818251270 None] Lock "cinder-a7808737-749f-48ea-985b-c5c48f382013-delete_volume" released by "delete_volume" :: held 6.835s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:28:58 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-e96bd56d-1190-4695-aace-00e3b0e94b13 tempest-VolumesDeleteCascade-818251270 None] Acquiring lock "cinder-f1784a2d-590d-4c7d-8d00-dac1bc356114-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:28:58 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-e96bd56d-1190-4695-aace-00e3b0e94b13 tempest-VolumesDeleteCascade-818251270 None] Lock "cinder-f1784a2d-590d-4c7d-8d00-dac1bc356114-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:28:58 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-e96bd56d-1190-4695-aace-00e3b0e94b13 tempest-VolumesDeleteCascade-818251270 None] Acquiring lock "cinder-quobyte-f1784a2d-590d-4c7d-8d00-dac1bc356114" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:28:58 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-e96bd56d-1190-4695-aace-00e3b0e94b13 tempest-VolumesDeleteCascade-818251270 None] Lock "cinder-quobyte-f1784a2d-590d-4c7d-8d00-dac1bc356114" acquired by "delete_volume" :: waited 0.028s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:28:58 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd7d9842-7bd9-4444-a1d8-18d07728d46e]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:28:58 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-e96bd56d-1190-4695-aace-00e3b0e94b13 tempest-VolumesDeleteCascade-818251270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-f1784a2d-590d-4c7d-8d00-dac1bc356114 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:28:58 devstack sudo[102692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-f1784a2d-590d-4c7d-8d00-dac1bc356114 Jun 29 03:28:58 devstack sudo[102692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:28:59 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-f29a59ad-3db8-40e1-a64f-a80c388d7b5b tempest-VolumeQuotasAdminTestJSON-332964430 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:28:59 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-f29a59ad-3db8-40e1-a64f-a80c388d7b5b tempest-VolumeQuotasAdminTestJSON-332964430 None] Flow 'volume_create_manager' (5e163d50-2333-46f5-a262-49bb641ec798) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:28:59 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-f29a59ad-3db8-40e1-a64f-a80c388d7b5b tempest-VolumeQuotasAdminTestJSON-332964430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cf2082f-304c-4bab-a466-05d42e9b4f36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:28:59 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-f29a59ad-3db8-40e1-a64f-a80c388d7b5b tempest-VolumeQuotasAdminTestJSON-332964430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cf2082f-304c-4bab-a466-05d42e9b4f36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:28:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-101599835',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfa86a7e-e284-42ac-af1e-81c901fba770,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63d9464d9bf44be6a60548edceb6b662',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:28:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:28:59Z,use_quota=True,user_id='b33977bb92194b7f90babb123601093c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:28:59 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-f29a59ad-3db8-40e1-a64f-a80c388d7b5b tempest-VolumeQuotasAdminTestJSON-332964430 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (196d68e7-0d9f-4517-b74c-54c2822f97dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:28:59 devstack sudo[102692]: pam_unix(sudo:session): session closed for user root Jun 29 03:28:59 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-f29a59ad-3db8-40e1-a64f-a80c388d7b5b tempest-VolumeQuotasAdminTestJSON-332964430 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (196d68e7-0d9f-4517-b74c-54c2822f97dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:28:59 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-f29a59ad-3db8-40e1-a64f-a80c388d7b5b tempest-VolumeQuotasAdminTestJSON-332964430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efbc9a14-fff7-45bf-84ce-7d2eeef3b0eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:28:59 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-f29a59ad-3db8-40e1-a64f-a80c388d7b5b tempest-VolumeQuotasAdminTestJSON-332964430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efbc9a14-fff7-45bf-84ce-7d2eeef3b0eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dfa86a7e-e284-42ac-af1e-81c901fba770', 'volume_name': 'volume-dfa86a7e-e284-42ac-af1e-81c901fba770', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:28:59 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-f29a59ad-3db8-40e1-a64f-a80c388d7b5b tempest-VolumeQuotasAdminTestJSON-332964430 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (153480eb-1ea0-4dd8-b4d1-a0b06f2a3d43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:28:59 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-f29a59ad-3db8-40e1-a64f-a80c388d7b5b tempest-VolumeQuotasAdminTestJSON-332964430 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (153480eb-1ea0-4dd8-b4d1-a0b06f2a3d43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:28:59 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-f29a59ad-3db8-40e1-a64f-a80c388d7b5b tempest-VolumeQuotasAdminTestJSON-332964430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10de2ad6-bd86-42a6-8be0-615e0e9f7d24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:28:59 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-f29a59ad-3db8-40e1-a64f-a80c388d7b5b tempest-VolumeQuotasAdminTestJSON-332964430 None] Volume dfa86a7e-e284-42ac-af1e-81c901fba770: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dfa86a7e-e284-42ac-af1e-81c901fba770', 'volume_size': 1} Jun 29 03:28:59 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-f29a59ad-3db8-40e1-a64f-a80c388d7b5b tempest-VolumeQuotasAdminTestJSON-332964430 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:28:59 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-e96bd56d-1190-4695-aace-00e3b0e94b13 tempest-VolumesDeleteCascade-818251270 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-f1784a2d-590d-4c7d-8d00-dac1bc356114" returned: 0 in 1.472s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:28:59 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-e96bd56d-1190-4695-aace-00e3b0e94b13 tempest-VolumesDeleteCascade-818251270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-f1784a2d-590d-4c7d-8d00-dac1bc356114 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:28:59 devstack sudo[102714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-f1784a2d-590d-4c7d-8d00-dac1bc356114 Jun 29 03:28:59 devstack sudo[102714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:29:00 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-c785d3e2-e708-47ec-91d9-0c9db8b46207 tempest-AttachVolumeTestJSON-872616700 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:29:00 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-c785d3e2-e708-47ec-91d9-0c9db8b46207 tempest-AttachVolumeTestJSON-872616700 None] Flow 'volume_create_manager' (011b3457-e7e1-49b4-9181-436db20a83f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:29:00 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-c785d3e2-e708-47ec-91d9-0c9db8b46207 tempest-AttachVolumeTestJSON-872616700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9babf36-b31f-4589-8d2b-ceef9a69506d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:29:00 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-c785d3e2-e708-47ec-91d9-0c9db8b46207 tempest-AttachVolumeTestJSON-872616700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9babf36-b31f-4589-8d2b-ceef9a69506d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:29:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-309652870',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12adcf13-1f15-44ad-a1b7-8385c5fe549d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6bf1b94df6c4485d87b2b2758c1476cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:29:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:29:00Z,use_quota=True,user_id='6fcdf128706544418b67f38090f52540',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:29:00 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-c785d3e2-e708-47ec-91d9-0c9db8b46207 tempest-AttachVolumeTestJSON-872616700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecbd1c87-db38-443c-a367-4c4dabe1c064) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:29:00 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-c785d3e2-e708-47ec-91d9-0c9db8b46207 tempest-AttachVolumeTestJSON-872616700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecbd1c87-db38-443c-a367-4c4dabe1c064) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:29:00 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-c785d3e2-e708-47ec-91d9-0c9db8b46207 tempest-AttachVolumeTestJSON-872616700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f52c6fa1-4438-4ff7-aba8-c8f6c6ea735e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:29:00 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-c785d3e2-e708-47ec-91d9-0c9db8b46207 tempest-AttachVolumeTestJSON-872616700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f52c6fa1-4438-4ff7-aba8-c8f6c6ea735e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '12adcf13-1f15-44ad-a1b7-8385c5fe549d', 'volume_name': 'volume-12adcf13-1f15-44ad-a1b7-8385c5fe549d', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:29:00 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-c785d3e2-e708-47ec-91d9-0c9db8b46207 tempest-AttachVolumeTestJSON-872616700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e32b808-43ad-43e7-900a-fb2b65ede246) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:29:00 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-c785d3e2-e708-47ec-91d9-0c9db8b46207 tempest-AttachVolumeTestJSON-872616700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e32b808-43ad-43e7-900a-fb2b65ede246) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:29:00 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-c785d3e2-e708-47ec-91d9-0c9db8b46207 tempest-AttachVolumeTestJSON-872616700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b569ca6c-9aa1-4f72-878b-a61b5ac7e11e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:29:00 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-c785d3e2-e708-47ec-91d9-0c9db8b46207 tempest-AttachVolumeTestJSON-872616700 None] Volume 12adcf13-1f15-44ad-a1b7-8385c5fe549d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-12adcf13-1f15-44ad-a1b7-8385c5fe549d', 'volume_size': 1} Jun 29 03:29:00 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-c785d3e2-e708-47ec-91d9-0c9db8b46207 tempest-AttachVolumeTestJSON-872616700 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:29:01 devstack sudo[102714]: pam_unix(sudo:session): session closed for user root Jun 29 03:29:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-e96bd56d-1190-4695-aace-00e3b0e94b13 tempest-VolumesDeleteCascade-818251270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-f1784a2d-590d-4c7d-8d00-dac1bc356114" returned: 0 in 1.359s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:29:01 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-e96bd56d-1190-4695-aace-00e3b0e94b13 tempest-VolumesDeleteCascade-818251270 None] Lock "cinder-quobyte-f1784a2d-590d-4c7d-8d00-dac1bc356114" released by "delete_volume" :: held 2.906s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:29:01 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-e96bd56d-1190-4695-aace-00e3b0e94b13 tempest-VolumesDeleteCascade-818251270 None] Created reservations ['070454cc-c5d0-4720-ac62-9798ea938115', 'b1c0e1ed-a4b3-4c96-b480-8b02d73b9d1b', '3eb26e1b-994d-4f7b-bbea-264ee55fd16c', 'ea1cb08d-85f6-478a-afff-6089fd1bb83b'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:29:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-e96bd56d-1190-4695-aace-00e3b0e94b13 tempest-VolumesDeleteCascade-818251270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:29:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-e96bd56d-1190-4695-aace-00e3b0e94b13 tempest-VolumesDeleteCascade-818251270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:29:01 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-e96bd56d-1190-4695-aace-00e3b0e94b13 tempest-VolumesDeleteCascade-818251270 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:29:01 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-e96bd56d-1190-4695-aace-00e3b0e94b13 tempest-VolumesDeleteCascade-818251270 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:29:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-e96bd56d-1190-4695-aace-00e3b0e94b13 tempest-VolumesDeleteCascade-818251270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:29:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-e96bd56d-1190-4695-aace-00e3b0e94b13 tempest-VolumesDeleteCascade-818251270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:29:01 devstack sudo[102719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf Jun 29 03:29:01 devstack sudo[102719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:29:03 devstack sudo[102719]: pam_unix(sudo:session): session closed for user root Jun 29 03:29:03 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-e96bd56d-1190-4695-aace-00e3b0e94b13 tempest-VolumesDeleteCascade-818251270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf" returned: 0 in 2.462s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:29:03 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-e96bd56d-1190-4695-aace-00e3b0e94b13 tempest-VolumesDeleteCascade-818251270 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:29:03 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-e96bd56d-1190-4695-aace-00e3b0e94b13 tempest-VolumesDeleteCascade-818251270 None] Deleted volume successfully. Jun 29 03:29:04 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-e96bd56d-1190-4695-aace-00e3b0e94b13 tempest-VolumesDeleteCascade-818251270 None] Lock "cinder-f1784a2d-590d-4c7d-8d00-dac1bc356114-delete_volume" released by "delete_volume" :: held 5.809s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:29:04 devstack sudo[102689]: pam_unix(sudo:session): session closed for user root Jun 29 03:29:04 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2d198e54-6442-4ca0-81dc-15ad88e815a0 tempest-GroupsV314Test-1799081870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-81bc4be0-42e0-442a-90d0-81c4ad65a01d /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-55ff3e1a-6b5f-4dfd-8134-f9f95b4ce4e8" returned: 0 in 6.273s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:29:04 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[93de6471-642c-4f22-9f26-391261a552e8]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:29:04 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2d198e54-6442-4ca0-81dc-15ad88e815a0 tempest-GroupsV314Test-1799081870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-81bc4be0-42e0-442a-90d0-81c4ad65a01d {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:29:04 devstack sudo[102722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-81bc4be0-42e0-442a-90d0-81c4ad65a01d Jun 29 03:29:04 devstack sudo[102722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:29:05 devstack sudo[102722]: pam_unix(sudo:session): session closed for user root Jun 29 03:29:05 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2d198e54-6442-4ca0-81dc-15ad88e815a0 tempest-GroupsV314Test-1799081870 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-81bc4be0-42e0-442a-90d0-81c4ad65a01d" returned: 0 in 0.960s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:29:05 devstack cinder-volume[93468]: DEBUG cinder.image.image_utils [None req-2d198e54-6442-4ca0-81dc-15ad88e815a0 tempest-GroupsV314Test-1799081870 None] Image conversion details: src /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-81bc4be0-42e0-442a-90d0-81c4ad65a01d, size 1024.00 MB, duration 6.27 sec, destination /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-55ff3e1a-6b5f-4dfd-8134-f9f95b4ce4e8 {{(pid=93468) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 29 03:29:05 devstack cinder-volume[93468]: INFO cinder.image.image_utils [None req-2d198e54-6442-4ca0-81dc-15ad88e815a0 tempest-GroupsV314Test-1799081870 None] Converted 1024.00 MB image at 163.22 MB/s Jun 29 03:29:05 devstack cinder-volume[93468]: WARNING cinder.volume.drivers.remotefs [None req-2d198e54-6442-4ca0-81dc-15ad88e815a0 tempest-GroupsV314Test-1799081870 None] /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-55ff3e1a-6b5f-4dfd-8134-f9f95b4ce4e8 is being set with open permissions: ugo+rw: NotImplementedError Jun 29 03:29:05 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2d198e54-6442-4ca0-81dc-15ad88e815a0 tempest-GroupsV314Test-1799081870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-55ff3e1a-6b5f-4dfd-8134-f9f95b4ce4e8 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:29:05 devstack sudo[102728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-55ff3e1a-6b5f-4dfd-8134-f9f95b4ce4e8 Jun 29 03:29:05 devstack sudo[102728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:29:05 devstack sudo[102728]: pam_unix(sudo:session): session closed for user root Jun 29 03:29:05 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2d198e54-6442-4ca0-81dc-15ad88e815a0 tempest-GroupsV314Test-1799081870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-55ff3e1a-6b5f-4dfd-8134-f9f95b4ce4e8" returned: 0 in 0.673s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:29:05 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-2d198e54-6442-4ca0-81dc-15ad88e815a0 tempest-GroupsV314Test-1799081870 None] Lock "cinder-quobyte-55ff3e1a-6b5f-4dfd-8134-f9f95b4ce4e8" released by "_copy_volume_from_snapshot" :: held 9.959s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:29:05 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-2d198e54-6442-4ca0-81dc-15ad88e815a0 tempest-GroupsV314Test-1799081870 None] Acquiring lock "cinder-quobyte-a3910b11-6658-4ea1-907c-93e1bbe2452a" by "_delete_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:29:05 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-2d198e54-6442-4ca0-81dc-15ad88e815a0 tempest-GroupsV314Test-1799081870 None] Lock "cinder-quobyte-a3910b11-6658-4ea1-907c-93e1bbe2452a" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:29:05 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-2d198e54-6442-4ca0-81dc-15ad88e815a0 tempest-GroupsV314Test-1799081870 None] Deleting offline snapshot a3910b11-6658-4ea1-907c-93e1bbe2452a of volume 81bc4be0-42e0-442a-90d0-81c4ad65a01d {{(pid=93468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 29 03:29:05 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-2d198e54-6442-4ca0-81dc-15ad88e815a0 tempest-GroupsV314Test-1799081870 None] snapshot_file for this snap is: volume-81bc4be0-42e0-442a-90d0-81c4ad65a01d.a3910b11-6658-4ea1-907c-93e1bbe2452a {{(pid=93468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 29 03:29:05 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f179e76-0791-4112-a906-4dac2c52b2a9]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:29:05 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2d198e54-6442-4ca0-81dc-15ad88e815a0 tempest-GroupsV314Test-1799081870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-81bc4be0-42e0-442a-90d0-81c4ad65a01d.a3910b11-6658-4ea1-907c-93e1bbe2452a {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:29:06 devstack sudo[102736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-81bc4be0-42e0-442a-90d0-81c4ad65a01d.a3910b11-6658-4ea1-907c-93e1bbe2452a Jun 29 03:29:06 devstack sudo[102736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:29:06 devstack sudo[102736]: pam_unix(sudo:session): session closed for user root Jun 29 03:29:06 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2d198e54-6442-4ca0-81dc-15ad88e815a0 tempest-GroupsV314Test-1799081870 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-81bc4be0-42e0-442a-90d0-81c4ad65a01d.a3910b11-6658-4ea1-907c-93e1bbe2452a" returned: 0 in 0.800s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:29:06 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-2d198e54-6442-4ca0-81dc-15ad88e815a0 tempest-GroupsV314Test-1799081870 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-81bc4be0-42e0-442a-90d0-81c4ad65a01d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93468) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 29 03:29:06 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfff07d5-85f6-43bc-b180-3f4d5127062b]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:29:06 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2d198e54-6442-4ca0-81dc-15ad88e815a0 tempest-GroupsV314Test-1799081870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-81bc4be0-42e0-442a-90d0-81c4ad65a01d {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:29:06 devstack sudo[102744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-81bc4be0-42e0-442a-90d0-81c4ad65a01d Jun 29 03:29:06 devstack sudo[102744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:29:07 devstack sudo[102744]: pam_unix(sudo:session): session closed for user root Jun 29 03:29:07 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2d198e54-6442-4ca0-81dc-15ad88e815a0 tempest-GroupsV314Test-1799081870 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-81bc4be0-42e0-442a-90d0-81c4ad65a01d" returned: 0 in 0.778s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:29:07 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2d198e54-6442-4ca0-81dc-15ad88e815a0 tempest-GroupsV314Test-1799081870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-81bc4be0-42e0-442a-90d0-81c4ad65a01d.a3910b11-6658-4ea1-907c-93e1bbe2452a {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:29:07 devstack sudo[102750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-81bc4be0-42e0-442a-90d0-81c4ad65a01d.a3910b11-6658-4ea1-907c-93e1bbe2452a Jun 29 03:29:07 devstack sudo[102750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:29:07 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-6cfb18bb-c4c7-4a0a-b258-b3728d447e6f tempest-VolumesTransfersTest-1810282051 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:29:07 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-6cfb18bb-c4c7-4a0a-b258-b3728d447e6f tempest-VolumesTransfersTest-1810282051 None] Flow 'volume_create_manager' (8aabd759-b163-4fb8-ac50-cf7a8406e902) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:29:07 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-6cfb18bb-c4c7-4a0a-b258-b3728d447e6f tempest-VolumesTransfersTest-1810282051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8e0c767-9778-463e-a79e-29ed56ce8010) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:29:08 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-6cfb18bb-c4c7-4a0a-b258-b3728d447e6f tempest-VolumesTransfersTest-1810282051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8e0c767-9778-463e-a79e-29ed56ce8010) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:29:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-344344503',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a21ea40f-7be7-4b6c-96f3-8bff8845324e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='abec7507b91b44fb90615ff8ef965451',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:29:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:29:08Z,use_quota=True,user_id='e053035204424df38502ac502cea079a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:29:08 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-6cfb18bb-c4c7-4a0a-b258-b3728d447e6f tempest-VolumesTransfersTest-1810282051 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e943736f-d40b-4009-b39d-c4af637e4da3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:29:08 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-6cfb18bb-c4c7-4a0a-b258-b3728d447e6f tempest-VolumesTransfersTest-1810282051 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e943736f-d40b-4009-b39d-c4af637e4da3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:29:08 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-6cfb18bb-c4c7-4a0a-b258-b3728d447e6f tempest-VolumesTransfersTest-1810282051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6526079e-144e-4827-8d48-f75f795dc8f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:29:08 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-6cfb18bb-c4c7-4a0a-b258-b3728d447e6f tempest-VolumesTransfersTest-1810282051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6526079e-144e-4827-8d48-f75f795dc8f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a21ea40f-7be7-4b6c-96f3-8bff8845324e', 'volume_name': 'volume-a21ea40f-7be7-4b6c-96f3-8bff8845324e', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:29:08 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-6cfb18bb-c4c7-4a0a-b258-b3728d447e6f tempest-VolumesTransfersTest-1810282051 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19ca0718-fc22-43fe-8dc8-3114d6b60c6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:29:08 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-6cfb18bb-c4c7-4a0a-b258-b3728d447e6f tempest-VolumesTransfersTest-1810282051 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19ca0718-fc22-43fe-8dc8-3114d6b60c6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:29:08 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-6cfb18bb-c4c7-4a0a-b258-b3728d447e6f tempest-VolumesTransfersTest-1810282051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6189ba0-1e5e-4fbc-873c-39b22b153b43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:29:08 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-6cfb18bb-c4c7-4a0a-b258-b3728d447e6f tempest-VolumesTransfersTest-1810282051 None] Volume a21ea40f-7be7-4b6c-96f3-8bff8845324e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a21ea40f-7be7-4b6c-96f3-8bff8845324e', 'volume_size': 1} Jun 29 03:29:08 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-6cfb18bb-c4c7-4a0a-b258-b3728d447e6f tempest-VolumesTransfersTest-1810282051 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:29:08 devstack sudo[102750]: pam_unix(sudo:session): session closed for user root Jun 29 03:29:08 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2d198e54-6442-4ca0-81dc-15ad88e815a0 tempest-GroupsV314Test-1799081870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-81bc4be0-42e0-442a-90d0-81c4ad65a01d.a3910b11-6658-4ea1-907c-93e1bbe2452a" returned: 0 in 0.737s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:29:08 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2d198e54-6442-4ca0-81dc-15ad88e815a0 tempest-GroupsV314Test-1799081870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-81bc4be0-42e0-442a-90d0-81c4ad65a01d.a3910b11-6658-4ea1-907c-93e1bbe2452a {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:29:08 devstack sudo[102755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-81bc4be0-42e0-442a-90d0-81c4ad65a01d.a3910b11-6658-4ea1-907c-93e1bbe2452a Jun 29 03:29:08 devstack sudo[102755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:29:08 devstack sudo[102755]: pam_unix(sudo:session): session closed for user root Jun 29 03:29:08 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2d198e54-6442-4ca0-81dc-15ad88e815a0 tempest-GroupsV314Test-1799081870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-81bc4be0-42e0-442a-90d0-81c4ad65a01d.a3910b11-6658-4ea1-907c-93e1bbe2452a" returned: 0 in 0.626s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:29:08 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-2d198e54-6442-4ca0-81dc-15ad88e815a0 tempest-GroupsV314Test-1799081870 None] Lock "cinder-quobyte-a3910b11-6658-4ea1-907c-93e1bbe2452a" released by "_delete_snapshot" :: held 3.071s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:29:08 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-2d198e54-6442-4ca0-81dc-15ad88e815a0 tempest-GroupsV314Test-1799081870 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 18.212s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:29:08 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-f29a59ad-3db8-40e1-a64f-a80c388d7b5b tempest-VolumeQuotasAdminTestJSON-332964430 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.155s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:29:08 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-f29a59ad-3db8-40e1-a64f-a80c388d7b5b tempest-VolumeQuotasAdminTestJSON-332964430 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:28:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-101599835',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfa86a7e-e284-42ac-af1e-81c901fba770,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63d9464d9bf44be6a60548edceb6b662',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:28:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:28:59Z,use_quota=True,user_id='b33977bb92194b7f90babb123601093c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:29:08 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-f29a59ad-3db8-40e1-a64f-a80c388d7b5b tempest-VolumeQuotasAdminTestJSON-332964430 None] Creating volume dfa86a7e-e284-42ac-af1e-81c901fba770 {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:29:08 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-f29a59ad-3db8-40e1-a64f-a80c388d7b5b tempest-VolumeQuotasAdminTestJSON-332964430 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:29:08 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-f29a59ad-3db8-40e1-a64f-a80c388d7b5b tempest-VolumeQuotasAdminTestJSON-332964430 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:29:08 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-f29a59ad-3db8-40e1-a64f-a80c388d7b5b tempest-VolumeQuotasAdminTestJSON-332964430 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:29:08 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-f29a59ad-3db8-40e1-a64f-a80c388d7b5b tempest-VolumeQuotasAdminTestJSON-332964430 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:29:08 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-f29a59ad-3db8-40e1-a64f-a80c388d7b5b tempest-VolumeQuotasAdminTestJSON-332964430 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:29:08 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-f29a59ad-3db8-40e1-a64f-a80c388d7b5b tempest-VolumeQuotasAdminTestJSON-332964430 None] Selected osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:29:08 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-f29a59ad-3db8-40e1-a64f-a80c388d7b5b tempest-VolumeQuotasAdminTestJSON-332964430 None] casted to osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f Jun 29 03:29:08 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-f29a59ad-3db8-40e1-a64f-a80c388d7b5b tempest-VolumeQuotasAdminTestJSON-332964430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-dfa86a7e-e284-42ac-af1e-81c901fba770 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:29:09 devstack sudo[102758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-dfa86a7e-e284-42ac-af1e-81c901fba770 1073741824 Jun 29 03:29:09 devstack sudo[102758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:29:09 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-2d198e54-6442-4ca0-81dc-15ad88e815a0 tempest-GroupsV314Test-1799081870 None] Create group from source-group-797efe7a-42f0-4a07-9ac7-27189c3898ee completed successfully. Jun 29 03:29:09 devstack sudo[102758]: pam_unix(sudo:session): session closed for user root Jun 29 03:29:09 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-f29a59ad-3db8-40e1-a64f-a80c388d7b5b tempest-VolumeQuotasAdminTestJSON-332964430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-dfa86a7e-e284-42ac-af1e-81c901fba770 1073741824" returned: 0 in 0.832s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:29:09 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-f29a59ad-3db8-40e1-a64f-a80c388d7b5b tempest-VolumeQuotasAdminTestJSON-332964430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-dfa86a7e-e284-42ac-af1e-81c901fba770 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:29:09 devstack sudo[102764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-dfa86a7e-e284-42ac-af1e-81c901fba770 Jun 29 03:29:09 devstack sudo[102764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:29:10 devstack sudo[102764]: pam_unix(sudo:session): session closed for user root Jun 29 03:29:10 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-f29a59ad-3db8-40e1-a64f-a80c388d7b5b tempest-VolumeQuotasAdminTestJSON-332964430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-dfa86a7e-e284-42ac-af1e-81c901fba770" returned: 0 in 0.633s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:29:10 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-f29a59ad-3db8-40e1-a64f-a80c388d7b5b tempest-VolumeQuotasAdminTestJSON-332964430 None] <== create_volume: return (1509ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:29:10 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-f29a59ad-3db8-40e1-a64f-a80c388d7b5b tempest-VolumeQuotasAdminTestJSON-332964430 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.513s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:29:10 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-c785d3e2-e708-47ec-91d9-0c9db8b46207 tempest-AttachVolumeTestJSON-872616700 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.685s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:29:10 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-c785d3e2-e708-47ec-91d9-0c9db8b46207 tempest-AttachVolumeTestJSON-872616700 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:29:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-309652870',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12adcf13-1f15-44ad-a1b7-8385c5fe549d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6bf1b94df6c4485d87b2b2758c1476cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:29:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:29:00Z,use_quota=True,user_id='6fcdf128706544418b67f38090f52540',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:29:10 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-c785d3e2-e708-47ec-91d9-0c9db8b46207 tempest-AttachVolumeTestJSON-872616700 None] Creating volume 12adcf13-1f15-44ad-a1b7-8385c5fe549d {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:29:10 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-c785d3e2-e708-47ec-91d9-0c9db8b46207 tempest-AttachVolumeTestJSON-872616700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:29:10 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-c785d3e2-e708-47ec-91d9-0c9db8b46207 tempest-AttachVolumeTestJSON-872616700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:29:10 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-c785d3e2-e708-47ec-91d9-0c9db8b46207 tempest-AttachVolumeTestJSON-872616700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:29:10 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-c785d3e2-e708-47ec-91d9-0c9db8b46207 tempest-AttachVolumeTestJSON-872616700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:29:10 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-c785d3e2-e708-47ec-91d9-0c9db8b46207 tempest-AttachVolumeTestJSON-872616700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:29:10 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-c785d3e2-e708-47ec-91d9-0c9db8b46207 tempest-AttachVolumeTestJSON-872616700 None] Selected osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:29:10 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-c785d3e2-e708-47ec-91d9-0c9db8b46207 tempest-AttachVolumeTestJSON-872616700 None] casted to osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f Jun 29 03:29:10 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c785d3e2-e708-47ec-91d9-0c9db8b46207 tempest-AttachVolumeTestJSON-872616700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-12adcf13-1f15-44ad-a1b7-8385c5fe549d 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:29:10 devstack sudo[102767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-12adcf13-1f15-44ad-a1b7-8385c5fe549d 1073741824 Jun 29 03:29:10 devstack sudo[102767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:29:10 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-f29a59ad-3db8-40e1-a64f-a80c388d7b5b tempest-VolumeQuotasAdminTestJSON-332964430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10de2ad6-bd86-42a6-8be0-615e0e9f7d24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dfa86a7e-e284-42ac-af1e-81c901fba770', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:29:10 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-f29a59ad-3db8-40e1-a64f-a80c388d7b5b tempest-VolumeQuotasAdminTestJSON-332964430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea4f53c0-3a25-48f8-a672-614224e8c9e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:29:10 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-f29a59ad-3db8-40e1-a64f-a80c388d7b5b tempest-VolumeQuotasAdminTestJSON-332964430 None] Volume volume-dfa86a7e-e284-42ac-af1e-81c901fba770 (dfa86a7e-e284-42ac-af1e-81c901fba770): created successfully Jun 29 03:29:10 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-f29a59ad-3db8-40e1-a64f-a80c388d7b5b tempest-VolumeQuotasAdminTestJSON-332964430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea4f53c0-3a25-48f8-a672-614224e8c9e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:29:10 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-f29a59ad-3db8-40e1-a64f-a80c388d7b5b tempest-VolumeQuotasAdminTestJSON-332964430 None] Flow 'volume_create_manager' (5e163d50-2333-46f5-a262-49bb641ec798) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:29:10 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-f29a59ad-3db8-40e1-a64f-a80c388d7b5b tempest-VolumeQuotasAdminTestJSON-332964430 None] Created volume successfully. Jun 29 03:29:10 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-33e318f5-cced-48b3-9bc9-eaab1f3568bb tempest-GroupsV314Test-1799081870 None] Acquiring lock "cinder-quobyte-55ff3e1a-6b5f-4dfd-8134-f9f95b4ce4e8" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:29:10 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-33e318f5-cced-48b3-9bc9-eaab1f3568bb tempest-GroupsV314Test-1799081870 None] Lock "cinder-quobyte-55ff3e1a-6b5f-4dfd-8134-f9f95b4ce4e8" acquired by "delete_volume" :: waited 0.021s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:29:10 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[86a08062-7ee7-4e66-871e-b66a940845dd]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:29:10 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-33e318f5-cced-48b3-9bc9-eaab1f3568bb tempest-GroupsV314Test-1799081870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-55ff3e1a-6b5f-4dfd-8134-f9f95b4ce4e8 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:29:10 devstack sudo[102769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-55ff3e1a-6b5f-4dfd-8134-f9f95b4ce4e8 Jun 29 03:29:10 devstack sudo[102769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:29:11 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-e462f653-dbce-4f00-9288-885a5bf57aff tempest-VolumeQuotasAdminTestJSON-332964430 None] Acquiring lock "cinder-dfa86a7e-e284-42ac-af1e-81c901fba770-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:29:11 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-e462f653-dbce-4f00-9288-885a5bf57aff tempest-VolumeQuotasAdminTestJSON-332964430 None] Lock "cinder-dfa86a7e-e284-42ac-af1e-81c901fba770-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:29:11 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-e462f653-dbce-4f00-9288-885a5bf57aff tempest-VolumeQuotasAdminTestJSON-332964430 None] Acquiring lock "cinder-quobyte-dfa86a7e-e284-42ac-af1e-81c901fba770" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:29:11 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-e462f653-dbce-4f00-9288-885a5bf57aff tempest-VolumeQuotasAdminTestJSON-332964430 None] Lock "cinder-quobyte-dfa86a7e-e284-42ac-af1e-81c901fba770" acquired by "delete_volume" :: waited 0.014s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:29:11 devstack sudo[102767]: pam_unix(sudo:session): session closed for user root Jun 29 03:29:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c785d3e2-e708-47ec-91d9-0c9db8b46207 tempest-AttachVolumeTestJSON-872616700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-12adcf13-1f15-44ad-a1b7-8385c5fe549d 1073741824" returned: 0 in 0.921s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:29:11 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d308886-6990-4ea5-a9da-57cfc045dd9d]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:29:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-e462f653-dbce-4f00-9288-885a5bf57aff tempest-VolumeQuotasAdminTestJSON-332964430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-dfa86a7e-e284-42ac-af1e-81c901fba770 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:29:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c785d3e2-e708-47ec-91d9-0c9db8b46207 tempest-AttachVolumeTestJSON-872616700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-12adcf13-1f15-44ad-a1b7-8385c5fe549d {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:29:11 devstack sudo[102779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-12adcf13-1f15-44ad-a1b7-8385c5fe549d Jun 29 03:29:11 devstack sudo[102779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:29:11 devstack sudo[102776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-dfa86a7e-e284-42ac-af1e-81c901fba770 Jun 29 03:29:11 devstack sudo[102776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:29:11 devstack sudo[102769]: pam_unix(sudo:session): session closed for user root Jun 29 03:29:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-33e318f5-cced-48b3-9bc9-eaab1f3568bb tempest-GroupsV314Test-1799081870 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-55ff3e1a-6b5f-4dfd-8134-f9f95b4ce4e8" returned: 0 in 0.834s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:29:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-33e318f5-cced-48b3-9bc9-eaab1f3568bb tempest-GroupsV314Test-1799081870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-55ff3e1a-6b5f-4dfd-8134-f9f95b4ce4e8 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:29:11 devstack sudo[102782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-55ff3e1a-6b5f-4dfd-8134-f9f95b4ce4e8 Jun 29 03:29:11 devstack sudo[102782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:29:11 devstack cinder-volume[93468]: DEBUG oslo_service.periodic_task [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93468) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 29 03:29:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:29:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:29:11 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:29:11 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:29:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:29:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:29:11 devstack sudo[102784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf Jun 29 03:29:11 devstack sudo[102784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:29:12 devstack sudo[102776]: pam_unix(sudo:session): session closed for user root Jun 29 03:29:12 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-e462f653-dbce-4f00-9288-885a5bf57aff tempest-VolumeQuotasAdminTestJSON-332964430 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-dfa86a7e-e284-42ac-af1e-81c901fba770" returned: 0 in 0.842s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:29:12 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-e462f653-dbce-4f00-9288-885a5bf57aff tempest-VolumeQuotasAdminTestJSON-332964430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-dfa86a7e-e284-42ac-af1e-81c901fba770 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:29:12 devstack sudo[102791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-dfa86a7e-e284-42ac-af1e-81c901fba770 Jun 29 03:29:12 devstack sudo[102791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:29:12 devstack sudo[102782]: pam_unix(sudo:session): session closed for user root Jun 29 03:29:12 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-33e318f5-cced-48b3-9bc9-eaab1f3568bb tempest-GroupsV314Test-1799081870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-55ff3e1a-6b5f-4dfd-8134-f9f95b4ce4e8" returned: 0 in 0.723s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:29:12 devstack sudo[102779]: pam_unix(sudo:session): session closed for user root Jun 29 03:29:12 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c785d3e2-e708-47ec-91d9-0c9db8b46207 tempest-AttachVolumeTestJSON-872616700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-12adcf13-1f15-44ad-a1b7-8385c5fe549d" returned: 0 in 0.854s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:29:12 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-c785d3e2-e708-47ec-91d9-0c9db8b46207 tempest-AttachVolumeTestJSON-872616700 None] <== create_volume: return (1836ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:29:12 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-c785d3e2-e708-47ec-91d9-0c9db8b46207 tempest-AttachVolumeTestJSON-872616700 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.840s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:29:12 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-33e318f5-cced-48b3-9bc9-eaab1f3568bb tempest-GroupsV314Test-1799081870 None] Lock "cinder-quobyte-55ff3e1a-6b5f-4dfd-8134-f9f95b4ce4e8" released by "delete_volume" :: held 1.632s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:29:12 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-6cfb18bb-c4c7-4a0a-b258-b3728d447e6f tempest-VolumesTransfersTest-1810282051 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.286s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:29:12 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-6cfb18bb-c4c7-4a0a-b258-b3728d447e6f tempest-VolumesTransfersTest-1810282051 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:29:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-344344503',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a21ea40f-7be7-4b6c-96f3-8bff8845324e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='abec7507b91b44fb90615ff8ef965451',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:29:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:29:08Z,use_quota=True,user_id='e053035204424df38502ac502cea079a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:29:12 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-6cfb18bb-c4c7-4a0a-b258-b3728d447e6f tempest-VolumesTransfersTest-1810282051 None] Creating volume a21ea40f-7be7-4b6c-96f3-8bff8845324e {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:29:12 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-6cfb18bb-c4c7-4a0a-b258-b3728d447e6f tempest-VolumesTransfersTest-1810282051 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:29:12 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-6cfb18bb-c4c7-4a0a-b258-b3728d447e6f tempest-VolumesTransfersTest-1810282051 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:29:12 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-6cfb18bb-c4c7-4a0a-b258-b3728d447e6f tempest-VolumesTransfersTest-1810282051 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:29:12 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-6cfb18bb-c4c7-4a0a-b258-b3728d447e6f tempest-VolumesTransfersTest-1810282051 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:29:12 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-6cfb18bb-c4c7-4a0a-b258-b3728d447e6f tempest-VolumesTransfersTest-1810282051 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:29:12 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-6cfb18bb-c4c7-4a0a-b258-b3728d447e6f tempest-VolumesTransfersTest-1810282051 None] Selected osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:29:12 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-6cfb18bb-c4c7-4a0a-b258-b3728d447e6f tempest-VolumesTransfersTest-1810282051 None] casted to osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f Jun 29 03:29:12 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-6cfb18bb-c4c7-4a0a-b258-b3728d447e6f tempest-VolumesTransfersTest-1810282051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-a21ea40f-7be7-4b6c-96f3-8bff8845324e 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:29:12 devstack sudo[102793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-a21ea40f-7be7-4b6c-96f3-8bff8845324e 1073741824 Jun 29 03:29:12 devstack sudo[102793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:29:12 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-c785d3e2-e708-47ec-91d9-0c9db8b46207 tempest-AttachVolumeTestJSON-872616700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b569ca6c-9aa1-4f72-878b-a61b5ac7e11e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12adcf13-1f15-44ad-a1b7-8385c5fe549d', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:29:12 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-c785d3e2-e708-47ec-91d9-0c9db8b46207 tempest-AttachVolumeTestJSON-872616700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1310fa6e-1717-4e6f-b2f9-4afb822e9421) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:29:12 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-c785d3e2-e708-47ec-91d9-0c9db8b46207 tempest-AttachVolumeTestJSON-872616700 None] Volume volume-12adcf13-1f15-44ad-a1b7-8385c5fe549d (12adcf13-1f15-44ad-a1b7-8385c5fe549d): created successfully Jun 29 03:29:12 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-c785d3e2-e708-47ec-91d9-0c9db8b46207 tempest-AttachVolumeTestJSON-872616700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1310fa6e-1717-4e6f-b2f9-4afb822e9421) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:29:12 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-c785d3e2-e708-47ec-91d9-0c9db8b46207 tempest-AttachVolumeTestJSON-872616700 None] Flow 'volume_create_manager' (011b3457-e7e1-49b4-9181-436db20a83f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:29:12 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-c785d3e2-e708-47ec-91d9-0c9db8b46207 tempest-AttachVolumeTestJSON-872616700 None] Created volume successfully. Jun 29 03:29:12 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-33e318f5-cced-48b3-9bc9-eaab1f3568bb tempest-GroupsV314Test-1799081870 None] Created reservations ['9292c5d5-2161-4cab-ac76-aed96e39b51b'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:29:12 devstack cinder-volume[93468]: WARNING cinder.quota [None req-33e318f5-cced-48b3-9bc9-eaab1f3568bb tempest-GroupsV314Test-1799081870 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-2097189836 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-2097189836, it is now deprecated. Please use the default quota class for default quota. Jun 29 03:29:12 devstack cinder-volume[93468]: WARNING cinder.quota [None req-33e318f5-cced-48b3-9bc9-eaab1f3568bb tempest-GroupsV314Test-1799081870 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-2097189836 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-2097189836, it is now deprecated. Please use the default quota class for default quota. Jun 29 03:29:12 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-33e318f5-cced-48b3-9bc9-eaab1f3568bb tempest-GroupsV314Test-1799081870 None] Created reservations ['6efd1b17-6023-4a98-8e18-52990d92c5cb', 'a8817417-89da-4c3a-91c3-74134d725387', '620820d4-74c9-4e14-a406-a55e394d2792', '9ec33459-772c-4123-aa5a-9ddf9a378d6d'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:29:12 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-33e318f5-cced-48b3-9bc9-eaab1f3568bb tempest-GroupsV314Test-1799081870 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:29:12 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-33e318f5-cced-48b3-9bc9-eaab1f3568bb tempest-GroupsV314Test-1799081870 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:29:12 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-33e318f5-cced-48b3-9bc9-eaab1f3568bb tempest-GroupsV314Test-1799081870 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:29:12 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-33e318f5-cced-48b3-9bc9-eaab1f3568bb tempest-GroupsV314Test-1799081870 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:29:12 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-33e318f5-cced-48b3-9bc9-eaab1f3568bb tempest-GroupsV314Test-1799081870 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:29:12 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-33e318f5-cced-48b3-9bc9-eaab1f3568bb tempest-GroupsV314Test-1799081870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:29:12 devstack sudo[102796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf Jun 29 03:29:12 devstack sudo[102796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:29:12 devstack sudo[102784]: pam_unix(sudo:session): session closed for user root Jun 29 03:29:12 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf" returned: 0 in 0.872s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:29:12 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:29:12 devstack cinder-volume[93468]: DEBUG oslo_service.periodic_task [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Running periodic task VolumeManager._thread_info {{(pid=93468) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 29 03:29:12 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] thread count: 28 {{(pid=93468) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 29 03:29:12 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] thread info: [<_MainThread(MainThread, started 132331377287296)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93468) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 29 03:29:13 devstack sudo[102791]: pam_unix(sudo:session): session closed for user root Jun 29 03:29:13 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-e462f653-dbce-4f00-9288-885a5bf57aff tempest-VolumeQuotasAdminTestJSON-332964430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-dfa86a7e-e284-42ac-af1e-81c901fba770" returned: 0 in 0.735s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:29:13 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-e462f653-dbce-4f00-9288-885a5bf57aff tempest-VolumeQuotasAdminTestJSON-332964430 None] Lock "cinder-quobyte-dfa86a7e-e284-42ac-af1e-81c901fba770" released by "delete_volume" :: held 1.630s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:29:13 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-e462f653-dbce-4f00-9288-885a5bf57aff tempest-VolumeQuotasAdminTestJSON-332964430 None] Created reservations ['49b72ec7-572f-4c6d-8272-1119b58049f4', 'd69fe6dd-b51a-4507-b5b9-2a48f56bdba4', 'fc4723c1-e182-4019-b0cf-afab89721a85', '14dcba9c-0e46-4a5c-b203-d81b0db424a6'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:29:13 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-e462f653-dbce-4f00-9288-885a5bf57aff tempest-VolumeQuotasAdminTestJSON-332964430 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:29:13 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-e462f653-dbce-4f00-9288-885a5bf57aff tempest-VolumeQuotasAdminTestJSON-332964430 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:29:13 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-e462f653-dbce-4f00-9288-885a5bf57aff tempest-VolumeQuotasAdminTestJSON-332964430 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:29:13 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-e462f653-dbce-4f00-9288-885a5bf57aff tempest-VolumeQuotasAdminTestJSON-332964430 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:29:13 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-e462f653-dbce-4f00-9288-885a5bf57aff tempest-VolumeQuotasAdminTestJSON-332964430 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:29:13 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-e462f653-dbce-4f00-9288-885a5bf57aff tempest-VolumeQuotasAdminTestJSON-332964430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:29:13 devstack sudo[102803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf Jun 29 03:29:13 devstack sudo[102803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:29:13 devstack sudo[102793]: pam_unix(sudo:session): session closed for user root Jun 29 03:29:13 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-6cfb18bb-c4c7-4a0a-b258-b3728d447e6f tempest-VolumesTransfersTest-1810282051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-a21ea40f-7be7-4b6c-96f3-8bff8845324e 1073741824" returned: 0 in 1.138s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:29:13 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-6cfb18bb-c4c7-4a0a-b258-b3728d447e6f tempest-VolumesTransfersTest-1810282051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-a21ea40f-7be7-4b6c-96f3-8bff8845324e {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:29:13 devstack sudo[102796]: pam_unix(sudo:session): session closed for user root Jun 29 03:29:13 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-33e318f5-cced-48b3-9bc9-eaab1f3568bb tempest-GroupsV314Test-1799081870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf" returned: 0 in 0.894s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:29:13 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-33e318f5-cced-48b3-9bc9-eaab1f3568bb tempest-GroupsV314Test-1799081870 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:29:13 devstack sudo[102810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-a21ea40f-7be7-4b6c-96f3-8bff8845324e Jun 29 03:29:13 devstack sudo[102810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:29:13 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-33e318f5-cced-48b3-9bc9-eaab1f3568bb tempest-GroupsV314Test-1799081870 None] Delete group completed successfully. Jun 29 03:29:13 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-ae1dd140-692b-41cc-9f49-2d72431e9430 tempest-GroupsV314Test-1799081870 None] Acquiring lock "cinder-quobyte-81bc4be0-42e0-442a-90d0-81c4ad65a01d" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:29:13 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-ae1dd140-692b-41cc-9f49-2d72431e9430 tempest-GroupsV314Test-1799081870 None] Lock "cinder-quobyte-81bc4be0-42e0-442a-90d0-81c4ad65a01d" acquired by "delete_volume" :: waited 0.025s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:29:13 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[55d2f1c1-2e41-44b0-8cd4-3ab0cdb97cc7]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:29:13 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ae1dd140-692b-41cc-9f49-2d72431e9430 tempest-GroupsV314Test-1799081870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-81bc4be0-42e0-442a-90d0-81c4ad65a01d {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:29:13 devstack sudo[102812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-81bc4be0-42e0-442a-90d0-81c4ad65a01d Jun 29 03:29:13 devstack sudo[102812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:29:14 devstack sudo[102803]: pam_unix(sudo:session): session closed for user root Jun 29 03:29:14 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-e462f653-dbce-4f00-9288-885a5bf57aff tempest-VolumeQuotasAdminTestJSON-332964430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf" returned: 0 in 0.880s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:29:14 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-e462f653-dbce-4f00-9288-885a5bf57aff tempest-VolumeQuotasAdminTestJSON-332964430 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:29:14 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-e462f653-dbce-4f00-9288-885a5bf57aff tempest-VolumeQuotasAdminTestJSON-332964430 None] Deleted volume successfully. Jun 29 03:29:14 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-e462f653-dbce-4f00-9288-885a5bf57aff tempest-VolumeQuotasAdminTestJSON-332964430 None] Lock "cinder-dfa86a7e-e284-42ac-af1e-81c901fba770-delete_volume" released by "delete_volume" :: held 2.737s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:29:14 devstack sudo[102810]: pam_unix(sudo:session): session closed for user root Jun 29 03:29:14 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-6cfb18bb-c4c7-4a0a-b258-b3728d447e6f tempest-VolumesTransfersTest-1810282051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-a21ea40f-7be7-4b6c-96f3-8bff8845324e" returned: 0 in 0.777s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:29:14 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-6cfb18bb-c4c7-4a0a-b258-b3728d447e6f tempest-VolumesTransfersTest-1810282051 None] <== create_volume: return (1984ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:29:14 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-6cfb18bb-c4c7-4a0a-b258-b3728d447e6f tempest-VolumesTransfersTest-1810282051 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.989s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:29:14 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-c04605e1-6ed0-4cf4-b0ab-3d83ce0a0acc tempest-VolumeQuotasAdminTestJSON-332964430 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:29:14 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-c04605e1-6ed0-4cf4-b0ab-3d83ce0a0acc tempest-VolumeQuotasAdminTestJSON-332964430 None] Flow 'volume_create_manager' (1d94af8c-a728-482e-90fd-195b362272f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:29:14 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-c04605e1-6ed0-4cf4-b0ab-3d83ce0a0acc tempest-VolumeQuotasAdminTestJSON-332964430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47aac666-33cb-41c7-9024-96baf38f8087) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:29:14 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-6cfb18bb-c4c7-4a0a-b258-b3728d447e6f tempest-VolumesTransfersTest-1810282051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6189ba0-1e5e-4fbc-873c-39b22b153b43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a21ea40f-7be7-4b6c-96f3-8bff8845324e', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:29:14 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-6cfb18bb-c4c7-4a0a-b258-b3728d447e6f tempest-VolumesTransfersTest-1810282051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f119cb0b-9189-43dd-99ce-20eb968c4153) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:29:14 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-c04605e1-6ed0-4cf4-b0ab-3d83ce0a0acc tempest-VolumeQuotasAdminTestJSON-332964430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47aac666-33cb-41c7-9024-96baf38f8087) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:29:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-323237177',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56b61fc5-15b8-4092-93fa-f180dd9413ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63d9464d9bf44be6a60548edceb6b662',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:29:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:29:14Z,use_quota=True,user_id='b33977bb92194b7f90babb123601093c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:29:14 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-c04605e1-6ed0-4cf4-b0ab-3d83ce0a0acc tempest-VolumeQuotasAdminTestJSON-332964430 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9987dd19-9f3b-4629-a902-d64f1d39ac01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:29:14 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-c04605e1-6ed0-4cf4-b0ab-3d83ce0a0acc tempest-VolumeQuotasAdminTestJSON-332964430 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9987dd19-9f3b-4629-a902-d64f1d39ac01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:29:14 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-c04605e1-6ed0-4cf4-b0ab-3d83ce0a0acc tempest-VolumeQuotasAdminTestJSON-332964430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e66303b-3e8e-4c53-bb36-7eb8f1bede1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:29:14 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-c04605e1-6ed0-4cf4-b0ab-3d83ce0a0acc tempest-VolumeQuotasAdminTestJSON-332964430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e66303b-3e8e-4c53-bb36-7eb8f1bede1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '56b61fc5-15b8-4092-93fa-f180dd9413ed', 'volume_name': 'volume-56b61fc5-15b8-4092-93fa-f180dd9413ed', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:29:14 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-c04605e1-6ed0-4cf4-b0ab-3d83ce0a0acc tempest-VolumeQuotasAdminTestJSON-332964430 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ef4918c-2e1a-4163-949c-ebf56422b0e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:29:14 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-c04605e1-6ed0-4cf4-b0ab-3d83ce0a0acc tempest-VolumeQuotasAdminTestJSON-332964430 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ef4918c-2e1a-4163-949c-ebf56422b0e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:29:14 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-c04605e1-6ed0-4cf4-b0ab-3d83ce0a0acc tempest-VolumeQuotasAdminTestJSON-332964430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (931f9192-3726-4b1b-9d25-f622cfd4802f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:29:14 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-c04605e1-6ed0-4cf4-b0ab-3d83ce0a0acc tempest-VolumeQuotasAdminTestJSON-332964430 None] Volume 56b61fc5-15b8-4092-93fa-f180dd9413ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-56b61fc5-15b8-4092-93fa-f180dd9413ed', 'volume_size': 1} Jun 29 03:29:14 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-c04605e1-6ed0-4cf4-b0ab-3d83ce0a0acc tempest-VolumeQuotasAdminTestJSON-332964430 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:29:14 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-c04605e1-6ed0-4cf4-b0ab-3d83ce0a0acc tempest-VolumeQuotasAdminTestJSON-332964430 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:29:14 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-c04605e1-6ed0-4cf4-b0ab-3d83ce0a0acc tempest-VolumeQuotasAdminTestJSON-332964430 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:29:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-323237177',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56b61fc5-15b8-4092-93fa-f180dd9413ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63d9464d9bf44be6a60548edceb6b662',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:29:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:29:14Z,use_quota=True,user_id='b33977bb92194b7f90babb123601093c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:29:14 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-c04605e1-6ed0-4cf4-b0ab-3d83ce0a0acc tempest-VolumeQuotasAdminTestJSON-332964430 None] Creating volume 56b61fc5-15b8-4092-93fa-f180dd9413ed {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:29:14 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-c04605e1-6ed0-4cf4-b0ab-3d83ce0a0acc tempest-VolumeQuotasAdminTestJSON-332964430 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:29:14 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-c04605e1-6ed0-4cf4-b0ab-3d83ce0a0acc tempest-VolumeQuotasAdminTestJSON-332964430 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:29:14 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-c04605e1-6ed0-4cf4-b0ab-3d83ce0a0acc tempest-VolumeQuotasAdminTestJSON-332964430 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:29:14 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-c04605e1-6ed0-4cf4-b0ab-3d83ce0a0acc tempest-VolumeQuotasAdminTestJSON-332964430 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:29:14 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-c04605e1-6ed0-4cf4-b0ab-3d83ce0a0acc tempest-VolumeQuotasAdminTestJSON-332964430 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:29:14 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-c04605e1-6ed0-4cf4-b0ab-3d83ce0a0acc tempest-VolumeQuotasAdminTestJSON-332964430 None] Selected osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:29:14 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-c04605e1-6ed0-4cf4-b0ab-3d83ce0a0acc tempest-VolumeQuotasAdminTestJSON-332964430 None] casted to osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f Jun 29 03:29:14 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c04605e1-6ed0-4cf4-b0ab-3d83ce0a0acc tempest-VolumeQuotasAdminTestJSON-332964430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-56b61fc5-15b8-4092-93fa-f180dd9413ed 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:29:14 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-6cfb18bb-c4c7-4a0a-b258-b3728d447e6f tempest-VolumesTransfersTest-1810282051 None] Volume volume-a21ea40f-7be7-4b6c-96f3-8bff8845324e (a21ea40f-7be7-4b6c-96f3-8bff8845324e): created successfully Jun 29 03:29:14 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-6cfb18bb-c4c7-4a0a-b258-b3728d447e6f tempest-VolumesTransfersTest-1810282051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f119cb0b-9189-43dd-99ce-20eb968c4153) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:29:14 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-6cfb18bb-c4c7-4a0a-b258-b3728d447e6f tempest-VolumesTransfersTest-1810282051 None] Flow 'volume_create_manager' (8aabd759-b163-4fb8-ac50-cf7a8406e902) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:29:14 devstack sudo[102817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-56b61fc5-15b8-4092-93fa-f180dd9413ed 1073741824 Jun 29 03:29:14 devstack sudo[102817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:29:14 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-6cfb18bb-c4c7-4a0a-b258-b3728d447e6f tempest-VolumesTransfersTest-1810282051 None] Created volume successfully. Jun 29 03:29:14 devstack sudo[102812]: pam_unix(sudo:session): session closed for user root Jun 29 03:29:14 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ae1dd140-692b-41cc-9f49-2d72431e9430 tempest-GroupsV314Test-1799081870 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-81bc4be0-42e0-442a-90d0-81c4ad65a01d" returned: 0 in 0.926s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:29:14 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ae1dd140-692b-41cc-9f49-2d72431e9430 tempest-GroupsV314Test-1799081870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-81bc4be0-42e0-442a-90d0-81c4ad65a01d {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:29:14 devstack sudo[102822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-81bc4be0-42e0-442a-90d0-81c4ad65a01d Jun 29 03:29:14 devstack sudo[102822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:29:15 devstack sudo[102817]: pam_unix(sudo:session): session closed for user root Jun 29 03:29:15 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c04605e1-6ed0-4cf4-b0ab-3d83ce0a0acc tempest-VolumeQuotasAdminTestJSON-332964430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-56b61fc5-15b8-4092-93fa-f180dd9413ed 1073741824" returned: 0 in 0.871s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:29:15 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c04605e1-6ed0-4cf4-b0ab-3d83ce0a0acc tempest-VolumeQuotasAdminTestJSON-332964430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-56b61fc5-15b8-4092-93fa-f180dd9413ed {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:29:15 devstack sudo[102829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-56b61fc5-15b8-4092-93fa-f180dd9413ed Jun 29 03:29:15 devstack sudo[102829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:29:15 devstack sudo[102822]: pam_unix(sudo:session): session closed for user root Jun 29 03:29:15 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ae1dd140-692b-41cc-9f49-2d72431e9430 tempest-GroupsV314Test-1799081870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-81bc4be0-42e0-442a-90d0-81c4ad65a01d" returned: 0 in 0.705s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:29:15 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-ae1dd140-692b-41cc-9f49-2d72431e9430 tempest-GroupsV314Test-1799081870 None] Lock "cinder-quobyte-81bc4be0-42e0-442a-90d0-81c4ad65a01d" released by "delete_volume" :: held 1.746s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:29:15 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-ae1dd140-692b-41cc-9f49-2d72431e9430 tempest-GroupsV314Test-1799081870 None] Created reservations ['7ef84aa0-def5-4555-8512-c184886dfdda'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:29:15 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-ae1dd140-692b-41cc-9f49-2d72431e9430 tempest-GroupsV314Test-1799081870 None] Created reservations ['0cb7271f-4759-46ca-8d09-56ea75436ef4', '67e8f7c8-bdb4-4be8-996f-47e04df9d6ba', 'ca1d252a-4b70-4eb5-bdcf-d0561e63eb2f', '506b8094-459c-4dc4-a328-16b1c8c5d557'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:29:15 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-ae1dd140-692b-41cc-9f49-2d72431e9430 tempest-GroupsV314Test-1799081870 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:29:15 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-ae1dd140-692b-41cc-9f49-2d72431e9430 tempest-GroupsV314Test-1799081870 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:29:15 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-ae1dd140-692b-41cc-9f49-2d72431e9430 tempest-GroupsV314Test-1799081870 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:29:15 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-ae1dd140-692b-41cc-9f49-2d72431e9430 tempest-GroupsV314Test-1799081870 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:29:15 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-ae1dd140-692b-41cc-9f49-2d72431e9430 tempest-GroupsV314Test-1799081870 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:29:15 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ae1dd140-692b-41cc-9f49-2d72431e9430 tempest-GroupsV314Test-1799081870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:29:15 devstack sudo[102832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf Jun 29 03:29:15 devstack sudo[102832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:29:16 devstack sudo[102829]: pam_unix(sudo:session): session closed for user root Jun 29 03:29:16 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c04605e1-6ed0-4cf4-b0ab-3d83ce0a0acc tempest-VolumeQuotasAdminTestJSON-332964430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-56b61fc5-15b8-4092-93fa-f180dd9413ed" returned: 0 in 0.792s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:29:16 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-c04605e1-6ed0-4cf4-b0ab-3d83ce0a0acc tempest-VolumeQuotasAdminTestJSON-332964430 None] <== create_volume: return (1717ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:29:16 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-c04605e1-6ed0-4cf4-b0ab-3d83ce0a0acc tempest-VolumeQuotasAdminTestJSON-332964430 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.719s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:29:16 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-c04605e1-6ed0-4cf4-b0ab-3d83ce0a0acc tempest-VolumeQuotasAdminTestJSON-332964430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (931f9192-3726-4b1b-9d25-f622cfd4802f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-56b61fc5-15b8-4092-93fa-f180dd9413ed', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:29:16 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-c04605e1-6ed0-4cf4-b0ab-3d83ce0a0acc tempest-VolumeQuotasAdminTestJSON-332964430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42046136-5720-4679-bd7b-ea9d061eb732) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:29:16 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-c04605e1-6ed0-4cf4-b0ab-3d83ce0a0acc tempest-VolumeQuotasAdminTestJSON-332964430 None] Volume volume-56b61fc5-15b8-4092-93fa-f180dd9413ed (56b61fc5-15b8-4092-93fa-f180dd9413ed): created successfully Jun 29 03:29:16 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-c04605e1-6ed0-4cf4-b0ab-3d83ce0a0acc tempest-VolumeQuotasAdminTestJSON-332964430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42046136-5720-4679-bd7b-ea9d061eb732) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:29:16 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-c04605e1-6ed0-4cf4-b0ab-3d83ce0a0acc tempest-VolumeQuotasAdminTestJSON-332964430 None] Flow 'volume_create_manager' (1d94af8c-a728-482e-90fd-195b362272f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:29:16 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-ea4e07bf-3bec-40fe-a789-f831a4f95d83 tempest-VolumesTransfersTest-184807407 None] Transfer volume completed successfully. Jun 29 03:29:16 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-c04605e1-6ed0-4cf4-b0ab-3d83ce0a0acc tempest-VolumeQuotasAdminTestJSON-332964430 None] Created volume successfully. Jun 29 03:29:16 devstack sudo[102832]: pam_unix(sudo:session): session closed for user root Jun 29 03:29:16 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ae1dd140-692b-41cc-9f49-2d72431e9430 tempest-GroupsV314Test-1799081870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf" returned: 0 in 0.765s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:29:16 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-ae1dd140-692b-41cc-9f49-2d72431e9430 tempest-GroupsV314Test-1799081870 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:29:16 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-ae1dd140-692b-41cc-9f49-2d72431e9430 tempest-GroupsV314Test-1799081870 None] Delete group completed successfully. Jun 29 03:29:16 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [req-695c06c3-c568-4bdf-b519-aa2ec42e2820 req-939198f7-d702-4c92-b707-031ff0a3fdd3 tempest-AttachVolumeTestJSON-872616700 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:29:16 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [req-695c06c3-c568-4bdf-b519-aa2ec42e2820 req-939198f7-d702-4c92-b707-031ff0a3fdd3 tempest-AttachVolumeTestJSON-872616700 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:29:16 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[a10ab844-bd19-41c6-9a24-7a2455e5976c]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:29:16 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [req-695c06c3-c568-4bdf-b519-aa2ec42e2820 req-939198f7-d702-4c92-b707-031ff0a3fdd3 tempest-AttachVolumeTestJSON-872616700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-12adcf13-1f15-44ad-a1b7-8385c5fe549d {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:29:16 devstack sudo[102846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-12adcf13-1f15-44ad-a1b7-8385c5fe549d Jun 29 03:29:16 devstack sudo[102846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:29:17 devstack sudo[102846]: pam_unix(sudo:session): session closed for user root Jun 29 03:29:17 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [req-695c06c3-c568-4bdf-b519-aa2ec42e2820 req-939198f7-d702-4c92-b707-031ff0a3fdd3 tempest-AttachVolumeTestJSON-872616700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-12adcf13-1f15-44ad-a1b7-8385c5fe549d" returned: 0 in 0.845s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:29:17 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [req-695c06c3-c568-4bdf-b519-aa2ec42e2820 req-939198f7-d702-4c92-b707-031ff0a3fdd3 tempest-AttachVolumeTestJSON-872616700 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.863s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:29:17 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [req-695c06c3-c568-4bdf-b519-aa2ec42e2820 req-939198f7-d702-4c92-b707-031ff0a3fdd3 tempest-AttachVolumeTestJSON-872616700 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f', 'name': 'volume-12adcf13-1f15-44ad-a1b7-8385c5fe549d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7e59b782-98fe-4c56-9e68-0118ccc6b254', 'enforce_multipath': True} {{(pid=93468) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 29 03:29:17 devstack cinder-volume[93468]: INFO cinder.volume.manager [req-695c06c3-c568-4bdf-b519-aa2ec42e2820 req-939198f7-d702-4c92-b707-031ff0a3fdd3 tempest-AttachVolumeTestJSON-872616700 None] attachment_update completed successfully. Jun 29 03:29:17 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-3ea100f1-223a-4bd1-be94-0123e492387b tempest-VolumeQuotasAdminTestJSON-1356403826 None] Transfer volume completed successfully. Jun 29 03:29:18 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-808b4c4f-da49-400a-b586-1b3b62516567 tempest-VolumesTransfersTest-1535366633 None] Acquiring lock "cinder-a21ea40f-7be7-4b6c-96f3-8bff8845324e-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:29:18 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-808b4c4f-da49-400a-b586-1b3b62516567 tempest-VolumesTransfersTest-1535366633 None] Lock "cinder-a21ea40f-7be7-4b6c-96f3-8bff8845324e-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:29:18 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-808b4c4f-da49-400a-b586-1b3b62516567 tempest-VolumesTransfersTest-1535366633 None] Acquiring lock "cinder-quobyte-a21ea40f-7be7-4b6c-96f3-8bff8845324e" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:29:18 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-808b4c4f-da49-400a-b586-1b3b62516567 tempest-VolumesTransfersTest-1535366633 None] Lock "cinder-quobyte-a21ea40f-7be7-4b6c-96f3-8bff8845324e" acquired by "delete_volume" :: waited 0.015s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:29:18 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a5e324d-9a13-41eb-aa5b-47d421b9aec0]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:29:18 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-808b4c4f-da49-400a-b586-1b3b62516567 tempest-VolumesTransfersTest-1535366633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-a21ea40f-7be7-4b6c-96f3-8bff8845324e {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:29:18 devstack sudo[102918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-a21ea40f-7be7-4b6c-96f3-8bff8845324e Jun 29 03:29:18 devstack sudo[102918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:29:18 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-1df7c36a-2077-40d4-976c-cfdfbb16bb26 tempest-VolumeQuotasAdminTestJSON-1271399909 None] Acquiring lock "cinder-56b61fc5-15b8-4092-93fa-f180dd9413ed-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:29:18 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-1df7c36a-2077-40d4-976c-cfdfbb16bb26 tempest-VolumeQuotasAdminTestJSON-1271399909 None] Lock "cinder-56b61fc5-15b8-4092-93fa-f180dd9413ed-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:29:18 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-1df7c36a-2077-40d4-976c-cfdfbb16bb26 tempest-VolumeQuotasAdminTestJSON-1271399909 None] Acquiring lock "cinder-quobyte-56b61fc5-15b8-4092-93fa-f180dd9413ed" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:29:18 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-1df7c36a-2077-40d4-976c-cfdfbb16bb26 tempest-VolumeQuotasAdminTestJSON-1271399909 None] Lock "cinder-quobyte-56b61fc5-15b8-4092-93fa-f180dd9413ed" acquired by "delete_volume" :: waited 0.019s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:29:18 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0bce63d-062a-42a5-8468-5844dccc4318]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:29:18 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-1df7c36a-2077-40d4-976c-cfdfbb16bb26 tempest-VolumeQuotasAdminTestJSON-1271399909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-56b61fc5-15b8-4092-93fa-f180dd9413ed {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:29:19 devstack sudo[103238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-56b61fc5-15b8-4092-93fa-f180dd9413ed Jun 29 03:29:19 devstack sudo[103238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:29:19 devstack sudo[102918]: pam_unix(sudo:session): session closed for user root Jun 29 03:29:19 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-808b4c4f-da49-400a-b586-1b3b62516567 tempest-VolumesTransfersTest-1535366633 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-a21ea40f-7be7-4b6c-96f3-8bff8845324e" returned: 0 in 1.046s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:29:19 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-808b4c4f-da49-400a-b586-1b3b62516567 tempest-VolumesTransfersTest-1535366633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-a21ea40f-7be7-4b6c-96f3-8bff8845324e {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:29:19 devstack sudo[103243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-a21ea40f-7be7-4b6c-96f3-8bff8845324e Jun 29 03:29:19 devstack sudo[103243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:29:19 devstack sudo[103238]: pam_unix(sudo:session): session closed for user root Jun 29 03:29:19 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-1df7c36a-2077-40d4-976c-cfdfbb16bb26 tempest-VolumeQuotasAdminTestJSON-1271399909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-56b61fc5-15b8-4092-93fa-f180dd9413ed" returned: 0 in 0.927s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:29:19 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-1df7c36a-2077-40d4-976c-cfdfbb16bb26 tempest-VolumeQuotasAdminTestJSON-1271399909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-56b61fc5-15b8-4092-93fa-f180dd9413ed {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:29:19 devstack sudo[103249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-56b61fc5-15b8-4092-93fa-f180dd9413ed Jun 29 03:29:19 devstack sudo[103249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:29:19 devstack sudo[103243]: pam_unix(sudo:session): session closed for user root Jun 29 03:29:19 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-808b4c4f-da49-400a-b586-1b3b62516567 tempest-VolumesTransfersTest-1535366633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-a21ea40f-7be7-4b6c-96f3-8bff8845324e" returned: 0 in 0.734s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:29:19 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-808b4c4f-da49-400a-b586-1b3b62516567 tempest-VolumesTransfersTest-1535366633 None] Lock "cinder-quobyte-a21ea40f-7be7-4b6c-96f3-8bff8845324e" released by "delete_volume" :: held 1.832s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:29:20 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-808b4c4f-da49-400a-b586-1b3b62516567 tempest-VolumesTransfersTest-1535366633 None] Created reservations ['bba4dfc9-fad2-49a1-b318-b167f522120f', 'e0e8f540-f356-4b62-b1c3-78ed287b1f87', 'd5966ea2-921a-4758-ab5b-e91edcc13126', '355507c0-1784-486b-b9db-39e3235429c0'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:29:20 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-808b4c4f-da49-400a-b586-1b3b62516567 tempest-VolumesTransfersTest-1535366633 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:29:20 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-808b4c4f-da49-400a-b586-1b3b62516567 tempest-VolumesTransfersTest-1535366633 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:29:20 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-808b4c4f-da49-400a-b586-1b3b62516567 tempest-VolumesTransfersTest-1535366633 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:29:20 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-808b4c4f-da49-400a-b586-1b3b62516567 tempest-VolumesTransfersTest-1535366633 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:29:20 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-808b4c4f-da49-400a-b586-1b3b62516567 tempest-VolumesTransfersTest-1535366633 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:29:20 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-808b4c4f-da49-400a-b586-1b3b62516567 tempest-VolumesTransfersTest-1535366633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:29:20 devstack sudo[103251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf Jun 29 03:29:20 devstack sudo[103251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:29:20 devstack sudo[103249]: pam_unix(sudo:session): session closed for user root Jun 29 03:29:20 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-1df7c36a-2077-40d4-976c-cfdfbb16bb26 tempest-VolumeQuotasAdminTestJSON-1271399909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-56b61fc5-15b8-4092-93fa-f180dd9413ed" returned: 0 in 0.799s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:29:20 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-1df7c36a-2077-40d4-976c-cfdfbb16bb26 tempest-VolumeQuotasAdminTestJSON-1271399909 None] Lock "cinder-quobyte-56b61fc5-15b8-4092-93fa-f180dd9413ed" released by "delete_volume" :: held 1.787s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:29:20 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-1df7c36a-2077-40d4-976c-cfdfbb16bb26 tempest-VolumeQuotasAdminTestJSON-1271399909 None] Created reservations ['654b3cea-ce5a-427d-8e6c-bf8476c41946', '9dd94a05-8b43-4580-a7f3-886c580c2d11', '769d5670-3dc0-4935-9e8b-9d83646a5665', 'd4b6eafa-5c10-4379-b8d5-047d1de592c9'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:29:20 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-1df7c36a-2077-40d4-976c-cfdfbb16bb26 tempest-VolumeQuotasAdminTestJSON-1271399909 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:29:20 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-1df7c36a-2077-40d4-976c-cfdfbb16bb26 tempest-VolumeQuotasAdminTestJSON-1271399909 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:29:20 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-1df7c36a-2077-40d4-976c-cfdfbb16bb26 tempest-VolumeQuotasAdminTestJSON-1271399909 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:29:20 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-1df7c36a-2077-40d4-976c-cfdfbb16bb26 tempest-VolumeQuotasAdminTestJSON-1271399909 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:29:20 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-1df7c36a-2077-40d4-976c-cfdfbb16bb26 tempest-VolumeQuotasAdminTestJSON-1271399909 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:29:20 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-1df7c36a-2077-40d4-976c-cfdfbb16bb26 tempest-VolumeQuotasAdminTestJSON-1271399909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:29:20 devstack sudo[103256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf Jun 29 03:29:20 devstack sudo[103256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:29:20 devstack sudo[103251]: pam_unix(sudo:session): session closed for user root Jun 29 03:29:20 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-808b4c4f-da49-400a-b586-1b3b62516567 tempest-VolumesTransfersTest-1535366633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf" returned: 0 in 0.820s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:29:20 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-808b4c4f-da49-400a-b586-1b3b62516567 tempest-VolumesTransfersTest-1535366633 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:29:20 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-808b4c4f-da49-400a-b586-1b3b62516567 tempest-VolumesTransfersTest-1535366633 None] Deleted volume successfully. Jun 29 03:29:21 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-808b4c4f-da49-400a-b586-1b3b62516567 tempest-VolumesTransfersTest-1535366633 None] Lock "cinder-a21ea40f-7be7-4b6c-96f3-8bff8845324e-delete_volume" released by "delete_volume" :: held 2.951s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:29:21 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-7353a610-4ffa-48ab-bc82-b4d7af6f04ec tempest-VolumesTransfersTest-1810282051 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:29:21 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-7353a610-4ffa-48ab-bc82-b4d7af6f04ec tempest-VolumesTransfersTest-1810282051 None] Flow 'volume_create_manager' (77bd2641-973a-42c6-8362-7f0ccec2f2ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:29:21 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-7353a610-4ffa-48ab-bc82-b4d7af6f04ec tempest-VolumesTransfersTest-1810282051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8978c14a-1125-47c1-8c39-7abdf7bf35a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:29:21 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-7353a610-4ffa-48ab-bc82-b4d7af6f04ec tempest-VolumesTransfersTest-1810282051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8978c14a-1125-47c1-8c39-7abdf7bf35a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:29:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1522128905',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2125b036-b482-4cfb-8675-f32f88d86a97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='abec7507b91b44fb90615ff8ef965451',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:29:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:29:21Z,use_quota=True,user_id='e053035204424df38502ac502cea079a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:29:21 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-7353a610-4ffa-48ab-bc82-b4d7af6f04ec tempest-VolumesTransfersTest-1810282051 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7060f2b6-6e8f-4e2e-902c-6f392173a6b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:29:21 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-7353a610-4ffa-48ab-bc82-b4d7af6f04ec tempest-VolumesTransfersTest-1810282051 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7060f2b6-6e8f-4e2e-902c-6f392173a6b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:29:21 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-7353a610-4ffa-48ab-bc82-b4d7af6f04ec tempest-VolumesTransfersTest-1810282051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f31dc063-7d0c-4588-85b4-e0319c257f57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:29:21 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-7353a610-4ffa-48ab-bc82-b4d7af6f04ec tempest-VolumesTransfersTest-1810282051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f31dc063-7d0c-4588-85b4-e0319c257f57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2125b036-b482-4cfb-8675-f32f88d86a97', 'volume_name': 'volume-2125b036-b482-4cfb-8675-f32f88d86a97', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:29:21 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-7353a610-4ffa-48ab-bc82-b4d7af6f04ec tempest-VolumesTransfersTest-1810282051 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a54888f6-2399-4cf7-be77-803d762cd336) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:29:21 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-7353a610-4ffa-48ab-bc82-b4d7af6f04ec tempest-VolumesTransfersTest-1810282051 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a54888f6-2399-4cf7-be77-803d762cd336) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:29:21 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-7353a610-4ffa-48ab-bc82-b4d7af6f04ec tempest-VolumesTransfersTest-1810282051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d4187ad-a6c5-4026-b8c1-fcd74845f92c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:29:21 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-7353a610-4ffa-48ab-bc82-b4d7af6f04ec tempest-VolumesTransfersTest-1810282051 None] Volume 2125b036-b482-4cfb-8675-f32f88d86a97: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2125b036-b482-4cfb-8675-f32f88d86a97', 'volume_size': 1} Jun 29 03:29:21 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-7353a610-4ffa-48ab-bc82-b4d7af6f04ec tempest-VolumesTransfersTest-1810282051 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:29:21 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-7353a610-4ffa-48ab-bc82-b4d7af6f04ec tempest-VolumesTransfersTest-1810282051 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:29:21 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-7353a610-4ffa-48ab-bc82-b4d7af6f04ec tempest-VolumesTransfersTest-1810282051 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:29:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1522128905',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2125b036-b482-4cfb-8675-f32f88d86a97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='abec7507b91b44fb90615ff8ef965451',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:29:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:29:21Z,use_quota=True,user_id='e053035204424df38502ac502cea079a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:29:21 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-7353a610-4ffa-48ab-bc82-b4d7af6f04ec tempest-VolumesTransfersTest-1810282051 None] Creating volume 2125b036-b482-4cfb-8675-f32f88d86a97 {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:29:21 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-7353a610-4ffa-48ab-bc82-b4d7af6f04ec tempest-VolumesTransfersTest-1810282051 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:29:21 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-7353a610-4ffa-48ab-bc82-b4d7af6f04ec tempest-VolumesTransfersTest-1810282051 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:29:21 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-7353a610-4ffa-48ab-bc82-b4d7af6f04ec tempest-VolumesTransfersTest-1810282051 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:29:21 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-7353a610-4ffa-48ab-bc82-b4d7af6f04ec tempest-VolumesTransfersTest-1810282051 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:29:21 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-7353a610-4ffa-48ab-bc82-b4d7af6f04ec tempest-VolumesTransfersTest-1810282051 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:29:21 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-7353a610-4ffa-48ab-bc82-b4d7af6f04ec tempest-VolumesTransfersTest-1810282051 None] Selected osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:29:21 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-7353a610-4ffa-48ab-bc82-b4d7af6f04ec tempest-VolumesTransfersTest-1810282051 None] casted to osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f Jun 29 03:29:21 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-7353a610-4ffa-48ab-bc82-b4d7af6f04ec tempest-VolumesTransfersTest-1810282051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-2125b036-b482-4cfb-8675-f32f88d86a97 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:29:21 devstack sudo[103259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-2125b036-b482-4cfb-8675-f32f88d86a97 1073741824 Jun 29 03:29:21 devstack sudo[103259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:29:21 devstack sudo[103256]: pam_unix(sudo:session): session closed for user root Jun 29 03:29:21 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-1df7c36a-2077-40d4-976c-cfdfbb16bb26 tempest-VolumeQuotasAdminTestJSON-1271399909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf" returned: 0 in 0.892s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:29:21 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-1df7c36a-2077-40d4-976c-cfdfbb16bb26 tempest-VolumeQuotasAdminTestJSON-1271399909 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:29:21 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-1df7c36a-2077-40d4-976c-cfdfbb16bb26 tempest-VolumeQuotasAdminTestJSON-1271399909 None] Deleted volume successfully. Jun 29 03:29:21 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-1df7c36a-2077-40d4-976c-cfdfbb16bb26 tempest-VolumeQuotasAdminTestJSON-1271399909 None] Lock "cinder-56b61fc5-15b8-4092-93fa-f180dd9413ed-delete_volume" released by "delete_volume" :: held 3.047s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:29:22 devstack sudo[103259]: pam_unix(sudo:session): session closed for user root Jun 29 03:29:22 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-7353a610-4ffa-48ab-bc82-b4d7af6f04ec tempest-VolumesTransfersTest-1810282051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-2125b036-b482-4cfb-8675-f32f88d86a97 1073741824" returned: 0 in 1.233s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:29:22 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-7353a610-4ffa-48ab-bc82-b4d7af6f04ec tempest-VolumesTransfersTest-1810282051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-2125b036-b482-4cfb-8675-f32f88d86a97 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:29:22 devstack sudo[103267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-2125b036-b482-4cfb-8675-f32f88d86a97 Jun 29 03:29:22 devstack sudo[103267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:29:23 devstack sudo[103267]: pam_unix(sudo:session): session closed for user root Jun 29 03:29:23 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-7353a610-4ffa-48ab-bc82-b4d7af6f04ec tempest-VolumesTransfersTest-1810282051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-2125b036-b482-4cfb-8675-f32f88d86a97" returned: 0 in 0.780s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:29:23 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-7353a610-4ffa-48ab-bc82-b4d7af6f04ec tempest-VolumesTransfersTest-1810282051 None] <== create_volume: return (2086ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:29:23 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-7353a610-4ffa-48ab-bc82-b4d7af6f04ec tempest-VolumesTransfersTest-1810282051 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.089s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:29:23 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-7353a610-4ffa-48ab-bc82-b4d7af6f04ec tempest-VolumesTransfersTest-1810282051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d4187ad-a6c5-4026-b8c1-fcd74845f92c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2125b036-b482-4cfb-8675-f32f88d86a97', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:29:23 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-7353a610-4ffa-48ab-bc82-b4d7af6f04ec tempest-VolumesTransfersTest-1810282051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4eb8e7f5-b659-4883-8a86-0efdbbfe6329) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:29:23 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-7353a610-4ffa-48ab-bc82-b4d7af6f04ec tempest-VolumesTransfersTest-1810282051 None] Volume volume-2125b036-b482-4cfb-8675-f32f88d86a97 (2125b036-b482-4cfb-8675-f32f88d86a97): created successfully Jun 29 03:29:23 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-7353a610-4ffa-48ab-bc82-b4d7af6f04ec tempest-VolumesTransfersTest-1810282051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4eb8e7f5-b659-4883-8a86-0efdbbfe6329) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:29:23 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-7353a610-4ffa-48ab-bc82-b4d7af6f04ec tempest-VolumesTransfersTest-1810282051 None] Flow 'volume_create_manager' (77bd2641-973a-42c6-8362-7f0ccec2f2ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:29:23 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-7353a610-4ffa-48ab-bc82-b4d7af6f04ec tempest-VolumesTransfersTest-1810282051 None] Created volume successfully. Jun 29 03:29:24 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-a25db0b1-45ba-43bd-b77c-17829be93899 tempest-VolumesTransfersTest-1535366633 None] Acquiring lock "cinder-2125b036-b482-4cfb-8675-f32f88d86a97-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:29:24 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-a25db0b1-45ba-43bd-b77c-17829be93899 tempest-VolumesTransfersTest-1535366633 None] Lock "cinder-2125b036-b482-4cfb-8675-f32f88d86a97-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:29:24 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-a25db0b1-45ba-43bd-b77c-17829be93899 tempest-VolumesTransfersTest-1535366633 None] Acquiring lock "cinder-quobyte-2125b036-b482-4cfb-8675-f32f88d86a97" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:29:24 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-a25db0b1-45ba-43bd-b77c-17829be93899 tempest-VolumesTransfersTest-1535366633 None] Lock "cinder-quobyte-2125b036-b482-4cfb-8675-f32f88d86a97" acquired by "delete_volume" :: waited 0.022s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:29:24 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bc89aa3-5675-41da-a2c6-21d06b125c94]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:29:24 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a25db0b1-45ba-43bd-b77c-17829be93899 tempest-VolumesTransfersTest-1535366633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-2125b036-b482-4cfb-8675-f32f88d86a97 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:29:25 devstack sudo[103317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-2125b036-b482-4cfb-8675-f32f88d86a97 Jun 29 03:29:25 devstack sudo[103317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:29:25 devstack sudo[103317]: pam_unix(sudo:session): session closed for user root Jun 29 03:29:25 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a25db0b1-45ba-43bd-b77c-17829be93899 tempest-VolumesTransfersTest-1535366633 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-2125b036-b482-4cfb-8675-f32f88d86a97" returned: 0 in 1.093s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:29:25 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a25db0b1-45ba-43bd-b77c-17829be93899 tempest-VolumesTransfersTest-1535366633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-2125b036-b482-4cfb-8675-f32f88d86a97 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:29:25 devstack sudo[103324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-2125b036-b482-4cfb-8675-f32f88d86a97 Jun 29 03:29:25 devstack sudo[103324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:29:26 devstack sudo[103324]: pam_unix(sudo:session): session closed for user root Jun 29 03:29:26 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a25db0b1-45ba-43bd-b77c-17829be93899 tempest-VolumesTransfersTest-1535366633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-2125b036-b482-4cfb-8675-f32f88d86a97" returned: 0 in 0.761s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:29:26 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-a25db0b1-45ba-43bd-b77c-17829be93899 tempest-VolumesTransfersTest-1535366633 None] Lock "cinder-quobyte-2125b036-b482-4cfb-8675-f32f88d86a97" released by "delete_volume" :: held 1.912s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:29:26 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-a25db0b1-45ba-43bd-b77c-17829be93899 tempest-VolumesTransfersTest-1535366633 None] Created reservations ['ef727cf1-8b58-4bbd-9a75-945b87a06e4b', 'c9a02d9a-4263-4c20-be04-ead5db8c2b9e', '55a75ad6-b6e5-4d75-83d1-82f130dd2bf9', '9960d337-c2f0-4026-a4c2-760c24675d05'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:29:26 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-a25db0b1-45ba-43bd-b77c-17829be93899 tempest-VolumesTransfersTest-1535366633 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:29:26 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-a25db0b1-45ba-43bd-b77c-17829be93899 tempest-VolumesTransfersTest-1535366633 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:29:26 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-a25db0b1-45ba-43bd-b77c-17829be93899 tempest-VolumesTransfersTest-1535366633 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:29:26 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-a25db0b1-45ba-43bd-b77c-17829be93899 tempest-VolumesTransfersTest-1535366633 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:29:26 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-a25db0b1-45ba-43bd-b77c-17829be93899 tempest-VolumesTransfersTest-1535366633 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:29:26 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a25db0b1-45ba-43bd-b77c-17829be93899 tempest-VolumesTransfersTest-1535366633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:29:26 devstack sudo[103327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf Jun 29 03:29:26 devstack sudo[103327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:29:27 devstack sudo[103327]: pam_unix(sudo:session): session closed for user root Jun 29 03:29:27 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a25db0b1-45ba-43bd-b77c-17829be93899 tempest-VolumesTransfersTest-1535366633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf" returned: 0 in 0.837s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:29:27 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-a25db0b1-45ba-43bd-b77c-17829be93899 tempest-VolumesTransfersTest-1535366633 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:29:27 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-a25db0b1-45ba-43bd-b77c-17829be93899 tempest-VolumesTransfersTest-1535366633 None] Deleted volume successfully. Jun 29 03:29:27 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-a25db0b1-45ba-43bd-b77c-17829be93899 tempest-VolumesTransfersTest-1535366633 None] Lock "cinder-2125b036-b482-4cfb-8675-f32f88d86a97-delete_volume" released by "delete_volume" :: held 3.061s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:29:31 devstack cinder-volume[93468]: DEBUG dbcounter [-] [93468] Writing DB stats cinder:SELECT=100,cinder:UPDATE=127,cinder:DELETE=11,cinder:INSERT=32 {{(pid=93468) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 29 03:29:31 devstack cinder-volume[93468]: DEBUG dbcounter [-] [93468] Writing DB stats cinder:SELECT=105,cinder:UPDATE=124,cinder:DELETE=6,cinder:INSERT=28 {{(pid=93468) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 29 03:29:31 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4244970-8b08-4685-b119-a01dc4e58531 tempest-VolumeRetypeWithoutMigrationTest-206488267 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:29:31 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-d4244970-8b08-4685-b119-a01dc4e58531 tempest-VolumeRetypeWithoutMigrationTest-206488267 None] Flow 'volume_create_manager' (f684979b-7e0d-414c-84ab-457745d32d65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:29:31 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-d4244970-8b08-4685-b119-a01dc4e58531 tempest-VolumeRetypeWithoutMigrationTest-206488267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28d60e4b-7cea-4808-8e35-e40dfeb183d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:29:31 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-d4244970-8b08-4685-b119-a01dc4e58531 tempest-VolumeRetypeWithoutMigrationTest-206488267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28d60e4b-7cea-4808-8e35-e40dfeb183d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:29:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1974536949',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58318f6e-46f5-4d04-9cbe-e2ec76b0a7c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='093d5877bd234685a2c8c0cfa8c09728',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:29:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:29:32Z,use_quota=True,user_id='1248682c7782468799f57168d35c03c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d6b3d66-60dc-4673-8dd1-b5e1f32809a6),volume_type_id=7d6b3d66-60dc-4673-8dd1-b5e1f32809a6)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:29:31 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-d4244970-8b08-4685-b119-a01dc4e58531 tempest-VolumeRetypeWithoutMigrationTest-206488267 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb148500-8736-4824-ae0f-54b1ea8130b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:29:31 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-d4244970-8b08-4685-b119-a01dc4e58531 tempest-VolumeRetypeWithoutMigrationTest-206488267 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb148500-8736-4824-ae0f-54b1ea8130b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:29:31 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-d4244970-8b08-4685-b119-a01dc4e58531 tempest-VolumeRetypeWithoutMigrationTest-206488267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2941d179-61be-4cc0-9426-883f12d19ca3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:29:31 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-d4244970-8b08-4685-b119-a01dc4e58531 tempest-VolumeRetypeWithoutMigrationTest-206488267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2941d179-61be-4cc0-9426-883f12d19ca3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '58318f6e-46f5-4d04-9cbe-e2ec76b0a7c2', 'volume_name': 'volume-58318f6e-46f5-4d04-9cbe-e2ec76b0a7c2', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:29:31 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-d4244970-8b08-4685-b119-a01dc4e58531 tempest-VolumeRetypeWithoutMigrationTest-206488267 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb1d3809-5615-45cd-878d-59c2c5551e13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:29:31 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-d4244970-8b08-4685-b119-a01dc4e58531 tempest-VolumeRetypeWithoutMigrationTest-206488267 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb1d3809-5615-45cd-878d-59c2c5551e13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:29:31 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-d4244970-8b08-4685-b119-a01dc4e58531 tempest-VolumeRetypeWithoutMigrationTest-206488267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b708f1ab-af00-47c0-9b1f-1fe5285bbaaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:29:31 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-d4244970-8b08-4685-b119-a01dc4e58531 tempest-VolumeRetypeWithoutMigrationTest-206488267 None] Volume 58318f6e-46f5-4d04-9cbe-e2ec76b0a7c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-58318f6e-46f5-4d04-9cbe-e2ec76b0a7c2', 'volume_size': 1} Jun 29 03:29:31 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-d4244970-8b08-4685-b119-a01dc4e58531 tempest-VolumeRetypeWithoutMigrationTest-206488267 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:29:31 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-d4244970-8b08-4685-b119-a01dc4e58531 tempest-VolumeRetypeWithoutMigrationTest-206488267 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:29:31 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-d4244970-8b08-4685-b119-a01dc4e58531 tempest-VolumeRetypeWithoutMigrationTest-206488267 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:29:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1974536949',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58318f6e-46f5-4d04-9cbe-e2ec76b0a7c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='093d5877bd234685a2c8c0cfa8c09728',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:29:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:29:32Z,use_quota=True,user_id='1248682c7782468799f57168d35c03c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d6b3d66-60dc-4673-8dd1-b5e1f32809a6),volume_type_id=7d6b3d66-60dc-4673-8dd1-b5e1f32809a6)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:29:31 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-d4244970-8b08-4685-b119-a01dc4e58531 tempest-VolumeRetypeWithoutMigrationTest-206488267 None] Creating volume 58318f6e-46f5-4d04-9cbe-e2ec76b0a7c2 {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:29:31 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-d4244970-8b08-4685-b119-a01dc4e58531 tempest-VolumeRetypeWithoutMigrationTest-206488267 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:29:31 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-d4244970-8b08-4685-b119-a01dc4e58531 tempest-VolumeRetypeWithoutMigrationTest-206488267 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:29:31 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-d4244970-8b08-4685-b119-a01dc4e58531 tempest-VolumeRetypeWithoutMigrationTest-206488267 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:29:31 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-d4244970-8b08-4685-b119-a01dc4e58531 tempest-VolumeRetypeWithoutMigrationTest-206488267 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:29:31 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-d4244970-8b08-4685-b119-a01dc4e58531 tempest-VolumeRetypeWithoutMigrationTest-206488267 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:29:31 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-d4244970-8b08-4685-b119-a01dc4e58531 tempest-VolumeRetypeWithoutMigrationTest-206488267 None] Selected osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:29:31 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-d4244970-8b08-4685-b119-a01dc4e58531 tempest-VolumeRetypeWithoutMigrationTest-206488267 None] casted to osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f Jun 29 03:29:31 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d4244970-8b08-4685-b119-a01dc4e58531 tempest-VolumeRetypeWithoutMigrationTest-206488267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-58318f6e-46f5-4d04-9cbe-e2ec76b0a7c2 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:29:31 devstack sudo[103424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-58318f6e-46f5-4d04-9cbe-e2ec76b0a7c2 1073741824 Jun 29 03:29:31 devstack sudo[103424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:29:33 devstack sudo[103424]: pam_unix(sudo:session): session closed for user root Jun 29 03:29:33 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d4244970-8b08-4685-b119-a01dc4e58531 tempest-VolumeRetypeWithoutMigrationTest-206488267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-58318f6e-46f5-4d04-9cbe-e2ec76b0a7c2 1073741824" returned: 0 in 1.100s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:29:33 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d4244970-8b08-4685-b119-a01dc4e58531 tempest-VolumeRetypeWithoutMigrationTest-206488267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-58318f6e-46f5-4d04-9cbe-e2ec76b0a7c2 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:29:33 devstack sudo[103435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-58318f6e-46f5-4d04-9cbe-e2ec76b0a7c2 Jun 29 03:29:33 devstack sudo[103435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:29:33 devstack sudo[103435]: pam_unix(sudo:session): session closed for user root Jun 29 03:29:33 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d4244970-8b08-4685-b119-a01dc4e58531 tempest-VolumeRetypeWithoutMigrationTest-206488267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-58318f6e-46f5-4d04-9cbe-e2ec76b0a7c2" returned: 0 in 0.823s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:29:33 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-d4244970-8b08-4685-b119-a01dc4e58531 tempest-VolumeRetypeWithoutMigrationTest-206488267 None] <== create_volume: return (1994ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:29:33 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-d4244970-8b08-4685-b119-a01dc4e58531 tempest-VolumeRetypeWithoutMigrationTest-206488267 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.998s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:29:33 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-d4244970-8b08-4685-b119-a01dc4e58531 tempest-VolumeRetypeWithoutMigrationTest-206488267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b708f1ab-af00-47c0-9b1f-1fe5285bbaaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58318f6e-46f5-4d04-9cbe-e2ec76b0a7c2', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:29:33 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-d4244970-8b08-4685-b119-a01dc4e58531 tempest-VolumeRetypeWithoutMigrationTest-206488267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28359bb6-eff0-431f-9b81-d52befb7dc79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:29:33 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-d4244970-8b08-4685-b119-a01dc4e58531 tempest-VolumeRetypeWithoutMigrationTest-206488267 None] Volume volume-58318f6e-46f5-4d04-9cbe-e2ec76b0a7c2 (58318f6e-46f5-4d04-9cbe-e2ec76b0a7c2): created successfully Jun 29 03:29:33 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-d4244970-8b08-4685-b119-a01dc4e58531 tempest-VolumeRetypeWithoutMigrationTest-206488267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28359bb6-eff0-431f-9b81-d52befb7dc79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:29:33 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-d4244970-8b08-4685-b119-a01dc4e58531 tempest-VolumeRetypeWithoutMigrationTest-206488267 None] Flow 'volume_create_manager' (f684979b-7e0d-414c-84ab-457745d32d65) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:29:33 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-d4244970-8b08-4685-b119-a01dc4e58531 tempest-VolumeRetypeWithoutMigrationTest-206488267 None] Created volume successfully. Jun 29 03:29:34 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6e3ae3b-00b1-4775-a4fa-fdd9794dde5a tempest-VolumesCloneTest-532724764 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:29:34 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-f6e3ae3b-00b1-4775-a4fa-fdd9794dde5a tempest-VolumesCloneTest-532724764 None] Flow 'volume_create_manager' (f2a59a22-e45d-4759-b552-b6ca010ab044) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:29:34 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-f6e3ae3b-00b1-4775-a4fa-fdd9794dde5a tempest-VolumesCloneTest-532724764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (061cb7cb-82d7-4327-a5b4-097492b3289f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:29:34 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-f6e3ae3b-00b1-4775-a4fa-fdd9794dde5a tempest-VolumesCloneTest-532724764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (061cb7cb-82d7-4327-a5b4-097492b3289f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:29:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1083930529',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f6f99ba-6c2f-43c7-b151-67131f4ebf53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e309341479c6400f88397e9d1e89c4ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:29:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:29:34Z,use_quota=True,user_id='0b1552ba6cd24deca118269d246d51e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:29:34 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-f6e3ae3b-00b1-4775-a4fa-fdd9794dde5a tempest-VolumesCloneTest-532724764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b5a199f-6a19-4eb5-894e-152843256419) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:29:34 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-f6e3ae3b-00b1-4775-a4fa-fdd9794dde5a tempest-VolumesCloneTest-532724764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b5a199f-6a19-4eb5-894e-152843256419) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:29:34 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-f6e3ae3b-00b1-4775-a4fa-fdd9794dde5a tempest-VolumesCloneTest-532724764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22dec621-ba87-4695-9326-a3fc3166b21e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:29:34 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-f6e3ae3b-00b1-4775-a4fa-fdd9794dde5a tempest-VolumesCloneTest-532724764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22dec621-ba87-4695-9326-a3fc3166b21e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f6f99ba-6c2f-43c7-b151-67131f4ebf53', 'volume_name': 'volume-4f6f99ba-6c2f-43c7-b151-67131f4ebf53', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:29:34 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-f6e3ae3b-00b1-4775-a4fa-fdd9794dde5a tempest-VolumesCloneTest-532724764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (780cde7d-a0da-417c-ac90-8e040a94f027) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:29:34 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-f6e3ae3b-00b1-4775-a4fa-fdd9794dde5a tempest-VolumesCloneTest-532724764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (780cde7d-a0da-417c-ac90-8e040a94f027) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:29:34 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-f6e3ae3b-00b1-4775-a4fa-fdd9794dde5a tempest-VolumesCloneTest-532724764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db03c132-c230-46d4-b0b3-fa014249c157) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:29:34 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-f6e3ae3b-00b1-4775-a4fa-fdd9794dde5a tempest-VolumesCloneTest-532724764 None] Volume 4f6f99ba-6c2f-43c7-b151-67131f4ebf53: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f6f99ba-6c2f-43c7-b151-67131f4ebf53', 'volume_size': 1} Jun 29 03:29:34 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-f6e3ae3b-00b1-4775-a4fa-fdd9794dde5a tempest-VolumesCloneTest-532724764 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:29:34 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-f6e3ae3b-00b1-4775-a4fa-fdd9794dde5a tempest-VolumesCloneTest-532724764 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:29:34 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-f6e3ae3b-00b1-4775-a4fa-fdd9794dde5a tempest-VolumesCloneTest-532724764 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:29:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1083930529',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f6f99ba-6c2f-43c7-b151-67131f4ebf53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e309341479c6400f88397e9d1e89c4ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:29:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:29:34Z,use_quota=True,user_id='0b1552ba6cd24deca118269d246d51e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:29:34 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-f6e3ae3b-00b1-4775-a4fa-fdd9794dde5a tempest-VolumesCloneTest-532724764 None] Creating volume 4f6f99ba-6c2f-43c7-b151-67131f4ebf53 {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:29:34 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-f6e3ae3b-00b1-4775-a4fa-fdd9794dde5a tempest-VolumesCloneTest-532724764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:29:34 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-f6e3ae3b-00b1-4775-a4fa-fdd9794dde5a tempest-VolumesCloneTest-532724764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:29:34 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-f6e3ae3b-00b1-4775-a4fa-fdd9794dde5a tempest-VolumesCloneTest-532724764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:29:34 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-f6e3ae3b-00b1-4775-a4fa-fdd9794dde5a tempest-VolumesCloneTest-532724764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:29:34 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-f6e3ae3b-00b1-4775-a4fa-fdd9794dde5a tempest-VolumesCloneTest-532724764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:29:34 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-f6e3ae3b-00b1-4775-a4fa-fdd9794dde5a tempest-VolumesCloneTest-532724764 None] Selected osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:29:34 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-f6e3ae3b-00b1-4775-a4fa-fdd9794dde5a tempest-VolumesCloneTest-532724764 None] casted to osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f Jun 29 03:29:34 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-f6e3ae3b-00b1-4775-a4fa-fdd9794dde5a tempest-VolumesCloneTest-532724764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-4f6f99ba-6c2f-43c7-b151-67131f4ebf53 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:29:34 devstack sudo[103451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-4f6f99ba-6c2f-43c7-b151-67131f4ebf53 1073741824 Jun 29 03:29:34 devstack sudo[103451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:29:34 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-37a3f7b1-4a7a-4d37-9795-044fcf1e6ccf tempest-VolumeQuotasNegativeTestJSON-63464544 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:29:34 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-37a3f7b1-4a7a-4d37-9795-044fcf1e6ccf tempest-VolumeQuotasNegativeTestJSON-63464544 None] Flow 'volume_create_manager' (b06bb324-2dea-466a-8293-51c3d453ed32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:29:34 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-37a3f7b1-4a7a-4d37-9795-044fcf1e6ccf tempest-VolumeQuotasNegativeTestJSON-63464544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f45520a-8be0-4fa3-a215-48fe563c530b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:29:34 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-37a3f7b1-4a7a-4d37-9795-044fcf1e6ccf tempest-VolumeQuotasNegativeTestJSON-63464544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f45520a-8be0-4fa3-a215-48fe563c530b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:29:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1829397522',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9604399f-52cd-4a3c-8315-89ac244385d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfbe4d77b617437785016b2e65581609',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:29:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:29:35Z,use_quota=True,user_id='7a2e95ccc16f409b97658632ba51a75b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:29:34 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-37a3f7b1-4a7a-4d37-9795-044fcf1e6ccf tempest-VolumeQuotasNegativeTestJSON-63464544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (290ce1cb-ab7e-423d-88fe-8d0f37656516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:29:34 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-37a3f7b1-4a7a-4d37-9795-044fcf1e6ccf tempest-VolumeQuotasNegativeTestJSON-63464544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (290ce1cb-ab7e-423d-88fe-8d0f37656516) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:29:34 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-37a3f7b1-4a7a-4d37-9795-044fcf1e6ccf tempest-VolumeQuotasNegativeTestJSON-63464544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16b0f1e1-c0f0-41d4-8ba3-7393ebb525e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:29:34 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-37a3f7b1-4a7a-4d37-9795-044fcf1e6ccf tempest-VolumeQuotasNegativeTestJSON-63464544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16b0f1e1-c0f0-41d4-8ba3-7393ebb525e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9604399f-52cd-4a3c-8315-89ac244385d7', 'volume_name': 'volume-9604399f-52cd-4a3c-8315-89ac244385d7', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:29:34 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-37a3f7b1-4a7a-4d37-9795-044fcf1e6ccf tempest-VolumeQuotasNegativeTestJSON-63464544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b6cb853-4ad6-42b3-bb32-3f8c715029b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:29:34 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-37a3f7b1-4a7a-4d37-9795-044fcf1e6ccf tempest-VolumeQuotasNegativeTestJSON-63464544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b6cb853-4ad6-42b3-bb32-3f8c715029b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:29:35 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-37a3f7b1-4a7a-4d37-9795-044fcf1e6ccf tempest-VolumeQuotasNegativeTestJSON-63464544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa8b7869-e388-410c-a13d-17a74e462bff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:29:35 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-37a3f7b1-4a7a-4d37-9795-044fcf1e6ccf tempest-VolumeQuotasNegativeTestJSON-63464544 None] Volume 9604399f-52cd-4a3c-8315-89ac244385d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9604399f-52cd-4a3c-8315-89ac244385d7', 'volume_size': 1} Jun 29 03:29:35 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-37a3f7b1-4a7a-4d37-9795-044fcf1e6ccf tempest-VolumeQuotasNegativeTestJSON-63464544 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:29:35 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-de0a052a-23d6-40c6-b3ed-ba88498bc218 tempest-VolumeRetypeWithoutMigrationTest-206488267 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:29:35 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-de0a052a-23d6-40c6-b3ed-ba88498bc218 tempest-VolumeRetypeWithoutMigrationTest-206488267 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:29:35 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-de0a052a-23d6-40c6-b3ed-ba88498bc218 tempest-VolumeRetypeWithoutMigrationTest-206488267 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:29:35 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-de0a052a-23d6-40c6-b3ed-ba88498bc218 tempest-VolumeRetypeWithoutMigrationTest-206488267 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:29:35 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-de0a052a-23d6-40c6-b3ed-ba88498bc218 tempest-VolumeRetypeWithoutMigrationTest-206488267 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:29:35 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-de0a052a-23d6-40c6-b3ed-ba88498bc218 tempest-VolumeRetypeWithoutMigrationTest-206488267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:29:35 devstack sudo[103781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf Jun 29 03:29:35 devstack sudo[103781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:29:35 devstack sudo[103451]: pam_unix(sudo:session): session closed for user root Jun 29 03:29:35 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-f6e3ae3b-00b1-4775-a4fa-fdd9794dde5a tempest-VolumesCloneTest-532724764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-4f6f99ba-6c2f-43c7-b151-67131f4ebf53 1073741824" returned: 0 in 1.129s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:29:35 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-f6e3ae3b-00b1-4775-a4fa-fdd9794dde5a tempest-VolumesCloneTest-532724764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-4f6f99ba-6c2f-43c7-b151-67131f4ebf53 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:29:35 devstack sudo[103820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-4f6f99ba-6c2f-43c7-b151-67131f4ebf53 Jun 29 03:29:35 devstack sudo[103820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:29:36 devstack sudo[103781]: pam_unix(sudo:session): session closed for user root Jun 29 03:29:36 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-de0a052a-23d6-40c6-b3ed-ba88498bc218 tempest-VolumeRetypeWithoutMigrationTest-206488267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf" returned: 0 in 1.310s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:29:36 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-de0a052a-23d6-40c6-b3ed-ba88498bc218 tempest-VolumeRetypeWithoutMigrationTest-206488267 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:29:36 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-de0a052a-23d6-40c6-b3ed-ba88498bc218 tempest-VolumeRetypeWithoutMigrationTest-206488267 None] Retype volume completed successfully. Jun 29 03:29:36 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-7d5e29ec-49c4-484f-8c84-e4a476b6c3e8 tempest-VolumeRetypeWithoutMigrationTest-206488267 None] Acquiring lock "cinder-58318f6e-46f5-4d04-9cbe-e2ec76b0a7c2-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:29:36 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-7d5e29ec-49c4-484f-8c84-e4a476b6c3e8 tempest-VolumeRetypeWithoutMigrationTest-206488267 None] Lock "cinder-58318f6e-46f5-4d04-9cbe-e2ec76b0a7c2-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:29:36 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-7d5e29ec-49c4-484f-8c84-e4a476b6c3e8 tempest-VolumeRetypeWithoutMigrationTest-206488267 None] Acquiring lock "cinder-quobyte-58318f6e-46f5-4d04-9cbe-e2ec76b0a7c2" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:29:36 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-7d5e29ec-49c4-484f-8c84-e4a476b6c3e8 tempest-VolumeRetypeWithoutMigrationTest-206488267 None] Lock "cinder-quobyte-58318f6e-46f5-4d04-9cbe-e2ec76b0a7c2" acquired by "delete_volume" :: waited 0.018s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:29:36 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e4afe90-77ba-4164-97c7-c46b556f119a]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:29:36 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-7d5e29ec-49c4-484f-8c84-e4a476b6c3e8 tempest-VolumeRetypeWithoutMigrationTest-206488267 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-58318f6e-46f5-4d04-9cbe-e2ec76b0a7c2 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:29:37 devstack sudo[103820]: pam_unix(sudo:session): session closed for user root Jun 29 03:29:37 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-f6e3ae3b-00b1-4775-a4fa-fdd9794dde5a tempest-VolumesCloneTest-532724764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-4f6f99ba-6c2f-43c7-b151-67131f4ebf53" returned: 0 in 1.232s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:29:37 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-f6e3ae3b-00b1-4775-a4fa-fdd9794dde5a tempest-VolumesCloneTest-532724764 None] <== create_volume: return (2465ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:29:37 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-f6e3ae3b-00b1-4775-a4fa-fdd9794dde5a tempest-VolumesCloneTest-532724764 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.469s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:29:37 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-37a3f7b1-4a7a-4d37-9795-044fcf1e6ccf tempest-VolumeQuotasNegativeTestJSON-63464544 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.106s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:29:37 devstack sudo[103855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-58318f6e-46f5-4d04-9cbe-e2ec76b0a7c2 Jun 29 03:29:37 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-37a3f7b1-4a7a-4d37-9795-044fcf1e6ccf tempest-VolumeQuotasNegativeTestJSON-63464544 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:29:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1829397522',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9604399f-52cd-4a3c-8315-89ac244385d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfbe4d77b617437785016b2e65581609',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:29:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:29:35Z,use_quota=True,user_id='7a2e95ccc16f409b97658632ba51a75b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:29:37 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-37a3f7b1-4a7a-4d37-9795-044fcf1e6ccf tempest-VolumeQuotasNegativeTestJSON-63464544 None] Creating volume 9604399f-52cd-4a3c-8315-89ac244385d7 {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:29:37 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-37a3f7b1-4a7a-4d37-9795-044fcf1e6ccf tempest-VolumeQuotasNegativeTestJSON-63464544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:29:37 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-37a3f7b1-4a7a-4d37-9795-044fcf1e6ccf tempest-VolumeQuotasNegativeTestJSON-63464544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:29:37 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-37a3f7b1-4a7a-4d37-9795-044fcf1e6ccf tempest-VolumeQuotasNegativeTestJSON-63464544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:29:37 devstack sudo[103855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:29:37 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-37a3f7b1-4a7a-4d37-9795-044fcf1e6ccf tempest-VolumeQuotasNegativeTestJSON-63464544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:29:37 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-37a3f7b1-4a7a-4d37-9795-044fcf1e6ccf tempest-VolumeQuotasNegativeTestJSON-63464544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:29:37 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-37a3f7b1-4a7a-4d37-9795-044fcf1e6ccf tempest-VolumeQuotasNegativeTestJSON-63464544 None] Selected osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:29:37 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-37a3f7b1-4a7a-4d37-9795-044fcf1e6ccf tempest-VolumeQuotasNegativeTestJSON-63464544 None] casted to osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f Jun 29 03:29:37 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-37a3f7b1-4a7a-4d37-9795-044fcf1e6ccf tempest-VolumeQuotasNegativeTestJSON-63464544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9604399f-52cd-4a3c-8315-89ac244385d7 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:29:37 devstack sudo[103857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9604399f-52cd-4a3c-8315-89ac244385d7 1073741824 Jun 29 03:29:37 devstack sudo[103857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:29:37 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-f6e3ae3b-00b1-4775-a4fa-fdd9794dde5a tempest-VolumesCloneTest-532724764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db03c132-c230-46d4-b0b3-fa014249c157) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f6f99ba-6c2f-43c7-b151-67131f4ebf53', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:29:37 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-f6e3ae3b-00b1-4775-a4fa-fdd9794dde5a tempest-VolumesCloneTest-532724764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c25aade-4d3a-486c-a761-3ea4410ab99d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:29:37 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-f6e3ae3b-00b1-4775-a4fa-fdd9794dde5a tempest-VolumesCloneTest-532724764 None] Volume volume-4f6f99ba-6c2f-43c7-b151-67131f4ebf53 (4f6f99ba-6c2f-43c7-b151-67131f4ebf53): created successfully Jun 29 03:29:37 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-f6e3ae3b-00b1-4775-a4fa-fdd9794dde5a tempest-VolumesCloneTest-532724764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c25aade-4d3a-486c-a761-3ea4410ab99d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:29:37 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-f6e3ae3b-00b1-4775-a4fa-fdd9794dde5a tempest-VolumesCloneTest-532724764 None] Flow 'volume_create_manager' (f2a59a22-e45d-4759-b552-b6ca010ab044) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:29:37 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-f6e3ae3b-00b1-4775-a4fa-fdd9794dde5a tempest-VolumesCloneTest-532724764 None] Created volume successfully. Jun 29 03:29:37 devstack sudo[103855]: pam_unix(sudo:session): session closed for user root Jun 29 03:29:37 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-7d5e29ec-49c4-484f-8c84-e4a476b6c3e8 tempest-VolumeRetypeWithoutMigrationTest-206488267 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-58318f6e-46f5-4d04-9cbe-e2ec76b0a7c2" returned: 0 in 0.862s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:29:37 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-7d5e29ec-49c4-484f-8c84-e4a476b6c3e8 tempest-VolumeRetypeWithoutMigrationTest-206488267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-58318f6e-46f5-4d04-9cbe-e2ec76b0a7c2 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:29:37 devstack sudo[103867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-58318f6e-46f5-4d04-9cbe-e2ec76b0a7c2 Jun 29 03:29:37 devstack sudo[103867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:29:38 devstack sudo[103857]: pam_unix(sudo:session): session closed for user root Jun 29 03:29:38 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-37a3f7b1-4a7a-4d37-9795-044fcf1e6ccf tempest-VolumeQuotasNegativeTestJSON-63464544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9604399f-52cd-4a3c-8315-89ac244385d7 1073741824" returned: 0 in 1.293s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:29:38 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-37a3f7b1-4a7a-4d37-9795-044fcf1e6ccf tempest-VolumeQuotasNegativeTestJSON-63464544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9604399f-52cd-4a3c-8315-89ac244385d7 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:29:38 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca915f30-2b6f-4fc0-b77e-cff1a7734334 tempest-VolumesCloneTest-532724764 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:29:38 devstack sudo[103870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9604399f-52cd-4a3c-8315-89ac244385d7 Jun 29 03:29:38 devstack sudo[103870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:29:38 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-ca915f30-2b6f-4fc0-b77e-cff1a7734334 tempest-VolumesCloneTest-532724764 None] Flow 'volume_create_manager' (7d0e08ba-7047-4133-8700-a22d34535849) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:29:38 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-ca915f30-2b6f-4fc0-b77e-cff1a7734334 tempest-VolumesCloneTest-532724764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16728a2b-df19-4707-9850-2dd62441d8ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:29:38 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-ca915f30-2b6f-4fc0-b77e-cff1a7734334 tempest-VolumesCloneTest-532724764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16728a2b-df19-4707-9850-2dd62441d8ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:29:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1032594879',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3271aaa3-d73f-4051-b958-3cac670f2b1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e309341479c6400f88397e9d1e89c4ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:29:38Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=4f6f99ba-6c2f-43c7-b151-67131f4ebf53,status='creating',terminated_at=None,updated_at=2026-06-29T01:29:38Z,use_quota=True,user_id='0b1552ba6cd24deca118269d246d51e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:29:38 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-ca915f30-2b6f-4fc0-b77e-cff1a7734334 tempest-VolumesCloneTest-532724764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eac850b9-4663-4090-afc1-dd02943a9c2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:29:38 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-ca915f30-2b6f-4fc0-b77e-cff1a7734334 tempest-VolumesCloneTest-532724764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eac850b9-4663-4090-afc1-dd02943a9c2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:29:38 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-ca915f30-2b6f-4fc0-b77e-cff1a7734334 tempest-VolumesCloneTest-532724764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e02fef3-7604-4ce5-b023-2c88aa149db0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:29:38 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-ca915f30-2b6f-4fc0-b77e-cff1a7734334 tempest-VolumesCloneTest-532724764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e02fef3-7604-4ce5-b023-2c88aa149db0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '3271aaa3-d73f-4051-b958-3cac670f2b1c', 'volume_name': 'volume-3271aaa3-d73f-4051-b958-3cac670f2b1c', 'volume_size': 2, 'source_volid': '4f6f99ba-6c2f-43c7-b151-67131f4ebf53', 'source_volstatus': 'available'}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:29:38 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-ca915f30-2b6f-4fc0-b77e-cff1a7734334 tempest-VolumesCloneTest-532724764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcc393db-2bc0-4f2d-a768-63545fda86a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:29:38 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-ca915f30-2b6f-4fc0-b77e-cff1a7734334 tempest-VolumesCloneTest-532724764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcc393db-2bc0-4f2d-a768-63545fda86a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:29:38 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-ca915f30-2b6f-4fc0-b77e-cff1a7734334 tempest-VolumesCloneTest-532724764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c34ce2e-873d-4f65-b983-c38cf5da6a11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:29:38 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-ca915f30-2b6f-4fc0-b77e-cff1a7734334 tempest-VolumesCloneTest-532724764 None] Volume 3271aaa3-d73f-4051-b958-3cac670f2b1c: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-3271aaa3-d73f-4051-b958-3cac670f2b1c', 'volume_size': 2, 'source_volid': '4f6f99ba-6c2f-43c7-b151-67131f4ebf53', 'source_volstatus': 'available'} Jun 29 03:29:38 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-ca915f30-2b6f-4fc0-b77e-cff1a7734334 tempest-VolumesCloneTest-532724764 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:29:38 devstack sudo[103867]: pam_unix(sudo:session): session closed for user root Jun 29 03:29:38 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-7d5e29ec-49c4-484f-8c84-e4a476b6c3e8 tempest-VolumeRetypeWithoutMigrationTest-206488267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-58318f6e-46f5-4d04-9cbe-e2ec76b0a7c2" returned: 0 in 1.026s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:29:38 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-7d5e29ec-49c4-484f-8c84-e4a476b6c3e8 tempest-VolumeRetypeWithoutMigrationTest-206488267 None] Lock "cinder-quobyte-58318f6e-46f5-4d04-9cbe-e2ec76b0a7c2" released by "delete_volume" :: held 1.972s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:29:39 devstack cinder-volume[93468]: WARNING cinder.quota [None req-7d5e29ec-49c4-484f-8c84-e4a476b6c3e8 tempest-VolumeRetypeWithoutMigrationTest-206488267 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jun 29 03:29:39 devstack cinder-volume[93468]: WARNING cinder.quota [None req-7d5e29ec-49c4-484f-8c84-e4a476b6c3e8 tempest-VolumeRetypeWithoutMigrationTest-206488267 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jun 29 03:29:39 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-7d5e29ec-49c4-484f-8c84-e4a476b6c3e8 tempest-VolumeRetypeWithoutMigrationTest-206488267 None] Created reservations ['653e3450-ff56-4132-9239-9ad01e4ccbc4', 'bacc4b7a-1d46-4522-8861-b0ae8f31eded', 'b4465082-b1aa-4f77-afa0-2ed1a40e1f60', 'd933a9f0-4d48-40d7-851d-cbb45930c2d8'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:29:39 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-7d5e29ec-49c4-484f-8c84-e4a476b6c3e8 tempest-VolumeRetypeWithoutMigrationTest-206488267 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:29:39 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-7d5e29ec-49c4-484f-8c84-e4a476b6c3e8 tempest-VolumeRetypeWithoutMigrationTest-206488267 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:29:39 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-7d5e29ec-49c4-484f-8c84-e4a476b6c3e8 tempest-VolumeRetypeWithoutMigrationTest-206488267 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:29:39 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-7d5e29ec-49c4-484f-8c84-e4a476b6c3e8 tempest-VolumeRetypeWithoutMigrationTest-206488267 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:29:39 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-7d5e29ec-49c4-484f-8c84-e4a476b6c3e8 tempest-VolumeRetypeWithoutMigrationTest-206488267 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:29:39 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-7d5e29ec-49c4-484f-8c84-e4a476b6c3e8 tempest-VolumeRetypeWithoutMigrationTest-206488267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:29:39 devstack sudo[103870]: pam_unix(sudo:session): session closed for user root Jun 29 03:29:39 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-37a3f7b1-4a7a-4d37-9795-044fcf1e6ccf tempest-VolumeQuotasNegativeTestJSON-63464544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9604399f-52cd-4a3c-8315-89ac244385d7" returned: 0 in 0.739s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:29:39 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-37a3f7b1-4a7a-4d37-9795-044fcf1e6ccf tempest-VolumeQuotasNegativeTestJSON-63464544 None] <== create_volume: return (2120ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:29:39 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-37a3f7b1-4a7a-4d37-9795-044fcf1e6ccf tempest-VolumeQuotasNegativeTestJSON-63464544 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.127s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:29:39 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-ca915f30-2b6f-4fc0-b77e-cff1a7734334 tempest-VolumesCloneTest-532724764 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.567s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:29:39 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-ca915f30-2b6f-4fc0-b77e-cff1a7734334 tempest-VolumesCloneTest-532724764 None] Cloning volume 4f6f99ba-6c2f-43c7-b151-67131f4ebf53 to volume 3271aaa3-d73f-4051-b958-3cac670f2b1c Jun 29 03:29:39 devstack sudo[103886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf Jun 29 03:29:39 devstack sudo[103886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:29:39 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-37a3f7b1-4a7a-4d37-9795-044fcf1e6ccf tempest-VolumeQuotasNegativeTestJSON-63464544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa8b7869-e388-410c-a13d-17a74e462bff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9604399f-52cd-4a3c-8315-89ac244385d7', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:29:39 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-37a3f7b1-4a7a-4d37-9795-044fcf1e6ccf tempest-VolumeQuotasNegativeTestJSON-63464544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73c34384-aa5e-40c5-99cb-25e0701d6dff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:29:39 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-37a3f7b1-4a7a-4d37-9795-044fcf1e6ccf tempest-VolumeQuotasNegativeTestJSON-63464544 None] Volume volume-9604399f-52cd-4a3c-8315-89ac244385d7 (9604399f-52cd-4a3c-8315-89ac244385d7): created successfully Jun 29 03:29:39 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-37a3f7b1-4a7a-4d37-9795-044fcf1e6ccf tempest-VolumeQuotasNegativeTestJSON-63464544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73c34384-aa5e-40c5-99cb-25e0701d6dff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:29:39 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-37a3f7b1-4a7a-4d37-9795-044fcf1e6ccf tempest-VolumeQuotasNegativeTestJSON-63464544 None] Flow 'volume_create_manager' (b06bb324-2dea-466a-8293-51c3d453ed32) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:29:39 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-ca915f30-2b6f-4fc0-b77e-cff1a7734334 tempest-VolumesCloneTest-532724764 None] Creating offline snapshot 4f7390a5-c764-4b7a-b314-7dfa5ba2440b of volume 4f6f99ba-6c2f-43c7-b151-67131f4ebf53 {{(pid=93468) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 29 03:29:39 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-37a3f7b1-4a7a-4d37-9795-044fcf1e6ccf tempest-VolumeQuotasNegativeTestJSON-63464544 None] Created volume successfully. Jun 29 03:29:39 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7e7a54f-6ef1-4c1d-b500-5ef6c74dc478]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:29:39 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ca915f30-2b6f-4fc0-b77e-cff1a7734334 tempest-VolumesCloneTest-532724764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-4f6f99ba-6c2f-43c7-b151-67131f4ebf53 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:29:39 devstack sudo[103910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-4f6f99ba-6c2f-43c7-b151-67131f4ebf53 Jun 29 03:29:39 devstack sudo[103910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:29:40 devstack sudo[103886]: pam_unix(sudo:session): session closed for user root Jun 29 03:29:40 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-7d5e29ec-49c4-484f-8c84-e4a476b6c3e8 tempest-VolumeRetypeWithoutMigrationTest-206488267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf" returned: 0 in 0.859s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:29:40 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-7d5e29ec-49c4-484f-8c84-e4a476b6c3e8 tempest-VolumeRetypeWithoutMigrationTest-206488267 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:29:40 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-7d5e29ec-49c4-484f-8c84-e4a476b6c3e8 tempest-VolumeRetypeWithoutMigrationTest-206488267 None] Deleted volume successfully. Jun 29 03:29:40 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-7d5e29ec-49c4-484f-8c84-e4a476b6c3e8 tempest-VolumeRetypeWithoutMigrationTest-206488267 None] Lock "cinder-58318f6e-46f5-4d04-9cbe-e2ec76b0a7c2-delete_volume" released by "delete_volume" :: held 3.231s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:29:40 devstack sudo[103910]: pam_unix(sudo:session): session closed for user root Jun 29 03:29:40 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ca915f30-2b6f-4fc0-b77e-cff1a7734334 tempest-VolumesCloneTest-532724764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-4f6f99ba-6c2f-43c7-b151-67131f4ebf53" returned: 0 in 1.091s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:29:40 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ca915f30-2b6f-4fc0-b77e-cff1a7734334 tempest-VolumesCloneTest-532724764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-4f6f99ba-6c2f-43c7-b151-67131f4ebf53,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-4f6f99ba-6c2f-43c7-b151-67131f4ebf53.4f7390a5-c764-4b7a-b314-7dfa5ba2440b 1G {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:29:40 devstack sudo[103918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-4f6f99ba-6c2f-43c7-b151-67131f4ebf53,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-4f6f99ba-6c2f-43c7-b151-67131f4ebf53.4f7390a5-c764-4b7a-b314-7dfa5ba2440b 1G Jun 29 03:29:40 devstack sudo[103918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:29:41 devstack sudo[103918]: pam_unix(sudo:session): session closed for user root Jun 29 03:29:41 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ca915f30-2b6f-4fc0-b77e-cff1a7734334 tempest-VolumesCloneTest-532724764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-4f6f99ba-6c2f-43c7-b151-67131f4ebf53,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-4f6f99ba-6c2f-43c7-b151-67131f4ebf53.4f7390a5-c764-4b7a-b314-7dfa5ba2440b 1G" returned: 0 in 1.094s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:29:41 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ca915f30-2b6f-4fc0-b77e-cff1a7734334 tempest-VolumesCloneTest-532724764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4f6f99ba-6c2f-43c7-b151-67131f4ebf53 -F qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-4f6f99ba-6c2f-43c7-b151-67131f4ebf53.4f7390a5-c764-4b7a-b314-7dfa5ba2440b {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:29:41 devstack sudo[103925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4f6f99ba-6c2f-43c7-b151-67131f4ebf53 -F qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-4f6f99ba-6c2f-43c7-b151-67131f4ebf53.4f7390a5-c764-4b7a-b314-7dfa5ba2440b Jun 29 03:29:41 devstack sudo[103925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:29:41 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-e1b6a8c9-9006-4cc1-879a-805902288be6 tempest-VolumeQuotasNegativeTestJSON-63464544 None] Acquiring lock "cinder-9604399f-52cd-4a3c-8315-89ac244385d7-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:29:41 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-e1b6a8c9-9006-4cc1-879a-805902288be6 tempest-VolumeQuotasNegativeTestJSON-63464544 None] Lock "cinder-9604399f-52cd-4a3c-8315-89ac244385d7-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:29:41 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-e1b6a8c9-9006-4cc1-879a-805902288be6 tempest-VolumeQuotasNegativeTestJSON-63464544 None] Acquiring lock "cinder-quobyte-9604399f-52cd-4a3c-8315-89ac244385d7" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:29:41 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-e1b6a8c9-9006-4cc1-879a-805902288be6 tempest-VolumeQuotasNegativeTestJSON-63464544 None] Lock "cinder-quobyte-9604399f-52cd-4a3c-8315-89ac244385d7" acquired by "delete_volume" :: waited 0.024s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:29:41 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[6375842a-986f-4ed6-8492-14fa50581523]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:29:41 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-e1b6a8c9-9006-4cc1-879a-805902288be6 tempest-VolumeQuotasNegativeTestJSON-63464544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9604399f-52cd-4a3c-8315-89ac244385d7 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:29:42 devstack sudo[103927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9604399f-52cd-4a3c-8315-89ac244385d7 Jun 29 03:29:42 devstack sudo[103927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:29:42 devstack sudo[103925]: pam_unix(sudo:session): session closed for user root Jun 29 03:29:42 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ca915f30-2b6f-4fc0-b77e-cff1a7734334 tempest-VolumesCloneTest-532724764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4f6f99ba-6c2f-43c7-b151-67131f4ebf53 -F qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-4f6f99ba-6c2f-43c7-b151-67131f4ebf53.4f7390a5-c764-4b7a-b314-7dfa5ba2440b" returned: 0 in 1.016s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:29:42 devstack cinder-volume[93468]: WARNING cinder.volume.drivers.remotefs [None req-ca915f30-2b6f-4fc0-b77e-cff1a7734334 tempest-VolumesCloneTest-532724764 None] /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-4f6f99ba-6c2f-43c7-b151-67131f4ebf53.4f7390a5-c764-4b7a-b314-7dfa5ba2440b is being set with open permissions: ugo+rw Jun 29 03:29:42 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ca915f30-2b6f-4fc0-b77e-cff1a7734334 tempest-VolumesCloneTest-532724764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-4f6f99ba-6c2f-43c7-b151-67131f4ebf53.4f7390a5-c764-4b7a-b314-7dfa5ba2440b {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:29:42 devstack sudo[103932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-4f6f99ba-6c2f-43c7-b151-67131f4ebf53.4f7390a5-c764-4b7a-b314-7dfa5ba2440b Jun 29 03:29:42 devstack sudo[103932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:29:42 devstack sudo[103927]: pam_unix(sudo:session): session closed for user root Jun 29 03:29:42 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-e1b6a8c9-9006-4cc1-879a-805902288be6 tempest-VolumeQuotasNegativeTestJSON-63464544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9604399f-52cd-4a3c-8315-89ac244385d7" returned: 0 in 1.087s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:29:42 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-e1b6a8c9-9006-4cc1-879a-805902288be6 tempest-VolumeQuotasNegativeTestJSON-63464544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9604399f-52cd-4a3c-8315-89ac244385d7 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:29:42 devstack sudo[103938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9604399f-52cd-4a3c-8315-89ac244385d7 Jun 29 03:29:42 devstack sudo[103938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:29:43 devstack sudo[103932]: pam_unix(sudo:session): session closed for user root Jun 29 03:29:43 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ca915f30-2b6f-4fc0-b77e-cff1a7734334 tempest-VolumesCloneTest-532724764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-4f6f99ba-6c2f-43c7-b151-67131f4ebf53.4f7390a5-c764-4b7a-b314-7dfa5ba2440b" returned: 0 in 0.892s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:29:43 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ca915f30-2b6f-4fc0-b77e-cff1a7734334 tempest-VolumesCloneTest-532724764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-4f6f99ba-6c2f-43c7-b151-67131f4ebf53.info {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:29:43 devstack sudo[103942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-4f6f99ba-6c2f-43c7-b151-67131f4ebf53.info Jun 29 03:29:43 devstack sudo[103942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:29:43 devstack sudo[103938]: pam_unix(sudo:session): session closed for user root Jun 29 03:29:43 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-e1b6a8c9-9006-4cc1-879a-805902288be6 tempest-VolumeQuotasNegativeTestJSON-63464544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9604399f-52cd-4a3c-8315-89ac244385d7" returned: 0 in 0.810s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:29:43 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-e1b6a8c9-9006-4cc1-879a-805902288be6 tempest-VolumeQuotasNegativeTestJSON-63464544 None] Lock "cinder-quobyte-9604399f-52cd-4a3c-8315-89ac244385d7" released by "delete_volume" :: held 2.001s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:29:43 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-e1b6a8c9-9006-4cc1-879a-805902288be6 tempest-VolumeQuotasNegativeTestJSON-63464544 None] Created reservations ['b578172d-7f8a-4e97-90e1-78cc0dd2f117', 'f4b04b70-0ee1-49da-b1d9-95fb7e62bb46', '5a2d5b8f-d56c-4540-ae81-99a8ac6fa84e', '99fc3bc6-a89b-47ce-bc3e-6f525392168e'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:29:44 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-e1b6a8c9-9006-4cc1-879a-805902288be6 tempest-VolumeQuotasNegativeTestJSON-63464544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:29:44 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-e1b6a8c9-9006-4cc1-879a-805902288be6 tempest-VolumeQuotasNegativeTestJSON-63464544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:29:44 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-e1b6a8c9-9006-4cc1-879a-805902288be6 tempest-VolumeQuotasNegativeTestJSON-63464544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:29:44 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-e1b6a8c9-9006-4cc1-879a-805902288be6 tempest-VolumeQuotasNegativeTestJSON-63464544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:29:44 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-e1b6a8c9-9006-4cc1-879a-805902288be6 tempest-VolumeQuotasNegativeTestJSON-63464544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:29:44 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-e1b6a8c9-9006-4cc1-879a-805902288be6 tempest-VolumeQuotasNegativeTestJSON-63464544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:29:44 devstack sudo[103945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf Jun 29 03:29:44 devstack sudo[103945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:29:44 devstack sudo[103942]: pam_unix(sudo:session): session closed for user root Jun 29 03:29:44 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ca915f30-2b6f-4fc0-b77e-cff1a7734334 tempest-VolumesCloneTest-532724764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-4f6f99ba-6c2f-43c7-b151-67131f4ebf53.info" returned: 0 in 0.888s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:29:44 devstack cinder-volume[93468]: WARNING cinder.volume.drivers.remotefs [None req-ca915f30-2b6f-4fc0-b77e-cff1a7734334 tempest-VolumesCloneTest-532724764 None] /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-4f6f99ba-6c2f-43c7-b151-67131f4ebf53.info is being set with open permissions: ugo+rw Jun 29 03:29:44 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ca915f30-2b6f-4fc0-b77e-cff1a7734334 tempest-VolumesCloneTest-532724764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-4f6f99ba-6c2f-43c7-b151-67131f4ebf53.info {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:29:44 devstack sudo[103948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-4f6f99ba-6c2f-43c7-b151-67131f4ebf53.info Jun 29 03:29:44 devstack sudo[103948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:29:45 devstack sudo[103945]: pam_unix(sudo:session): session closed for user root Jun 29 03:29:45 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-e1b6a8c9-9006-4cc1-879a-805902288be6 tempest-VolumeQuotasNegativeTestJSON-63464544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf" returned: 0 in 1.217s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:29:45 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-e1b6a8c9-9006-4cc1-879a-805902288be6 tempest-VolumeQuotasNegativeTestJSON-63464544 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:29:45 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-e1b6a8c9-9006-4cc1-879a-805902288be6 tempest-VolumeQuotasNegativeTestJSON-63464544 None] Deleted volume successfully. Jun 29 03:29:45 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-e1b6a8c9-9006-4cc1-879a-805902288be6 tempest-VolumeQuotasNegativeTestJSON-63464544 None] Lock "cinder-9604399f-52cd-4a3c-8315-89ac244385d7-delete_volume" released by "delete_volume" :: held 3.570s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:29:45 devstack sudo[103948]: pam_unix(sudo:session): session closed for user root Jun 29 03:29:45 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ca915f30-2b6f-4fc0-b77e-cff1a7734334 tempest-VolumesCloneTest-532724764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-4f6f99ba-6c2f-43c7-b151-67131f4ebf53.info" returned: 0 in 1.150s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:29:45 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-ca915f30-2b6f-4fc0-b77e-cff1a7734334 tempest-VolumesCloneTest-532724764 None] Acquiring lock "cinder-quobyte-3271aaa3-d73f-4051-b958-3cac670f2b1c" by "_copy_volume_from_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:29:45 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-ca915f30-2b6f-4fc0-b77e-cff1a7734334 tempest-VolumesCloneTest-532724764 None] Lock "cinder-quobyte-3271aaa3-d73f-4051-b958-3cac670f2b1c" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:29:45 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-ca915f30-2b6f-4fc0-b77e-cff1a7734334 tempest-VolumesCloneTest-532724764 None] snapshot: 4f7390a5-c764-4b7a-b314-7dfa5ba2440b, volume: 3271aaa3-d73f-4051-b958-3cac670f2b1c, {{(pid=93468) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 29 03:29:45 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-ca915f30-2b6f-4fc0-b77e-cff1a7734334 tempest-VolumesCloneTest-532724764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:29:45 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-ca915f30-2b6f-4fc0-b77e-cff1a7734334 tempest-VolumesCloneTest-532724764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:29:45 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-ca915f30-2b6f-4fc0-b77e-cff1a7734334 tempest-VolumesCloneTest-532724764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:29:45 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-ca915f30-2b6f-4fc0-b77e-cff1a7734334 tempest-VolumesCloneTest-532724764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:29:45 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-ca915f30-2b6f-4fc0-b77e-cff1a7734334 tempest-VolumesCloneTest-532724764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:29:45 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[677c697e-e348-4c0a-9375-14f586a5e3da]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:29:45 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ca915f30-2b6f-4fc0-b77e-cff1a7734334 tempest-VolumesCloneTest-532724764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-4f6f99ba-6c2f-43c7-b151-67131f4ebf53.4f7390a5-c764-4b7a-b314-7dfa5ba2440b {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:29:45 devstack sudo[103952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-4f6f99ba-6c2f-43c7-b151-67131f4ebf53.4f7390a5-c764-4b7a-b314-7dfa5ba2440b Jun 29 03:29:45 devstack sudo[103952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:29:46 devstack sudo[103952]: pam_unix(sudo:session): session closed for user root Jun 29 03:29:46 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ca915f30-2b6f-4fc0-b77e-cff1a7734334 tempest-VolumesCloneTest-532724764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-4f6f99ba-6c2f-43c7-b151-67131f4ebf53.4f7390a5-c764-4b7a-b314-7dfa5ba2440b" returned: 0 in 1.159s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:29:46 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-ca915f30-2b6f-4fc0-b77e-cff1a7734334 tempest-VolumesCloneTest-532724764 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4f6f99ba-6c2f-43c7-b151-67131f4ebf53(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93468) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 29 03:29:46 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-ca915f30-2b6f-4fc0-b77e-cff1a7734334 tempest-VolumesCloneTest-532724764 None] will copy from snapshot at /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-4f6f99ba-6c2f-43c7-b151-67131f4ebf53 {{(pid=93468) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 29 03:29:46 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-ca915f30-2b6f-4fc0-b77e-cff1a7734334 tempest-VolumesCloneTest-532724764 None] Creating direct copy from snapshot {{(pid=93468) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 29 03:29:46 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d0cf8db-22c1-427f-b3c3-0dfa0dd89213]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:29:46 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ca915f30-2b6f-4fc0-b77e-cff1a7734334 tempest-VolumesCloneTest-532724764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-4f6f99ba-6c2f-43c7-b151-67131f4ebf53 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:29:47 devstack sudo[103958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-4f6f99ba-6c2f-43c7-b151-67131f4ebf53 Jun 29 03:29:47 devstack sudo[103958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:29:47 devstack sudo[103958]: pam_unix(sudo:session): session closed for user root Jun 29 03:29:47 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ca915f30-2b6f-4fc0-b77e-cff1a7734334 tempest-VolumesCloneTest-532724764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-4f6f99ba-6c2f-43c7-b151-67131f4ebf53" returned: 0 in 1.076s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:29:47 devstack cinder-volume[93468]: DEBUG cinder.utils [None req-ca915f30-2b6f-4fc0-b77e-cff1a7734334 tempest-VolumesCloneTest-532724764 None] Path /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-3271aaa3-d73f-4051-b958-3cac670f2b1c not found in is_blk_device check {{(pid=93468) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 29 03:29:47 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ca915f30-2b6f-4fc0-b77e-cff1a7734334 tempest-VolumesCloneTest-532724764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-4f6f99ba-6c2f-43c7-b151-67131f4ebf53 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-3271aaa3-d73f-4051-b958-3cac670f2b1c {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:29:47 devstack sudo[103964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-4f6f99ba-6c2f-43c7-b151-67131f4ebf53 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-3271aaa3-d73f-4051-b958-3cac670f2b1c Jun 29 03:29:47 devstack sudo[103964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:29:54 devstack cinder-volume[93468]: DEBUG dbcounter [-] [93468] Writing DB stats cinder:SELECT=22,cinder:UPDATE=30,cinder:INSERT=9,cinder:DELETE=3 {{(pid=93468) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 29 03:29:54 devstack sudo[103964]: pam_unix(sudo:session): session closed for user root Jun 29 03:29:54 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ca915f30-2b6f-4fc0-b77e-cff1a7734334 tempest-VolumesCloneTest-532724764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-4f6f99ba-6c2f-43c7-b151-67131f4ebf53 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-3271aaa3-d73f-4051-b958-3cac670f2b1c" returned: 0 in 6.794s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:29:54 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[042b3351-d727-415e-befa-f23f63a64b92]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:29:54 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ca915f30-2b6f-4fc0-b77e-cff1a7734334 tempest-VolumesCloneTest-532724764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-4f6f99ba-6c2f-43c7-b151-67131f4ebf53 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:29:54 devstack sudo[104009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-4f6f99ba-6c2f-43c7-b151-67131f4ebf53 Jun 29 03:29:54 devstack sudo[104009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:29:55 devstack cinder-volume[93468]: DEBUG dbcounter [-] [93468] Writing DB stats cinder:SELECT=31,cinder:UPDATE=30,cinder:INSERT=4,cinder:DELETE=2 {{(pid=93468) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 29 03:29:55 devstack sudo[104009]: pam_unix(sudo:session): session closed for user root Jun 29 03:29:55 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ca915f30-2b6f-4fc0-b77e-cff1a7734334 tempest-VolumesCloneTest-532724764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-4f6f99ba-6c2f-43c7-b151-67131f4ebf53" returned: 0 in 0.985s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:29:55 devstack cinder-volume[93468]: DEBUG cinder.image.image_utils [None req-ca915f30-2b6f-4fc0-b77e-cff1a7734334 tempest-VolumesCloneTest-532724764 None] Image conversion details: src /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-4f6f99ba-6c2f-43c7-b151-67131f4ebf53, size 1024.00 MB, duration 6.80 sec, destination /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-3271aaa3-d73f-4051-b958-3cac670f2b1c {{(pid=93468) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 29 03:29:55 devstack cinder-volume[93468]: INFO cinder.image.image_utils [None req-ca915f30-2b6f-4fc0-b77e-cff1a7734334 tempest-VolumesCloneTest-532724764 None] Converted 1024.00 MB image at 150.67 MB/s Jun 29 03:29:55 devstack cinder-volume[93468]: WARNING cinder.volume.drivers.remotefs [None req-ca915f30-2b6f-4fc0-b77e-cff1a7734334 tempest-VolumesCloneTest-532724764 None] /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-3271aaa3-d73f-4051-b958-3cac670f2b1c is being set with open permissions: ugo+rw Jun 29 03:29:55 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ca915f30-2b6f-4fc0-b77e-cff1a7734334 tempest-VolumesCloneTest-532724764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-3271aaa3-d73f-4051-b958-3cac670f2b1c {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:29:55 devstack sudo[104014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-3271aaa3-d73f-4051-b958-3cac670f2b1c Jun 29 03:29:55 devstack sudo[104014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:29:56 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5c7cea6-33c5-4295-ada4-a88b69136f61 tempest-VolumeTypesAccessTest-579047537 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:29:56 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-f5c7cea6-33c5-4295-ada4-a88b69136f61 tempest-VolumeTypesAccessTest-579047537 None] Flow 'volume_create_manager' (e434b3f6-6cf0-47a7-a105-24e550362bdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:29:56 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-f5c7cea6-33c5-4295-ada4-a88b69136f61 tempest-VolumeTypesAccessTest-579047537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11b270ef-d65d-4f38-ac40-69bf4c145afb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:29:56 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-f5c7cea6-33c5-4295-ada4-a88b69136f61 tempest-VolumeTypesAccessTest-579047537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11b270ef-d65d-4f38-ac40-69bf4c145afb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:29:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1164007218',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf3ef9a7-6290-4465-8535-aaea318cc025,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1551053dfc54a0e84c5e6abb0b95f4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:29:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:29:56Z,use_quota=True,user_id='2bba99fa578241ae82291ca283343298',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a9dead6-67ef-4816-9dc8-49e5a79c33b2),volume_type_id=7a9dead6-67ef-4816-9dc8-49e5a79c33b2)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:29:56 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-f5c7cea6-33c5-4295-ada4-a88b69136f61 tempest-VolumeTypesAccessTest-579047537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21ca8e75-bce5-4d7d-9bf4-6d1a8f4fd00f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:29:56 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-f5c7cea6-33c5-4295-ada4-a88b69136f61 tempest-VolumeTypesAccessTest-579047537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21ca8e75-bce5-4d7d-9bf4-6d1a8f4fd00f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:29:56 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-f5c7cea6-33c5-4295-ada4-a88b69136f61 tempest-VolumeTypesAccessTest-579047537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4208f09-b259-401e-b56d-762764afff64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:29:56 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-f5c7cea6-33c5-4295-ada4-a88b69136f61 tempest-VolumeTypesAccessTest-579047537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4208f09-b259-401e-b56d-762764afff64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cf3ef9a7-6290-4465-8535-aaea318cc025', 'volume_name': 'volume-cf3ef9a7-6290-4465-8535-aaea318cc025', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:29:56 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-f5c7cea6-33c5-4295-ada4-a88b69136f61 tempest-VolumeTypesAccessTest-579047537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0377d819-b8c6-4b31-a857-f266dbf9a134) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:29:56 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-f5c7cea6-33c5-4295-ada4-a88b69136f61 tempest-VolumeTypesAccessTest-579047537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0377d819-b8c6-4b31-a857-f266dbf9a134) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:29:56 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-f5c7cea6-33c5-4295-ada4-a88b69136f61 tempest-VolumeTypesAccessTest-579047537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4da2221-c9b9-4e2f-a127-6cfa79225341) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:29:56 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-f5c7cea6-33c5-4295-ada4-a88b69136f61 tempest-VolumeTypesAccessTest-579047537 None] Volume cf3ef9a7-6290-4465-8535-aaea318cc025: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cf3ef9a7-6290-4465-8535-aaea318cc025', 'volume_size': 1} Jun 29 03:29:56 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-f5c7cea6-33c5-4295-ada4-a88b69136f61 tempest-VolumeTypesAccessTest-579047537 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:29:56 devstack sudo[104014]: pam_unix(sudo:session): session closed for user root Jun 29 03:29:56 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ca915f30-2b6f-4fc0-b77e-cff1a7734334 tempest-VolumesCloneTest-532724764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-3271aaa3-d73f-4051-b958-3cac670f2b1c" returned: 0 in 0.691s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:29:56 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-ca915f30-2b6f-4fc0-b77e-cff1a7734334 tempest-VolumesCloneTest-532724764 None] Lock "cinder-quobyte-3271aaa3-d73f-4051-b958-3cac670f2b1c" released by "_copy_volume_from_snapshot" :: held 10.822s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:29:56 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-ca915f30-2b6f-4fc0-b77e-cff1a7734334 tempest-VolumesCloneTest-532724764 None] Acquiring lock "cinder-quobyte-4f7390a5-c764-4b7a-b314-7dfa5ba2440b" by "_delete_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:29:56 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-ca915f30-2b6f-4fc0-b77e-cff1a7734334 tempest-VolumesCloneTest-532724764 None] Lock "cinder-quobyte-4f7390a5-c764-4b7a-b314-7dfa5ba2440b" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:29:56 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-ca915f30-2b6f-4fc0-b77e-cff1a7734334 tempest-VolumesCloneTest-532724764 None] Deleting offline snapshot 4f7390a5-c764-4b7a-b314-7dfa5ba2440b of volume 4f6f99ba-6c2f-43c7-b151-67131f4ebf53 {{(pid=93468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 29 03:29:56 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-ca915f30-2b6f-4fc0-b77e-cff1a7734334 tempest-VolumesCloneTest-532724764 None] snapshot_file for this snap is: volume-4f6f99ba-6c2f-43c7-b151-67131f4ebf53.4f7390a5-c764-4b7a-b314-7dfa5ba2440b {{(pid=93468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 29 03:29:56 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[126aa87a-324b-4315-99a4-3f09d3473d96]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:29:56 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ca915f30-2b6f-4fc0-b77e-cff1a7734334 tempest-VolumesCloneTest-532724764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-4f6f99ba-6c2f-43c7-b151-67131f4ebf53.4f7390a5-c764-4b7a-b314-7dfa5ba2440b {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:29:56 devstack sudo[104017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-4f6f99ba-6c2f-43c7-b151-67131f4ebf53.4f7390a5-c764-4b7a-b314-7dfa5ba2440b Jun 29 03:29:56 devstack sudo[104017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:29:57 devstack sudo[104017]: pam_unix(sudo:session): session closed for user root Jun 29 03:29:57 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ca915f30-2b6f-4fc0-b77e-cff1a7734334 tempest-VolumesCloneTest-532724764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-4f6f99ba-6c2f-43c7-b151-67131f4ebf53.4f7390a5-c764-4b7a-b314-7dfa5ba2440b" returned: 0 in 0.856s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:29:57 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-ca915f30-2b6f-4fc0-b77e-cff1a7734334 tempest-VolumesCloneTest-532724764 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4f6f99ba-6c2f-43c7-b151-67131f4ebf53(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93468) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 29 03:29:57 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf55b6ea-cfca-44ee-ac61-d84eca631b45]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:29:57 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ca915f30-2b6f-4fc0-b77e-cff1a7734334 tempest-VolumesCloneTest-532724764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-4f6f99ba-6c2f-43c7-b151-67131f4ebf53 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:29:57 devstack sudo[104023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-4f6f99ba-6c2f-43c7-b151-67131f4ebf53 Jun 29 03:29:57 devstack sudo[104023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:29:58 devstack sudo[104023]: pam_unix(sudo:session): session closed for user root Jun 29 03:29:58 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ca915f30-2b6f-4fc0-b77e-cff1a7734334 tempest-VolumesCloneTest-532724764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-4f6f99ba-6c2f-43c7-b151-67131f4ebf53" returned: 0 in 0.855s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:29:58 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ca915f30-2b6f-4fc0-b77e-cff1a7734334 tempest-VolumesCloneTest-532724764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-4f6f99ba-6c2f-43c7-b151-67131f4ebf53.4f7390a5-c764-4b7a-b314-7dfa5ba2440b {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:29:58 devstack sudo[104028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-4f6f99ba-6c2f-43c7-b151-67131f4ebf53.4f7390a5-c764-4b7a-b314-7dfa5ba2440b Jun 29 03:29:58 devstack sudo[104028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:29:59 devstack sudo[104028]: pam_unix(sudo:session): session closed for user root Jun 29 03:29:59 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ca915f30-2b6f-4fc0-b77e-cff1a7734334 tempest-VolumesCloneTest-532724764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-4f6f99ba-6c2f-43c7-b151-67131f4ebf53.4f7390a5-c764-4b7a-b314-7dfa5ba2440b" returned: 0 in 0.785s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:29:59 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ca915f30-2b6f-4fc0-b77e-cff1a7734334 tempest-VolumesCloneTest-532724764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-4f6f99ba-6c2f-43c7-b151-67131f4ebf53.4f7390a5-c764-4b7a-b314-7dfa5ba2440b {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:29:59 devstack sudo[104034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-4f6f99ba-6c2f-43c7-b151-67131f4ebf53.4f7390a5-c764-4b7a-b314-7dfa5ba2440b Jun 29 03:29:59 devstack sudo[104034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:29:59 devstack sudo[104034]: pam_unix(sudo:session): session closed for user root Jun 29 03:29:59 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ca915f30-2b6f-4fc0-b77e-cff1a7734334 tempest-VolumesCloneTest-532724764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-4f6f99ba-6c2f-43c7-b151-67131f4ebf53.4f7390a5-c764-4b7a-b314-7dfa5ba2440b" returned: 0 in 0.797s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:29:59 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-ca915f30-2b6f-4fc0-b77e-cff1a7734334 tempest-VolumesCloneTest-532724764 None] Lock "cinder-quobyte-4f7390a5-c764-4b7a-b314-7dfa5ba2440b" released by "_delete_snapshot" :: held 3.405s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:29:59 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-ca915f30-2b6f-4fc0-b77e-cff1a7734334 tempest-VolumesCloneTest-532724764 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 20.668s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:29:59 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-f5c7cea6-33c5-4295-ada4-a88b69136f61 tempest-VolumeTypesAccessTest-579047537 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.668s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:29:59 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-f5c7cea6-33c5-4295-ada4-a88b69136f61 tempest-VolumeTypesAccessTest-579047537 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:29:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1164007218',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf3ef9a7-6290-4465-8535-aaea318cc025,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1551053dfc54a0e84c5e6abb0b95f4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:29:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:29:56Z,use_quota=True,user_id='2bba99fa578241ae82291ca283343298',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a9dead6-67ef-4816-9dc8-49e5a79c33b2),volume_type_id=7a9dead6-67ef-4816-9dc8-49e5a79c33b2)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:29:59 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-f5c7cea6-33c5-4295-ada4-a88b69136f61 tempest-VolumeTypesAccessTest-579047537 None] Creating volume cf3ef9a7-6290-4465-8535-aaea318cc025 {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:29:59 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-f5c7cea6-33c5-4295-ada4-a88b69136f61 tempest-VolumeTypesAccessTest-579047537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:29:59 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-f5c7cea6-33c5-4295-ada4-a88b69136f61 tempest-VolumeTypesAccessTest-579047537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:29:59 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-f5c7cea6-33c5-4295-ada4-a88b69136f61 tempest-VolumeTypesAccessTest-579047537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:29:59 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-f5c7cea6-33c5-4295-ada4-a88b69136f61 tempest-VolumeTypesAccessTest-579047537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:29:59 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-f5c7cea6-33c5-4295-ada4-a88b69136f61 tempest-VolumeTypesAccessTest-579047537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:29:59 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-f5c7cea6-33c5-4295-ada4-a88b69136f61 tempest-VolumeTypesAccessTest-579047537 None] Selected osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:29:59 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-f5c7cea6-33c5-4295-ada4-a88b69136f61 tempest-VolumeTypesAccessTest-579047537 None] casted to osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f Jun 29 03:29:59 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-f5c7cea6-33c5-4295-ada4-a88b69136f61 tempest-VolumeTypesAccessTest-579047537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-cf3ef9a7-6290-4465-8535-aaea318cc025 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:29:59 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-ca915f30-2b6f-4fc0-b77e-cff1a7734334 tempest-VolumesCloneTest-532724764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c34ce2e-873d-4f65-b983-c38cf5da6a11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3271aaa3-d73f-4051-b958-3cac670f2b1c', 'volume_size': 2, 'source_volid': '4f6f99ba-6c2f-43c7-b151-67131f4ebf53', 'source_volstatus': 'available'}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:29:59 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-ca915f30-2b6f-4fc0-b77e-cff1a7734334 tempest-VolumesCloneTest-532724764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42810d67-a4bf-46b9-8f62-117aabac43be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:29:59 devstack sudo[104039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-cf3ef9a7-6290-4465-8535-aaea318cc025 1073741824 Jun 29 03:29:59 devstack sudo[104039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:29:59 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-ca915f30-2b6f-4fc0-b77e-cff1a7734334 tempest-VolumesCloneTest-532724764 None] Volume volume-3271aaa3-d73f-4051-b958-3cac670f2b1c (3271aaa3-d73f-4051-b958-3cac670f2b1c): created successfully Jun 29 03:29:59 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-ca915f30-2b6f-4fc0-b77e-cff1a7734334 tempest-VolumesCloneTest-532724764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42810d67-a4bf-46b9-8f62-117aabac43be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:29:59 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-ca915f30-2b6f-4fc0-b77e-cff1a7734334 tempest-VolumesCloneTest-532724764 None] Flow 'volume_create_manager' (7d0e08ba-7047-4133-8700-a22d34535849) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:30:00 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-ca915f30-2b6f-4fc0-b77e-cff1a7734334 tempest-VolumesCloneTest-532724764 None] Created volume successfully. Jun 29 03:30:00 devstack sudo[104039]: pam_unix(sudo:session): session closed for user root Jun 29 03:30:00 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-f5c7cea6-33c5-4295-ada4-a88b69136f61 tempest-VolumeTypesAccessTest-579047537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-cf3ef9a7-6290-4465-8535-aaea318cc025 1073741824" returned: 0 in 0.852s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:30:00 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-f5c7cea6-33c5-4295-ada4-a88b69136f61 tempest-VolumeTypesAccessTest-579047537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-cf3ef9a7-6290-4465-8535-aaea318cc025 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:30:00 devstack sudo[104046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-cf3ef9a7-6290-4465-8535-aaea318cc025 Jun 29 03:30:00 devstack sudo[104046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:30:01 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-ba9115ce-73cb-4043-bcea-2703f966d7e2 tempest-VolumesCloneTest-532724764 None] Acquiring lock "cinder-3271aaa3-d73f-4051-b958-3cac670f2b1c-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:30:01 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-ba9115ce-73cb-4043-bcea-2703f966d7e2 tempest-VolumesCloneTest-532724764 None] Lock "cinder-3271aaa3-d73f-4051-b958-3cac670f2b1c-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:30:01 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-ba9115ce-73cb-4043-bcea-2703f966d7e2 tempest-VolumesCloneTest-532724764 None] Acquiring lock "cinder-quobyte-3271aaa3-d73f-4051-b958-3cac670f2b1c" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:30:01 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-ba9115ce-73cb-4043-bcea-2703f966d7e2 tempest-VolumesCloneTest-532724764 None] Lock "cinder-quobyte-3271aaa3-d73f-4051-b958-3cac670f2b1c" acquired by "delete_volume" :: waited 0.017s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:30:01 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[5378e7f0-224a-41f3-a86e-e741c35adf63]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:30:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ba9115ce-73cb-4043-bcea-2703f966d7e2 tempest-VolumesCloneTest-532724764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-3271aaa3-d73f-4051-b958-3cac670f2b1c {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:30:01 devstack sudo[104049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-3271aaa3-d73f-4051-b958-3cac670f2b1c Jun 29 03:30:01 devstack sudo[104049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:30:01 devstack sudo[104046]: pam_unix(sudo:session): session closed for user root Jun 29 03:30:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-f5c7cea6-33c5-4295-ada4-a88b69136f61 tempest-VolumeTypesAccessTest-579047537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-cf3ef9a7-6290-4465-8535-aaea318cc025" returned: 0 in 0.734s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:30:01 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-f5c7cea6-33c5-4295-ada4-a88b69136f61 tempest-VolumeTypesAccessTest-579047537 None] <== create_volume: return (1640ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:30:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-f5c7cea6-33c5-4295-ada4-a88b69136f61 tempest-VolumeTypesAccessTest-579047537 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.643s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:30:01 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-f5c7cea6-33c5-4295-ada4-a88b69136f61 tempest-VolumeTypesAccessTest-579047537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4da2221-c9b9-4e2f-a127-6cfa79225341) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf3ef9a7-6290-4465-8535-aaea318cc025', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:30:01 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-f5c7cea6-33c5-4295-ada4-a88b69136f61 tempest-VolumeTypesAccessTest-579047537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69f0e085-016e-427d-b171-14c5131f7209) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:30:01 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-f5c7cea6-33c5-4295-ada4-a88b69136f61 tempest-VolumeTypesAccessTest-579047537 None] Volume volume-cf3ef9a7-6290-4465-8535-aaea318cc025 (cf3ef9a7-6290-4465-8535-aaea318cc025): created successfully Jun 29 03:30:01 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-f5c7cea6-33c5-4295-ada4-a88b69136f61 tempest-VolumeTypesAccessTest-579047537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69f0e085-016e-427d-b171-14c5131f7209) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:30:01 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-f5c7cea6-33c5-4295-ada4-a88b69136f61 tempest-VolumeTypesAccessTest-579047537 None] Flow 'volume_create_manager' (e434b3f6-6cf0-47a7-a105-24e550362bdc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:30:01 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-f5c7cea6-33c5-4295-ada4-a88b69136f61 tempest-VolumeTypesAccessTest-579047537 None] Created volume successfully. Jun 29 03:30:01 devstack cinder-volume[93468]: INFO cinder.volume.manager [req-2ea150e3-0e62-46d9-ad12-6361a1bd3273 req-283834a3-6d73-4921-8c14-ef0a4fff0091 tempest-AttachVolumeTestJSON-872616700 None] Terminate volume connection completed successfully. Jun 29 03:30:01 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [req-2ea150e3-0e62-46d9-ad12-6361a1bd3273 req-283834a3-6d73-4921-8c14-ef0a4fff0091 tempest-AttachVolumeTestJSON-872616700 None] Deleting attachment 7e59b782-98fe-4c56-9e68-0118ccc6b254. {{(pid=93468) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 29 03:30:02 devstack sudo[104049]: pam_unix(sudo:session): session closed for user root Jun 29 03:30:02 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ba9115ce-73cb-4043-bcea-2703f966d7e2 tempest-VolumesCloneTest-532724764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-3271aaa3-d73f-4051-b958-3cac670f2b1c" returned: 0 in 0.895s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:30:02 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ba9115ce-73cb-4043-bcea-2703f966d7e2 tempest-VolumesCloneTest-532724764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-3271aaa3-d73f-4051-b958-3cac670f2b1c {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:30:02 devstack sudo[104065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-3271aaa3-d73f-4051-b958-3cac670f2b1c Jun 29 03:30:02 devstack sudo[104065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:30:02 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-49c9a81a-8a58-46c1-8643-82f737214717 tempest-VolumeTypesAccessTest-579047537 None] Acquiring lock "cinder-cf3ef9a7-6290-4465-8535-aaea318cc025-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:30:02 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-49c9a81a-8a58-46c1-8643-82f737214717 tempest-VolumeTypesAccessTest-579047537 None] Lock "cinder-cf3ef9a7-6290-4465-8535-aaea318cc025-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:30:02 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-49c9a81a-8a58-46c1-8643-82f737214717 tempest-VolumeTypesAccessTest-579047537 None] Acquiring lock "cinder-quobyte-cf3ef9a7-6290-4465-8535-aaea318cc025" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:30:02 devstack sudo[104065]: pam_unix(sudo:session): session closed for user root Jun 29 03:30:02 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ba9115ce-73cb-4043-bcea-2703f966d7e2 tempest-VolumesCloneTest-532724764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-3271aaa3-d73f-4051-b958-3cac670f2b1c" returned: 0 in 0.779s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:30:02 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-ba9115ce-73cb-4043-bcea-2703f966d7e2 tempest-VolumesCloneTest-532724764 None] Lock "cinder-quobyte-3271aaa3-d73f-4051-b958-3cac670f2b1c" released by "delete_volume" :: held 1.724s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:30:02 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-49c9a81a-8a58-46c1-8643-82f737214717 tempest-VolumeTypesAccessTest-579047537 None] Lock "cinder-quobyte-cf3ef9a7-6290-4465-8535-aaea318cc025" acquired by "delete_volume" :: waited 0.040s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:30:02 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eb6ef2b-b1ef-4758-8a45-3b7abd44d891]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:30:02 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-49c9a81a-8a58-46c1-8643-82f737214717 tempest-VolumeTypesAccessTest-579047537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-cf3ef9a7-6290-4465-8535-aaea318cc025 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:30:02 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-ba9115ce-73cb-4043-bcea-2703f966d7e2 tempest-VolumesCloneTest-532724764 None] Created reservations ['41ac55bb-6f69-4fa3-8b4b-0ba6ed1c202d', 'd73dc746-e806-4686-be14-c7c727a60f3d', 'ee02146e-dc90-46f7-9f7f-fc8076183933', 'd03b5f97-4710-4193-80ba-519732d4d73b'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:30:03 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-ba9115ce-73cb-4043-bcea-2703f966d7e2 tempest-VolumesCloneTest-532724764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:30:03 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-ba9115ce-73cb-4043-bcea-2703f966d7e2 tempest-VolumesCloneTest-532724764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:30:03 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-ba9115ce-73cb-4043-bcea-2703f966d7e2 tempest-VolumesCloneTest-532724764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:30:03 devstack sudo[104069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-cf3ef9a7-6290-4465-8535-aaea318cc025 Jun 29 03:30:03 devstack sudo[104069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:30:03 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-ba9115ce-73cb-4043-bcea-2703f966d7e2 tempest-VolumesCloneTest-532724764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:30:03 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-ba9115ce-73cb-4043-bcea-2703f966d7e2 tempest-VolumesCloneTest-532724764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:30:03 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ba9115ce-73cb-4043-bcea-2703f966d7e2 tempest-VolumesCloneTest-532724764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:30:03 devstack sudo[104071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf Jun 29 03:30:03 devstack sudo[104071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:30:03 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-a879e58d-78b2-4c41-8092-41e506195815 tempest-VolumesCloneTest-532724764 None] Acquiring lock "cinder-4f6f99ba-6c2f-43c7-b151-67131f4ebf53-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:30:03 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-a879e58d-78b2-4c41-8092-41e506195815 tempest-VolumesCloneTest-532724764 None] Lock "cinder-4f6f99ba-6c2f-43c7-b151-67131f4ebf53-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:30:03 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-a879e58d-78b2-4c41-8092-41e506195815 tempest-VolumesCloneTest-532724764 None] Acquiring lock "cinder-quobyte-4f6f99ba-6c2f-43c7-b151-67131f4ebf53" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:30:03 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-a879e58d-78b2-4c41-8092-41e506195815 tempest-VolumesCloneTest-532724764 None] Lock "cinder-quobyte-4f6f99ba-6c2f-43c7-b151-67131f4ebf53" acquired by "delete_volume" :: waited 0.042s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:30:03 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fbe510f-ac52-4cad-9e1f-7b8e9bf610ab]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:30:03 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a879e58d-78b2-4c41-8092-41e506195815 tempest-VolumesCloneTest-532724764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-4f6f99ba-6c2f-43c7-b151-67131f4ebf53 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:30:03 devstack sudo[104073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-4f6f99ba-6c2f-43c7-b151-67131f4ebf53 Jun 29 03:30:03 devstack sudo[104073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:30:03 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-853af521-e0e8-40c9-a3ca-e581425360b0 tempest-VolumesTransfersV355Test-87264054 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:30:03 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-853af521-e0e8-40c9-a3ca-e581425360b0 tempest-VolumesTransfersV355Test-87264054 None] Flow 'volume_create_manager' (94038953-eaf6-4795-8a5e-109617be09c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:30:03 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-853af521-e0e8-40c9-a3ca-e581425360b0 tempest-VolumesTransfersV355Test-87264054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86e35701-ade7-4ee5-ae52-2fcec4a404b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:30:03 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-853af521-e0e8-40c9-a3ca-e581425360b0 tempest-VolumesTransfersV355Test-87264054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86e35701-ade7-4ee5-ae52-2fcec4a404b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:30:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1207832828',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4bd91da6-f278-47eb-9a77-8b7757384a0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e764cba78c0494ea8b9e5fce0de208d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:30:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:30:04Z,use_quota=True,user_id='e3ee15e342ae45b790fcbe53ca52caeb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:30:03 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-853af521-e0e8-40c9-a3ca-e581425360b0 tempest-VolumesTransfersV355Test-87264054 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58279a99-f2f5-4a16-a0c0-4837eece6d67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:30:03 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-853af521-e0e8-40c9-a3ca-e581425360b0 tempest-VolumesTransfersV355Test-87264054 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58279a99-f2f5-4a16-a0c0-4837eece6d67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:30:03 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-853af521-e0e8-40c9-a3ca-e581425360b0 tempest-VolumesTransfersV355Test-87264054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (edec14a8-a368-48b7-a5e5-193f6085666d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:30:03 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-853af521-e0e8-40c9-a3ca-e581425360b0 tempest-VolumesTransfersV355Test-87264054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (edec14a8-a368-48b7-a5e5-193f6085666d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4bd91da6-f278-47eb-9a77-8b7757384a0a', 'volume_name': 'volume-4bd91da6-f278-47eb-9a77-8b7757384a0a', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:30:03 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-853af521-e0e8-40c9-a3ca-e581425360b0 tempest-VolumesTransfersV355Test-87264054 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b29f0fd1-e547-498a-8de1-53b2f1ebb58d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:30:03 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-853af521-e0e8-40c9-a3ca-e581425360b0 tempest-VolumesTransfersV355Test-87264054 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b29f0fd1-e547-498a-8de1-53b2f1ebb58d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:30:03 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-853af521-e0e8-40c9-a3ca-e581425360b0 tempest-VolumesTransfersV355Test-87264054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f78dcfa4-3536-487c-99cc-63d8c07b49e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:30:03 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-853af521-e0e8-40c9-a3ca-e581425360b0 tempest-VolumesTransfersV355Test-87264054 None] Volume 4bd91da6-f278-47eb-9a77-8b7757384a0a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4bd91da6-f278-47eb-9a77-8b7757384a0a', 'volume_size': 1} Jun 29 03:30:03 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-853af521-e0e8-40c9-a3ca-e581425360b0 tempest-VolumesTransfersV355Test-87264054 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:30:03 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-853af521-e0e8-40c9-a3ca-e581425360b0 tempest-VolumesTransfersV355Test-87264054 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:30:03 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-853af521-e0e8-40c9-a3ca-e581425360b0 tempest-VolumesTransfersV355Test-87264054 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:30:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1207832828',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4bd91da6-f278-47eb-9a77-8b7757384a0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e764cba78c0494ea8b9e5fce0de208d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:30:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:30:04Z,use_quota=True,user_id='e3ee15e342ae45b790fcbe53ca52caeb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:30:03 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-853af521-e0e8-40c9-a3ca-e581425360b0 tempest-VolumesTransfersV355Test-87264054 None] Creating volume 4bd91da6-f278-47eb-9a77-8b7757384a0a {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:30:03 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-853af521-e0e8-40c9-a3ca-e581425360b0 tempest-VolumesTransfersV355Test-87264054 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:30:03 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-853af521-e0e8-40c9-a3ca-e581425360b0 tempest-VolumesTransfersV355Test-87264054 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:30:03 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-853af521-e0e8-40c9-a3ca-e581425360b0 tempest-VolumesTransfersV355Test-87264054 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:30:03 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-853af521-e0e8-40c9-a3ca-e581425360b0 tempest-VolumesTransfersV355Test-87264054 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:30:03 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-853af521-e0e8-40c9-a3ca-e581425360b0 tempest-VolumesTransfersV355Test-87264054 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:30:03 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-853af521-e0e8-40c9-a3ca-e581425360b0 tempest-VolumesTransfersV355Test-87264054 None] Selected osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:30:03 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-853af521-e0e8-40c9-a3ca-e581425360b0 tempest-VolumesTransfersV355Test-87264054 None] casted to osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f Jun 29 03:30:03 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-853af521-e0e8-40c9-a3ca-e581425360b0 tempest-VolumesTransfersV355Test-87264054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-4bd91da6-f278-47eb-9a77-8b7757384a0a 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:30:03 devstack sudo[104071]: pam_unix(sudo:session): session closed for user root Jun 29 03:30:03 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ba9115ce-73cb-4043-bcea-2703f966d7e2 tempest-VolumesCloneTest-532724764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf" returned: 0 in 0.807s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:30:03 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-ba9115ce-73cb-4043-bcea-2703f966d7e2 tempest-VolumesCloneTest-532724764 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:30:03 devstack sudo[104079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-4bd91da6-f278-47eb-9a77-8b7757384a0a 1073741824 Jun 29 03:30:03 devstack sudo[104079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:30:03 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-ba9115ce-73cb-4043-bcea-2703f966d7e2 tempest-VolumesCloneTest-532724764 None] Deleted volume successfully. Jun 29 03:30:03 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-ba9115ce-73cb-4043-bcea-2703f966d7e2 tempest-VolumesCloneTest-532724764 None] Lock "cinder-3271aaa3-d73f-4051-b958-3cac670f2b1c-delete_volume" released by "delete_volume" :: held 2.858s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:30:03 devstack sudo[104069]: pam_unix(sudo:session): session closed for user root Jun 29 03:30:03 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-49c9a81a-8a58-46c1-8643-82f737214717 tempest-VolumeTypesAccessTest-579047537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-cf3ef9a7-6290-4465-8535-aaea318cc025" returned: 0 in 1.070s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:30:03 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-49c9a81a-8a58-46c1-8643-82f737214717 tempest-VolumeTypesAccessTest-579047537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-cf3ef9a7-6290-4465-8535-aaea318cc025 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:30:03 devstack sudo[104081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-cf3ef9a7-6290-4465-8535-aaea318cc025 Jun 29 03:30:03 devstack sudo[104081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:30:04 devstack sudo[104073]: pam_unix(sudo:session): session closed for user root Jun 29 03:30:04 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a879e58d-78b2-4c41-8092-41e506195815 tempest-VolumesCloneTest-532724764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-4f6f99ba-6c2f-43c7-b151-67131f4ebf53" returned: 0 in 0.980s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:30:04 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a879e58d-78b2-4c41-8092-41e506195815 tempest-VolumesCloneTest-532724764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-4f6f99ba-6c2f-43c7-b151-67131f4ebf53 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:30:04 devstack sudo[104098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-4f6f99ba-6c2f-43c7-b151-67131f4ebf53 Jun 29 03:30:04 devstack sudo[104098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:30:04 devstack sudo[104081]: pam_unix(sudo:session): session closed for user root Jun 29 03:30:04 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-49c9a81a-8a58-46c1-8643-82f737214717 tempest-VolumeTypesAccessTest-579047537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-cf3ef9a7-6290-4465-8535-aaea318cc025" returned: 0 in 0.851s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:30:04 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-49c9a81a-8a58-46c1-8643-82f737214717 tempest-VolumeTypesAccessTest-579047537 None] Lock "cinder-quobyte-cf3ef9a7-6290-4465-8535-aaea318cc025" released by "delete_volume" :: held 1.988s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:30:04 devstack cinder-volume[93468]: WARNING cinder.quota [None req-49c9a81a-8a58-46c1-8643-82f737214717 tempest-VolumeTypesAccessTest-579047537 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-593700239 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-593700239, it is now deprecated. Please use the default quota class for default quota. Jun 29 03:30:04 devstack cinder-volume[93468]: WARNING cinder.quota [None req-49c9a81a-8a58-46c1-8643-82f737214717 tempest-VolumeTypesAccessTest-579047537 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-593700239 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-593700239, it is now deprecated. Please use the default quota class for default quota. Jun 29 03:30:04 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-49c9a81a-8a58-46c1-8643-82f737214717 tempest-VolumeTypesAccessTest-579047537 None] Created reservations ['bd9a3217-ca12-48a9-8b59-27c212e07e5c', '389fb3fa-c2ee-4d4e-9fce-a31147a93ca7', '673c5879-1ad2-4609-943c-66ea46660df4', 'd48e7f6e-7b71-4e0e-94d6-d3647b5decaf'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:30:05 devstack sudo[104079]: pam_unix(sudo:session): session closed for user root Jun 29 03:30:05 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-853af521-e0e8-40c9-a3ca-e581425360b0 tempest-VolumesTransfersV355Test-87264054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-4bd91da6-f278-47eb-9a77-8b7757384a0a 1073741824" returned: 0 in 1.268s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:30:05 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-49c9a81a-8a58-46c1-8643-82f737214717 tempest-VolumeTypesAccessTest-579047537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:30:05 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-49c9a81a-8a58-46c1-8643-82f737214717 tempest-VolumeTypesAccessTest-579047537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:30:05 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-49c9a81a-8a58-46c1-8643-82f737214717 tempest-VolumeTypesAccessTest-579047537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:30:05 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-49c9a81a-8a58-46c1-8643-82f737214717 tempest-VolumeTypesAccessTest-579047537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:30:05 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-49c9a81a-8a58-46c1-8643-82f737214717 tempest-VolumeTypesAccessTest-579047537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:30:05 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-49c9a81a-8a58-46c1-8643-82f737214717 tempest-VolumeTypesAccessTest-579047537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:30:05 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-853af521-e0e8-40c9-a3ca-e581425360b0 tempest-VolumesTransfersV355Test-87264054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-4bd91da6-f278-47eb-9a77-8b7757384a0a {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:30:05 devstack sudo[104135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf Jun 29 03:30:05 devstack sudo[104135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:30:05 devstack sudo[104137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-4bd91da6-f278-47eb-9a77-8b7757384a0a Jun 29 03:30:05 devstack sudo[104137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:30:05 devstack sudo[104098]: pam_unix(sudo:session): session closed for user root Jun 29 03:30:05 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a879e58d-78b2-4c41-8092-41e506195815 tempest-VolumesCloneTest-532724764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-4f6f99ba-6c2f-43c7-b151-67131f4ebf53" returned: 0 in 0.908s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:30:05 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-a879e58d-78b2-4c41-8092-41e506195815 tempest-VolumesCloneTest-532724764 None] Lock "cinder-quobyte-4f6f99ba-6c2f-43c7-b151-67131f4ebf53" released by "delete_volume" :: held 1.975s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:30:05 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-a879e58d-78b2-4c41-8092-41e506195815 tempest-VolumesCloneTest-532724764 None] Created reservations ['ba14756e-978b-4df7-bc8e-88794a48d5fd', '68fab61c-2ea9-4a07-a44d-30d7cc951542', '50afe14e-935e-4def-9a73-13b192571124', 'dded8a25-2b1b-4b9e-b993-5e7b3d2e94f2'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:30:05 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-a879e58d-78b2-4c41-8092-41e506195815 tempest-VolumesCloneTest-532724764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:30:05 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-a879e58d-78b2-4c41-8092-41e506195815 tempest-VolumesCloneTest-532724764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:30:05 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-a879e58d-78b2-4c41-8092-41e506195815 tempest-VolumesCloneTest-532724764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:30:05 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-a879e58d-78b2-4c41-8092-41e506195815 tempest-VolumesCloneTest-532724764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:30:05 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-a879e58d-78b2-4c41-8092-41e506195815 tempest-VolumesCloneTest-532724764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:30:05 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a879e58d-78b2-4c41-8092-41e506195815 tempest-VolumesCloneTest-532724764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:30:05 devstack sudo[104141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf Jun 29 03:30:05 devstack sudo[104141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:30:05 devstack sudo[104135]: pam_unix(sudo:session): session closed for user root Jun 29 03:30:05 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-49c9a81a-8a58-46c1-8643-82f737214717 tempest-VolumeTypesAccessTest-579047537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf" returned: 0 in 0.778s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:30:05 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-49c9a81a-8a58-46c1-8643-82f737214717 tempest-VolumeTypesAccessTest-579047537 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:30:05 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-49c9a81a-8a58-46c1-8643-82f737214717 tempest-VolumeTypesAccessTest-579047537 None] Deleted volume successfully. Jun 29 03:30:05 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-49c9a81a-8a58-46c1-8643-82f737214717 tempest-VolumeTypesAccessTest-579047537 None] Lock "cinder-cf3ef9a7-6290-4465-8535-aaea318cc025-delete_volume" released by "delete_volume" :: held 3.175s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:30:06 devstack sudo[104137]: pam_unix(sudo:session): session closed for user root Jun 29 03:30:06 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-853af521-e0e8-40c9-a3ca-e581425360b0 tempest-VolumesTransfersV355Test-87264054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-4bd91da6-f278-47eb-9a77-8b7757384a0a" returned: 0 in 0.872s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:30:06 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-853af521-e0e8-40c9-a3ca-e581425360b0 tempest-VolumesTransfersV355Test-87264054 None] <== create_volume: return (2203ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:30:06 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-853af521-e0e8-40c9-a3ca-e581425360b0 tempest-VolumesTransfersV355Test-87264054 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.207s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:30:06 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-853af521-e0e8-40c9-a3ca-e581425360b0 tempest-VolumesTransfersV355Test-87264054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f78dcfa4-3536-487c-99cc-63d8c07b49e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4bd91da6-f278-47eb-9a77-8b7757384a0a', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:30:06 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-853af521-e0e8-40c9-a3ca-e581425360b0 tempest-VolumesTransfersV355Test-87264054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7aba5cd7-67e0-4211-a6e8-75eb154f41c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:30:06 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-853af521-e0e8-40c9-a3ca-e581425360b0 tempest-VolumesTransfersV355Test-87264054 None] Volume volume-4bd91da6-f278-47eb-9a77-8b7757384a0a (4bd91da6-f278-47eb-9a77-8b7757384a0a): created successfully Jun 29 03:30:06 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-853af521-e0e8-40c9-a3ca-e581425360b0 tempest-VolumesTransfersV355Test-87264054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7aba5cd7-67e0-4211-a6e8-75eb154f41c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:30:06 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-853af521-e0e8-40c9-a3ca-e581425360b0 tempest-VolumesTransfersV355Test-87264054 None] Flow 'volume_create_manager' (94038953-eaf6-4795-8a5e-109617be09c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:30:06 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-853af521-e0e8-40c9-a3ca-e581425360b0 tempest-VolumesTransfersV355Test-87264054 None] Created volume successfully. Jun 29 03:30:06 devstack sudo[104141]: pam_unix(sudo:session): session closed for user root Jun 29 03:30:06 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a879e58d-78b2-4c41-8092-41e506195815 tempest-VolumesCloneTest-532724764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf" returned: 0 in 0.752s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:30:06 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-a879e58d-78b2-4c41-8092-41e506195815 tempest-VolumesCloneTest-532724764 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:30:06 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-a879e58d-78b2-4c41-8092-41e506195815 tempest-VolumesCloneTest-532724764 None] Deleted volume successfully. Jun 29 03:30:06 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-a879e58d-78b2-4c41-8092-41e506195815 tempest-VolumesCloneTest-532724764 None] Lock "cinder-4f6f99ba-6c2f-43c7-b151-67131f4ebf53-delete_volume" released by "delete_volume" :: held 3.095s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:30:07 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-6fc545b6-7b26-4838-834d-5bb78ce83185 tempest-VolumesTransfersV355Test-1668039311 None] Transfer volume completed successfully. Jun 29 03:30:09 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-dfed33ea-2814-494c-afa5-8a25dcb2c91c tempest-VolumesTransfersV355Test-1091482437 None] Acquiring lock "cinder-4bd91da6-f278-47eb-9a77-8b7757384a0a-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:30:09 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-dfed33ea-2814-494c-afa5-8a25dcb2c91c tempest-VolumesTransfersV355Test-1091482437 None] Lock "cinder-4bd91da6-f278-47eb-9a77-8b7757384a0a-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:30:09 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-dfed33ea-2814-494c-afa5-8a25dcb2c91c tempest-VolumesTransfersV355Test-1091482437 None] Acquiring lock "cinder-quobyte-4bd91da6-f278-47eb-9a77-8b7757384a0a" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:30:09 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-dfed33ea-2814-494c-afa5-8a25dcb2c91c tempest-VolumesTransfersV355Test-1091482437 None] Lock "cinder-quobyte-4bd91da6-f278-47eb-9a77-8b7757384a0a" acquired by "delete_volume" :: waited 0.022s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:30:09 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9146cdc-b3a2-4bed-8618-b6079997799e]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:30:09 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-dfed33ea-2814-494c-afa5-8a25dcb2c91c tempest-VolumesTransfersV355Test-1091482437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-4bd91da6-f278-47eb-9a77-8b7757384a0a {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:30:09 devstack sudo[104156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-4bd91da6-f278-47eb-9a77-8b7757384a0a Jun 29 03:30:09 devstack sudo[104156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:30:10 devstack sudo[104156]: pam_unix(sudo:session): session closed for user root Jun 29 03:30:10 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-dfed33ea-2814-494c-afa5-8a25dcb2c91c tempest-VolumesTransfersV355Test-1091482437 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-4bd91da6-f278-47eb-9a77-8b7757384a0a" returned: 0 in 1.023s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:30:10 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-dfed33ea-2814-494c-afa5-8a25dcb2c91c tempest-VolumesTransfersV355Test-1091482437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-4bd91da6-f278-47eb-9a77-8b7757384a0a {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:30:10 devstack sudo[104161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-4bd91da6-f278-47eb-9a77-8b7757384a0a Jun 29 03:30:10 devstack sudo[104161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:30:11 devstack sudo[104161]: pam_unix(sudo:session): session closed for user root Jun 29 03:30:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-dfed33ea-2814-494c-afa5-8a25dcb2c91c tempest-VolumesTransfersV355Test-1091482437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-4bd91da6-f278-47eb-9a77-8b7757384a0a" returned: 0 in 0.795s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:30:11 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-dfed33ea-2814-494c-afa5-8a25dcb2c91c tempest-VolumesTransfersV355Test-1091482437 None] Lock "cinder-quobyte-4bd91da6-f278-47eb-9a77-8b7757384a0a" released by "delete_volume" :: held 1.878s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:30:11 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-dfed33ea-2814-494c-afa5-8a25dcb2c91c tempest-VolumesTransfersV355Test-1091482437 None] Created reservations ['0163a562-ccf7-4a08-9f13-64d13b3ba216', 'a2a240bc-81cc-4ccd-8e75-d12bcfda1a62', '7b06ff38-6cd7-4257-9584-7168f60253eb', '97e20c90-a476-452b-87f6-e7c2c51599c9'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:30:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-dfed33ea-2814-494c-afa5-8a25dcb2c91c tempest-VolumesTransfersV355Test-1091482437 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:30:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-dfed33ea-2814-494c-afa5-8a25dcb2c91c tempest-VolumesTransfersV355Test-1091482437 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:30:11 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-dfed33ea-2814-494c-afa5-8a25dcb2c91c tempest-VolumesTransfersV355Test-1091482437 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:30:11 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-dfed33ea-2814-494c-afa5-8a25dcb2c91c tempest-VolumesTransfersV355Test-1091482437 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:30:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-dfed33ea-2814-494c-afa5-8a25dcb2c91c tempest-VolumesTransfersV355Test-1091482437 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:30:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-dfed33ea-2814-494c-afa5-8a25dcb2c91c tempest-VolumesTransfersV355Test-1091482437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:30:11 devstack sudo[104165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf Jun 29 03:30:11 devstack sudo[104165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:30:11 devstack cinder-volume[93468]: DEBUG oslo_service.periodic_task [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93468) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 29 03:30:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:30:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:30:11 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:30:11 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:30:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:30:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:30:11 devstack sudo[104167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf Jun 29 03:30:11 devstack sudo[104167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:30:11 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-dcf45d02-fa70-4047-b465-e24d1f122cf6 tempest-VolumesExtendTest-1491885283 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:30:11 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-dcf45d02-fa70-4047-b465-e24d1f122cf6 tempest-VolumesExtendTest-1491885283 None] Flow 'volume_create_manager' (4af42939-85b8-4419-ab01-cff1ea41a85d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:30:11 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-dcf45d02-fa70-4047-b465-e24d1f122cf6 tempest-VolumesExtendTest-1491885283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5683e9a-80b0-4774-aec6-d152b8cc864e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:30:12 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-dcf45d02-fa70-4047-b465-e24d1f122cf6 tempest-VolumesExtendTest-1491885283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5683e9a-80b0-4774-aec6-d152b8cc864e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:30:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-966943773',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ad02ddf-9ce4-4b52-84f6-bbae3ef86489,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af692eda75a64a209207ebf0feb1875e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:30:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:30:12Z,use_quota=True,user_id='8244e3ddb5cf44298377b44a9395cc8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:30:12 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-dcf45d02-fa70-4047-b465-e24d1f122cf6 tempest-VolumesExtendTest-1491885283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8e51684-f9b0-44e2-b352-65d47d19df38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:30:12 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-dcf45d02-fa70-4047-b465-e24d1f122cf6 tempest-VolumesExtendTest-1491885283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8e51684-f9b0-44e2-b352-65d47d19df38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:30:12 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-dcf45d02-fa70-4047-b465-e24d1f122cf6 tempest-VolumesExtendTest-1491885283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1dca9cb-95ef-4bcb-8928-37e10033e694) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:30:12 devstack cinder-volume[93468]: DEBUG cinder.image.glance [None req-dcf45d02-fa70-4047-b465-e24d1f122cf6 tempest-VolumesExtendTest-1491885283 None] Creating Keystone auth plugin from conf {{(pid=93468) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 29 03:30:12 devstack sudo[104165]: pam_unix(sudo:session): session closed for user root Jun 29 03:30:12 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-dfed33ea-2814-494c-afa5-8a25dcb2c91c tempest-VolumesTransfersV355Test-1091482437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf" returned: 0 in 0.950s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:30:12 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-dfed33ea-2814-494c-afa5-8a25dcb2c91c tempest-VolumesTransfersV355Test-1091482437 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:30:12 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-dfed33ea-2814-494c-afa5-8a25dcb2c91c tempest-VolumesTransfersV355Test-1091482437 None] Deleted volume successfully. Jun 29 03:30:12 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-dfed33ea-2814-494c-afa5-8a25dcb2c91c tempest-VolumesTransfersV355Test-1091482437 None] Lock "cinder-4bd91da6-f278-47eb-9a77-8b7757384a0a-delete_volume" released by "delete_volume" :: held 3.104s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:30:12 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-dcf45d02-fa70-4047-b465-e24d1f122cf6 tempest-VolumesExtendTest-1491885283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1dca9cb-95ef-4bcb-8928-37e10033e694) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '9ad02ddf-9ce4-4b52-84f6-bbae3ef86489', 'volume_name': 'volume-9ad02ddf-9ce4-4b52-84f6-bbae3ef86489', 'volume_size': 1, 'image_id': '24cf6ce1-1d2d-493f-a115-2a39928c82fb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/24cf6ce1-1d2d-493f-a115-2a39928c82fb', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1335b5873eea4762b9fea7f84dd1615c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '24cf6ce1-1d2d-493f-a115-2a39928c82fb', 'created_at': datetime.datetime(2026, 6, 29, 1, 13, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 29, 1, 13, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/24cf6ce1-1d2d-493f-a115-2a39928c82fb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:30:12 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-dcf45d02-fa70-4047-b465-e24d1f122cf6 tempest-VolumesExtendTest-1491885283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (566346c9-9ce7-4107-9644-0f1093bab900) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:30:12 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-dcf45d02-fa70-4047-b465-e24d1f122cf6 tempest-VolumesExtendTest-1491885283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (566346c9-9ce7-4107-9644-0f1093bab900) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:30:12 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-dcf45d02-fa70-4047-b465-e24d1f122cf6 tempest-VolumesExtendTest-1491885283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05b3ae82-8de5-4181-87bc-5450258b25da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:30:12 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-dcf45d02-fa70-4047-b465-e24d1f122cf6 tempest-VolumesExtendTest-1491885283 None] Volume 9ad02ddf-9ce4-4b52-84f6-bbae3ef86489: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-9ad02ddf-9ce4-4b52-84f6-bbae3ef86489', 'volume_size': 1, 'image_id': '24cf6ce1-1d2d-493f-a115-2a39928c82fb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/24cf6ce1-1d2d-493f-a115-2a39928c82fb', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1335b5873eea4762b9fea7f84dd1615c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '24cf6ce1-1d2d-493f-a115-2a39928c82fb', 'created_at': datetime.datetime(2026, 6, 29, 1, 13, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 29, 1, 13, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/24cf6ce1-1d2d-493f-a115-2a39928c82fb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jun 29 03:30:12 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-dcf45d02-fa70-4047-b465-e24d1f122cf6 tempest-VolumesExtendTest-1491885283 None] Trying to clone 9ad02ddf-9ce4-4b52-84f6-bbae3ef86489 from image 24cf6ce1-1d2d-493f-a115-2a39928c82fb at location (None, [{'url': 'file:///opt/stack/data/glance/images/24cf6ce1-1d2d-493f-a115-2a39928c82fb', 'metadata': {}}]). {{(pid=93468) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 29 03:30:12 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-142291f8-396d-48de-92de-323ffaf1b13c tempest-VolumesTransfersV355Test-87264054 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:30:12 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-142291f8-396d-48de-92de-323ffaf1b13c tempest-VolumesTransfersV355Test-87264054 None] Flow 'volume_create_manager' (b527b38c-3fca-4015-acb6-ecaf41a7b244) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:30:12 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-142291f8-396d-48de-92de-323ffaf1b13c tempest-VolumesTransfersV355Test-87264054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a122a9cc-35a2-4d21-8ff2-1ff8eaa27e68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:30:12 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-142291f8-396d-48de-92de-323ffaf1b13c tempest-VolumesTransfersV355Test-87264054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a122a9cc-35a2-4d21-8ff2-1ff8eaa27e68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:30:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1509983920',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e46c9b82-7efe-4260-8b2b-faa38e294ba7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e764cba78c0494ea8b9e5fce0de208d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:30:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:30:12Z,use_quota=True,user_id='e3ee15e342ae45b790fcbe53ca52caeb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:30:12 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-142291f8-396d-48de-92de-323ffaf1b13c tempest-VolumesTransfersV355Test-87264054 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47eaae24-0c46-43c6-956c-0baf6483709a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:30:12 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-142291f8-396d-48de-92de-323ffaf1b13c tempest-VolumesTransfersV355Test-87264054 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47eaae24-0c46-43c6-956c-0baf6483709a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:30:12 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-142291f8-396d-48de-92de-323ffaf1b13c tempest-VolumesTransfersV355Test-87264054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c8c5340-fcd0-4dfa-a37d-2633eefb92e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:30:12 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-142291f8-396d-48de-92de-323ffaf1b13c tempest-VolumesTransfersV355Test-87264054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c8c5340-fcd0-4dfa-a37d-2633eefb92e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e46c9b82-7efe-4260-8b2b-faa38e294ba7', 'volume_name': 'volume-e46c9b82-7efe-4260-8b2b-faa38e294ba7', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:30:12 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-142291f8-396d-48de-92de-323ffaf1b13c tempest-VolumesTransfersV355Test-87264054 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (269e8782-832a-4f41-8be5-daf160c581a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:30:12 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-142291f8-396d-48de-92de-323ffaf1b13c tempest-VolumesTransfersV355Test-87264054 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (269e8782-832a-4f41-8be5-daf160c581a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:30:12 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-142291f8-396d-48de-92de-323ffaf1b13c tempest-VolumesTransfersV355Test-87264054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa02ebc6-e006-4450-80c0-c3e69dfcbc50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:30:12 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-142291f8-396d-48de-92de-323ffaf1b13c tempest-VolumesTransfersV355Test-87264054 None] Volume e46c9b82-7efe-4260-8b2b-faa38e294ba7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e46c9b82-7efe-4260-8b2b-faa38e294ba7', 'volume_size': 1} Jun 29 03:30:12 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-142291f8-396d-48de-92de-323ffaf1b13c tempest-VolumesTransfersV355Test-87264054 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:30:12 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-142291f8-396d-48de-92de-323ffaf1b13c tempest-VolumesTransfersV355Test-87264054 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:30:12 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-142291f8-396d-48de-92de-323ffaf1b13c tempest-VolumesTransfersV355Test-87264054 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:30:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1509983920',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e46c9b82-7efe-4260-8b2b-faa38e294ba7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e764cba78c0494ea8b9e5fce0de208d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:30:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:30:12Z,use_quota=True,user_id='e3ee15e342ae45b790fcbe53ca52caeb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:30:12 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-142291f8-396d-48de-92de-323ffaf1b13c tempest-VolumesTransfersV355Test-87264054 None] Creating volume e46c9b82-7efe-4260-8b2b-faa38e294ba7 {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:30:12 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-142291f8-396d-48de-92de-323ffaf1b13c tempest-VolumesTransfersV355Test-87264054 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:30:12 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-142291f8-396d-48de-92de-323ffaf1b13c tempest-VolumesTransfersV355Test-87264054 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:30:12 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-142291f8-396d-48de-92de-323ffaf1b13c tempest-VolumesTransfersV355Test-87264054 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:30:12 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-142291f8-396d-48de-92de-323ffaf1b13c tempest-VolumesTransfersV355Test-87264054 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:30:12 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-142291f8-396d-48de-92de-323ffaf1b13c tempest-VolumesTransfersV355Test-87264054 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:30:12 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-142291f8-396d-48de-92de-323ffaf1b13c tempest-VolumesTransfersV355Test-87264054 None] Selected osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:30:12 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-142291f8-396d-48de-92de-323ffaf1b13c tempest-VolumesTransfersV355Test-87264054 None] casted to osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f Jun 29 03:30:12 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-142291f8-396d-48de-92de-323ffaf1b13c tempest-VolumesTransfersV355Test-87264054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-e46c9b82-7efe-4260-8b2b-faa38e294ba7 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:30:12 devstack sudo[104172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-e46c9b82-7efe-4260-8b2b-faa38e294ba7 1073741824 Jun 29 03:30:12 devstack sudo[104172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:30:12 devstack sudo[104167]: pam_unix(sudo:session): session closed for user root Jun 29 03:30:12 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf" returned: 0 in 1.064s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:30:12 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:30:12 devstack cinder-volume[93468]: DEBUG oslo_service.periodic_task [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Running periodic task VolumeManager._thread_info {{(pid=93468) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 29 03:30:12 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] thread count: 28 {{(pid=93468) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 29 03:30:12 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] thread info: [<_MainThread(MainThread, started 132331377287296)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93468) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 29 03:30:13 devstack cinder-volume[93468]: DEBUG cinder.image.image_utils [None req-dcf45d02-fa70-4047-b465-e24d1f122cf6 tempest-VolumesExtendTest-1491885283 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_24cf6ce1-1d2d-493f-a115-2a39928c82fb_7gfcx19qdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=93468) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 29 03:30:13 devstack cinder-volume[93468]: INFO cinder.image.image_utils [None req-dcf45d02-fa70-4047-b465-e24d1f122cf6 tempest-VolumesExtendTest-1491885283 None] Image download 20.69 MB at 20.69 MB/s Jun 29 03:30:13 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac6c54a5-8b5e-468c-9294-bba7361f8dba]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:30:13 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-dcf45d02-fa70-4047-b465-e24d1f122cf6 tempest-VolumesExtendTest-1491885283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_24cf6ce1-1d2d-493f-a115-2a39928c82fb_7gfcx19qdevstack@QuobyteHD {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:30:13 devstack sudo[104175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_24cf6ce1-1d2d-493f-a115-2a39928c82fb_7gfcx19qdevstack@QuobyteHD Jun 29 03:30:13 devstack sudo[104175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:30:13 devstack sudo[104172]: pam_unix(sudo:session): session closed for user root Jun 29 03:30:13 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-142291f8-396d-48de-92de-323ffaf1b13c tempest-VolumesTransfersV355Test-87264054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-e46c9b82-7efe-4260-8b2b-faa38e294ba7 1073741824" returned: 0 in 1.044s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:30:13 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-142291f8-396d-48de-92de-323ffaf1b13c tempest-VolumesTransfersV355Test-87264054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-e46c9b82-7efe-4260-8b2b-faa38e294ba7 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:30:13 devstack sudo[104180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-e46c9b82-7efe-4260-8b2b-faa38e294ba7 Jun 29 03:30:13 devstack sudo[104180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:30:14 devstack sudo[104175]: pam_unix(sudo:session): session closed for user root Jun 29 03:30:14 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-dcf45d02-fa70-4047-b465-e24d1f122cf6 tempest-VolumesExtendTest-1491885283 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_24cf6ce1-1d2d-493f-a115-2a39928c82fb_7gfcx19qdevstack@QuobyteHD" returned: 0 in 0.914s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:30:14 devstack cinder-volume[93468]: DEBUG cinder.image.image_utils [None req-dcf45d02-fa70-4047-b465-e24d1f122cf6 tempest-VolumesExtendTest-1491885283 None] Temporary image 24cf6ce1-1d2d-493f-a115-2a39928c82fb is fetched for user 8244e3ddb5cf44298377b44a9395cc8a. {{(pid=93468) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 29 03:30:14 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c1c67f7-0731-4662-92e9-84b1c84807e0]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:30:14 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-dcf45d02-fa70-4047-b465-e24d1f122cf6 tempest-VolumesExtendTest-1491885283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_24cf6ce1-1d2d-493f-a115-2a39928c82fb_7gfcx19qdevstack@QuobyteHD {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:30:14 devstack sudo[104187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_24cf6ce1-1d2d-493f-a115-2a39928c82fb_7gfcx19qdevstack@QuobyteHD Jun 29 03:30:14 devstack sudo[104187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:30:14 devstack sudo[104180]: pam_unix(sudo:session): session closed for user root Jun 29 03:30:14 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-142291f8-396d-48de-92de-323ffaf1b13c tempest-VolumesTransfersV355Test-87264054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-e46c9b82-7efe-4260-8b2b-faa38e294ba7" returned: 0 in 0.816s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:30:14 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-142291f8-396d-48de-92de-323ffaf1b13c tempest-VolumesTransfersV355Test-87264054 None] <== create_volume: return (1947ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:30:14 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-142291f8-396d-48de-92de-323ffaf1b13c tempest-VolumesTransfersV355Test-87264054 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.950s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:30:14 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-142291f8-396d-48de-92de-323ffaf1b13c tempest-VolumesTransfersV355Test-87264054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa02ebc6-e006-4450-80c0-c3e69dfcbc50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e46c9b82-7efe-4260-8b2b-faa38e294ba7', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:30:14 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-142291f8-396d-48de-92de-323ffaf1b13c tempest-VolumesTransfersV355Test-87264054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (724257c2-3538-4ae3-ba5b-4367f0aff71e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:30:14 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-142291f8-396d-48de-92de-323ffaf1b13c tempest-VolumesTransfersV355Test-87264054 None] Volume volume-e46c9b82-7efe-4260-8b2b-faa38e294ba7 (e46c9b82-7efe-4260-8b2b-faa38e294ba7): created successfully Jun 29 03:30:14 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-142291f8-396d-48de-92de-323ffaf1b13c tempest-VolumesTransfersV355Test-87264054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (724257c2-3538-4ae3-ba5b-4367f0aff71e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:30:14 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-142291f8-396d-48de-92de-323ffaf1b13c tempest-VolumesTransfersV355Test-87264054 None] Flow 'volume_create_manager' (b527b38c-3fca-4015-acb6-ecaf41a7b244) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:30:14 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-142291f8-396d-48de-92de-323ffaf1b13c tempest-VolumesTransfersV355Test-87264054 None] Created volume successfully. Jun 29 03:30:14 devstack sudo[104187]: pam_unix(sudo:session): session closed for user root Jun 29 03:30:14 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-dcf45d02-fa70-4047-b465-e24d1f122cf6 tempest-VolumesExtendTest-1491885283 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_24cf6ce1-1d2d-493f-a115-2a39928c82fb_7gfcx19qdevstack@QuobyteHD" returned: 0 in 0.810s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:30:14 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-dcf45d02-fa70-4047-b465-e24d1f122cf6 tempest-VolumesExtendTest-1491885283 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:30:14 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-dcf45d02-fa70-4047-b465-e24d1f122cf6 tempest-VolumesExtendTest-1491885283 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:30:14 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-dcf45d02-fa70-4047-b465-e24d1f122cf6 tempest-VolumesExtendTest-1491885283 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:30:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-966943773',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ad02ddf-9ce4-4b52-84f6-bbae3ef86489,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af692eda75a64a209207ebf0feb1875e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:30:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:30:12Z,use_quota=True,user_id='8244e3ddb5cf44298377b44a9395cc8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:30:14 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-dcf45d02-fa70-4047-b465-e24d1f122cf6 tempest-VolumesExtendTest-1491885283 None] Creating volume 9ad02ddf-9ce4-4b52-84f6-bbae3ef86489 {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:30:14 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-dcf45d02-fa70-4047-b465-e24d1f122cf6 tempest-VolumesExtendTest-1491885283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:30:14 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-dcf45d02-fa70-4047-b465-e24d1f122cf6 tempest-VolumesExtendTest-1491885283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:30:14 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-dcf45d02-fa70-4047-b465-e24d1f122cf6 tempest-VolumesExtendTest-1491885283 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:30:14 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-dcf45d02-fa70-4047-b465-e24d1f122cf6 tempest-VolumesExtendTest-1491885283 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:30:14 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-dcf45d02-fa70-4047-b465-e24d1f122cf6 tempest-VolumesExtendTest-1491885283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:30:14 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-dcf45d02-fa70-4047-b465-e24d1f122cf6 tempest-VolumesExtendTest-1491885283 None] Selected osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:30:14 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-dcf45d02-fa70-4047-b465-e24d1f122cf6 tempest-VolumesExtendTest-1491885283 None] casted to osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f Jun 29 03:30:14 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-dcf45d02-fa70-4047-b465-e24d1f122cf6 tempest-VolumesExtendTest-1491885283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9ad02ddf-9ce4-4b52-84f6-bbae3ef86489 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:30:14 devstack sudo[104201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9ad02ddf-9ce4-4b52-84f6-bbae3ef86489 1073741824 Jun 29 03:30:14 devstack sudo[104201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:30:15 devstack sudo[104201]: pam_unix(sudo:session): session closed for user root Jun 29 03:30:15 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-dcf45d02-fa70-4047-b465-e24d1f122cf6 tempest-VolumesExtendTest-1491885283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9ad02ddf-9ce4-4b52-84f6-bbae3ef86489 1073741824" returned: 0 in 0.968s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:30:15 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-dcf45d02-fa70-4047-b465-e24d1f122cf6 tempest-VolumesExtendTest-1491885283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9ad02ddf-9ce4-4b52-84f6-bbae3ef86489 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:30:15 devstack sudo[104213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9ad02ddf-9ce4-4b52-84f6-bbae3ef86489 Jun 29 03:30:15 devstack sudo[104213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:30:15 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-efbbfee6-81d6-4e1b-9aea-6a74f61901aa tempest-VolumesTransfersV355Test-1091482437 None] Acquiring lock "cinder-e46c9b82-7efe-4260-8b2b-faa38e294ba7-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:30:16 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-efbbfee6-81d6-4e1b-9aea-6a74f61901aa tempest-VolumesTransfersV355Test-1091482437 None] Lock "cinder-e46c9b82-7efe-4260-8b2b-faa38e294ba7-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:30:16 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-efbbfee6-81d6-4e1b-9aea-6a74f61901aa tempest-VolumesTransfersV355Test-1091482437 None] Acquiring lock "cinder-quobyte-e46c9b82-7efe-4260-8b2b-faa38e294ba7" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:30:16 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-efbbfee6-81d6-4e1b-9aea-6a74f61901aa tempest-VolumesTransfersV355Test-1091482437 None] Lock "cinder-quobyte-e46c9b82-7efe-4260-8b2b-faa38e294ba7" acquired by "delete_volume" :: waited 0.029s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:30:16 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[68d56429-bab4-4e55-ae5f-822712332f6c]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:30:16 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-efbbfee6-81d6-4e1b-9aea-6a74f61901aa tempest-VolumesTransfersV355Test-1091482437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-e46c9b82-7efe-4260-8b2b-faa38e294ba7 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:30:16 devstack sudo[104218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-e46c9b82-7efe-4260-8b2b-faa38e294ba7 Jun 29 03:30:16 devstack sudo[104218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:30:16 devstack sudo[104213]: pam_unix(sudo:session): session closed for user root Jun 29 03:30:16 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-dcf45d02-fa70-4047-b465-e24d1f122cf6 tempest-VolumesExtendTest-1491885283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9ad02ddf-9ce4-4b52-84f6-bbae3ef86489" returned: 0 in 0.869s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:30:16 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-dcf45d02-fa70-4047-b465-e24d1f122cf6 tempest-VolumesExtendTest-1491885283 None] <== create_volume: return (1888ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:30:16 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-dcf45d02-fa70-4047-b465-e24d1f122cf6 tempest-VolumesExtendTest-1491885283 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.895s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:30:16 devstack cinder-volume[93468]: DEBUG cinder.volume.volume_utils [None req-dcf45d02-fa70-4047-b465-e24d1f122cf6 tempest-VolumesExtendTest-1491885283 None] Attempting download of 24cf6ce1-1d2d-493f-a115-2a39928c82fb ((None, [{'url': 'file:///opt/stack/data/glance/images/24cf6ce1-1d2d-493f-a115-2a39928c82fb', 'metadata': {}}])) to volume 9ad02ddf-9ce4-4b52-84f6-bbae3ef86489. {{(pid=93468) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 29 03:30:16 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[c51a08d0-9ed9-49d4-83e6-4d4a5052eb3c]: (4, 'raw') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:30:16 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-dcf45d02-fa70-4047-b465-e24d1f122cf6 tempest-VolumesExtendTest-1491885283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_24cf6ce1-1d2d-493f-a115-2a39928c82fb_0x4h17kj {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:30:17 devstack sudo[104238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_24cf6ce1-1d2d-493f-a115-2a39928c82fb_0x4h17kj Jun 29 03:30:17 devstack sudo[104238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:30:17 devstack sudo[104218]: pam_unix(sudo:session): session closed for user root Jun 29 03:30:17 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-efbbfee6-81d6-4e1b-9aea-6a74f61901aa tempest-VolumesTransfersV355Test-1091482437 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-e46c9b82-7efe-4260-8b2b-faa38e294ba7" returned: 0 in 1.303s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:30:17 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-efbbfee6-81d6-4e1b-9aea-6a74f61901aa tempest-VolumesTransfersV355Test-1091482437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-e46c9b82-7efe-4260-8b2b-faa38e294ba7 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:30:17 devstack sudo[104280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-e46c9b82-7efe-4260-8b2b-faa38e294ba7 Jun 29 03:30:17 devstack sudo[104280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:30:18 devstack sudo[104238]: pam_unix(sudo:session): session closed for user root Jun 29 03:30:18 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-dcf45d02-fa70-4047-b465-e24d1f122cf6 tempest-VolumesExtendTest-1491885283 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_24cf6ce1-1d2d-493f-a115-2a39928c82fb_0x4h17kj" returned: 0 in 1.533s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:30:18 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-dcf45d02-fa70-4047-b465-e24d1f122cf6 tempest-VolumesExtendTest-1491885283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_24cf6ce1-1d2d-493f-a115-2a39928c82fb_0x4h17kj {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:30:18 devstack sudo[104310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_24cf6ce1-1d2d-493f-a115-2a39928c82fb_0x4h17kj Jun 29 03:30:18 devstack sudo[104310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:30:19 devstack sudo[104280]: pam_unix(sudo:session): session closed for user root Jun 29 03:30:19 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-efbbfee6-81d6-4e1b-9aea-6a74f61901aa tempest-VolumesTransfersV355Test-1091482437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-e46c9b82-7efe-4260-8b2b-faa38e294ba7" returned: 0 in 1.533s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:30:19 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-efbbfee6-81d6-4e1b-9aea-6a74f61901aa tempest-VolumesTransfersV355Test-1091482437 None] Lock "cinder-quobyte-e46c9b82-7efe-4260-8b2b-faa38e294ba7" released by "delete_volume" :: held 2.928s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:30:19 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-efbbfee6-81d6-4e1b-9aea-6a74f61901aa tempest-VolumesTransfersV355Test-1091482437 None] Created reservations ['09509508-ec5e-437f-8382-5e7f991b8a63', '11a1f3e7-66c5-4010-8d11-baa7260a67a6', '5607e5f0-63e6-4191-b2dc-4c63c6a42e56', '910bf52c-e32c-4e3f-8c29-d82722b5c3da'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:30:19 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-efbbfee6-81d6-4e1b-9aea-6a74f61901aa tempest-VolumesTransfersV355Test-1091482437 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:30:19 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-efbbfee6-81d6-4e1b-9aea-6a74f61901aa tempest-VolumesTransfersV355Test-1091482437 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:30:19 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-efbbfee6-81d6-4e1b-9aea-6a74f61901aa tempest-VolumesTransfersV355Test-1091482437 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:30:19 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-efbbfee6-81d6-4e1b-9aea-6a74f61901aa tempest-VolumesTransfersV355Test-1091482437 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:30:19 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-efbbfee6-81d6-4e1b-9aea-6a74f61901aa tempest-VolumesTransfersV355Test-1091482437 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:30:19 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-efbbfee6-81d6-4e1b-9aea-6a74f61901aa tempest-VolumesTransfersV355Test-1091482437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:30:19 devstack sudo[104316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf Jun 29 03:30:19 devstack sudo[104316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:30:19 devstack sudo[104310]: pam_unix(sudo:session): session closed for user root Jun 29 03:30:19 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-dcf45d02-fa70-4047-b465-e24d1f122cf6 tempest-VolumesExtendTest-1491885283 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_24cf6ce1-1d2d-493f-a115-2a39928c82fb_0x4h17kj" returned: 1 in 1.168s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:30:19 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-dcf45d02-fa70-4047-b465-e24d1f122cf6 tempest-VolumesExtendTest-1491885283 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_24cf6ce1-1d2d-493f-a115-2a39928c82fb_0x4h17kj' failed. Not Retrying. {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 29 03:30:19 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[d84b1fa6-d59e-4080-b290-252bf8928dcf]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:30:19 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-dcf45d02-fa70-4047-b465-e24d1f122cf6 tempest-VolumesExtendTest-1491885283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_24cf6ce1-1d2d-493f-a115-2a39928c82fb_7gfcx19qdevstack@QuobyteHD {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:30:19 devstack sudo[104321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_24cf6ce1-1d2d-493f-a115-2a39928c82fb_7gfcx19qdevstack@QuobyteHD Jun 29 03:30:19 devstack sudo[104321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:30:20 devstack sudo[104316]: pam_unix(sudo:session): session closed for user root Jun 29 03:30:20 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-efbbfee6-81d6-4e1b-9aea-6a74f61901aa tempest-VolumesTransfersV355Test-1091482437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf" returned: 0 in 1.021s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:30:20 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-efbbfee6-81d6-4e1b-9aea-6a74f61901aa tempest-VolumesTransfersV355Test-1091482437 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:30:20 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-efbbfee6-81d6-4e1b-9aea-6a74f61901aa tempest-VolumesTransfersV355Test-1091482437 None] Deleted volume successfully. Jun 29 03:30:20 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-efbbfee6-81d6-4e1b-9aea-6a74f61901aa tempest-VolumesTransfersV355Test-1091482437 None] Lock "cinder-e46c9b82-7efe-4260-8b2b-faa38e294ba7-delete_volume" released by "delete_volume" :: held 4.281s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:30:21 devstack sudo[104321]: pam_unix(sudo:session): session closed for user root Jun 29 03:30:21 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-dcf45d02-fa70-4047-b465-e24d1f122cf6 tempest-VolumesExtendTest-1491885283 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_24cf6ce1-1d2d-493f-a115-2a39928c82fb_7gfcx19qdevstack@QuobyteHD" returned: 0 in 1.329s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:30:21 devstack cinder-volume[93468]: DEBUG cinder.image.image_utils [None req-dcf45d02-fa70-4047-b465-e24d1f122cf6 tempest-VolumesExtendTest-1491885283 None] 24cf6ce1-1d2d-493f-a115-2a39928c82fb was qcow2, converting to raw {{(pid=93468) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 29 03:30:21 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-dcf45d02-fa70-4047-b465-e24d1f122cf6 tempest-VolumesExtendTest-1491885283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_24cf6ce1-1d2d-493f-a115-2a39928c82fb_7gfcx19qdevstack@QuobyteHD /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9ad02ddf-9ce4-4b52-84f6-bbae3ef86489 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:30:21 devstack sudo[104328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_24cf6ce1-1d2d-493f-a115-2a39928c82fb_7gfcx19qdevstack@QuobyteHD /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9ad02ddf-9ce4-4b52-84f6-bbae3ef86489 Jun 29 03:30:21 devstack sudo[104328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:30:22 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-afabc564-c9a8-415d-8830-fcb4028900f2 tempest-SnapshotMetadataTestJSON-1345646456 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:30:22 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-afabc564-c9a8-415d-8830-fcb4028900f2 tempest-SnapshotMetadataTestJSON-1345646456 None] Flow 'volume_create_manager' (0c66843f-7894-41c3-ad34-6a79d4b5610a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:30:22 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-afabc564-c9a8-415d-8830-fcb4028900f2 tempest-SnapshotMetadataTestJSON-1345646456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2c12ae1-e07f-4b0f-9f8d-53433c0e39c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:30:22 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-afabc564-c9a8-415d-8830-fcb4028900f2 tempest-SnapshotMetadataTestJSON-1345646456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2c12ae1-e07f-4b0f-9f8d-53433c0e39c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:30:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-21205849',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5a6fb56-c5d8-4322-88fd-f9b343f60a12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be69dbb208d6414baa5214c3980183a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:30:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:30:22Z,use_quota=True,user_id='338bec51dfb245929027aa89182203a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:30:22 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-afabc564-c9a8-415d-8830-fcb4028900f2 tempest-SnapshotMetadataTestJSON-1345646456 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d0be9e0-4e4e-45e0-9812-46b28fbcb4ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:30:22 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-afabc564-c9a8-415d-8830-fcb4028900f2 tempest-SnapshotMetadataTestJSON-1345646456 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d0be9e0-4e4e-45e0-9812-46b28fbcb4ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:30:22 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-afabc564-c9a8-415d-8830-fcb4028900f2 tempest-SnapshotMetadataTestJSON-1345646456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98883c3c-976e-4746-a019-bb78702d1096) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:30:22 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-afabc564-c9a8-415d-8830-fcb4028900f2 tempest-SnapshotMetadataTestJSON-1345646456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98883c3c-976e-4746-a019-bb78702d1096) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd5a6fb56-c5d8-4322-88fd-f9b343f60a12', 'volume_name': 'volume-d5a6fb56-c5d8-4322-88fd-f9b343f60a12', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:30:22 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-afabc564-c9a8-415d-8830-fcb4028900f2 tempest-SnapshotMetadataTestJSON-1345646456 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (571a1c8b-aac8-4b4d-92be-82b560fa2c07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:30:22 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-afabc564-c9a8-415d-8830-fcb4028900f2 tempest-SnapshotMetadataTestJSON-1345646456 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (571a1c8b-aac8-4b4d-92be-82b560fa2c07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:30:22 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-afabc564-c9a8-415d-8830-fcb4028900f2 tempest-SnapshotMetadataTestJSON-1345646456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc8d7f0d-d3c7-4d2a-907c-3f8fc0db30de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:30:22 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-afabc564-c9a8-415d-8830-fcb4028900f2 tempest-SnapshotMetadataTestJSON-1345646456 None] Volume d5a6fb56-c5d8-4322-88fd-f9b343f60a12: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d5a6fb56-c5d8-4322-88fd-f9b343f60a12', 'volume_size': 1} Jun 29 03:30:22 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-afabc564-c9a8-415d-8830-fcb4028900f2 tempest-SnapshotMetadataTestJSON-1345646456 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:30:22 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-afabc564-c9a8-415d-8830-fcb4028900f2 tempest-SnapshotMetadataTestJSON-1345646456 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:30:22 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-afabc564-c9a8-415d-8830-fcb4028900f2 tempest-SnapshotMetadataTestJSON-1345646456 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:30:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-21205849',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5a6fb56-c5d8-4322-88fd-f9b343f60a12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be69dbb208d6414baa5214c3980183a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:30:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:30:22Z,use_quota=True,user_id='338bec51dfb245929027aa89182203a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:30:22 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-afabc564-c9a8-415d-8830-fcb4028900f2 tempest-SnapshotMetadataTestJSON-1345646456 None] Creating volume d5a6fb56-c5d8-4322-88fd-f9b343f60a12 {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:30:22 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-afabc564-c9a8-415d-8830-fcb4028900f2 tempest-SnapshotMetadataTestJSON-1345646456 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:30:22 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-afabc564-c9a8-415d-8830-fcb4028900f2 tempest-SnapshotMetadataTestJSON-1345646456 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:30:22 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-afabc564-c9a8-415d-8830-fcb4028900f2 tempest-SnapshotMetadataTestJSON-1345646456 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:30:22 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-afabc564-c9a8-415d-8830-fcb4028900f2 tempest-SnapshotMetadataTestJSON-1345646456 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:30:22 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-afabc564-c9a8-415d-8830-fcb4028900f2 tempest-SnapshotMetadataTestJSON-1345646456 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:30:22 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-afabc564-c9a8-415d-8830-fcb4028900f2 tempest-SnapshotMetadataTestJSON-1345646456 None] Selected osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:30:22 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-afabc564-c9a8-415d-8830-fcb4028900f2 tempest-SnapshotMetadataTestJSON-1345646456 None] casted to osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f Jun 29 03:30:22 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-afabc564-c9a8-415d-8830-fcb4028900f2 tempest-SnapshotMetadataTestJSON-1345646456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-d5a6fb56-c5d8-4322-88fd-f9b343f60a12 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:30:22 devstack sudo[104336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-d5a6fb56-c5d8-4322-88fd-f9b343f60a12 1073741824 Jun 29 03:30:22 devstack sudo[104336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:30:23 devstack sudo[104336]: pam_unix(sudo:session): session closed for user root Jun 29 03:30:23 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-afabc564-c9a8-415d-8830-fcb4028900f2 tempest-SnapshotMetadataTestJSON-1345646456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-d5a6fb56-c5d8-4322-88fd-f9b343f60a12 1073741824" returned: 0 in 1.165s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:30:23 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-afabc564-c9a8-415d-8830-fcb4028900f2 tempest-SnapshotMetadataTestJSON-1345646456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-d5a6fb56-c5d8-4322-88fd-f9b343f60a12 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:30:23 devstack sudo[104344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-d5a6fb56-c5d8-4322-88fd-f9b343f60a12 Jun 29 03:30:23 devstack sudo[104344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:30:23 devstack sudo[104328]: pam_unix(sudo:session): session closed for user root Jun 29 03:30:23 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-dcf45d02-fa70-4047-b465-e24d1f122cf6 tempest-VolumesExtendTest-1491885283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_24cf6ce1-1d2d-493f-a115-2a39928c82fb_7gfcx19qdevstack@QuobyteHD /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9ad02ddf-9ce4-4b52-84f6-bbae3ef86489" returned: 0 in 2.753s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:30:23 devstack cinder-volume[93468]: DEBUG cinder.image.image_utils [None req-dcf45d02-fa70-4047-b465-e24d1f122cf6 tempest-VolumesExtendTest-1491885283 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_24cf6ce1-1d2d-493f-a115-2a39928c82fb_7gfcx19qdevstack@QuobyteHD, size 112.00 MB, duration 2.76 sec, destination /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9ad02ddf-9ce4-4b52-84f6-bbae3ef86489 {{(pid=93468) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 29 03:30:23 devstack cinder-volume[93468]: INFO cinder.image.image_utils [None req-dcf45d02-fa70-4047-b465-e24d1f122cf6 tempest-VolumesExtendTest-1491885283 None] Converted 112.00 MB image at 40.60 MB/s Jun 29 03:30:23 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-dcf45d02-fa70-4047-b465-e24d1f122cf6 tempest-VolumesExtendTest-1491885283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9ad02ddf-9ce4-4b52-84f6-bbae3ef86489 1G {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:30:23 devstack sudo[104346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9ad02ddf-9ce4-4b52-84f6-bbae3ef86489 1G Jun 29 03:30:23 devstack sudo[104346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:30:24 devstack sudo[104344]: pam_unix(sudo:session): session closed for user root Jun 29 03:30:24 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-afabc564-c9a8-415d-8830-fcb4028900f2 tempest-SnapshotMetadataTestJSON-1345646456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-d5a6fb56-c5d8-4322-88fd-f9b343f60a12" returned: 0 in 1.046s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:30:24 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-afabc564-c9a8-415d-8830-fcb4028900f2 tempest-SnapshotMetadataTestJSON-1345646456 None] <== create_volume: return (2280ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:30:24 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-afabc564-c9a8-415d-8830-fcb4028900f2 tempest-SnapshotMetadataTestJSON-1345646456 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.291s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:30:24 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-afabc564-c9a8-415d-8830-fcb4028900f2 tempest-SnapshotMetadataTestJSON-1345646456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc8d7f0d-d3c7-4d2a-907c-3f8fc0db30de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d5a6fb56-c5d8-4322-88fd-f9b343f60a12', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:30:24 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-afabc564-c9a8-415d-8830-fcb4028900f2 tempest-SnapshotMetadataTestJSON-1345646456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a8d9244-2d7b-4b69-90bc-d986db7ca3f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:30:24 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-afabc564-c9a8-415d-8830-fcb4028900f2 tempest-SnapshotMetadataTestJSON-1345646456 None] Volume volume-d5a6fb56-c5d8-4322-88fd-f9b343f60a12 (d5a6fb56-c5d8-4322-88fd-f9b343f60a12): created successfully Jun 29 03:30:24 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-afabc564-c9a8-415d-8830-fcb4028900f2 tempest-SnapshotMetadataTestJSON-1345646456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a8d9244-2d7b-4b69-90bc-d986db7ca3f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:30:24 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-afabc564-c9a8-415d-8830-fcb4028900f2 tempest-SnapshotMetadataTestJSON-1345646456 None] Flow 'volume_create_manager' (0c66843f-7894-41c3-ad34-6a79d4b5610a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:30:24 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-afabc564-c9a8-415d-8830-fcb4028900f2 tempest-SnapshotMetadataTestJSON-1345646456 None] Created volume successfully. Jun 29 03:30:24 devstack sudo[104346]: pam_unix(sudo:session): session closed for user root Jun 29 03:30:24 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-dcf45d02-fa70-4047-b465-e24d1f122cf6 tempest-VolumesExtendTest-1491885283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9ad02ddf-9ce4-4b52-84f6-bbae3ef86489 1G" returned: 0 in 1.111s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:30:24 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[139be1b1-90df-452d-b025-1d1bb38a6877]: (4, 'raw') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:30:24 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-dcf45d02-fa70-4047-b465-e24d1f122cf6 tempest-VolumesExtendTest-1491885283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9ad02ddf-9ce4-4b52-84f6-bbae3ef86489 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:30:25 devstack sudo[104358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9ad02ddf-9ce4-4b52-84f6-bbae3ef86489 Jun 29 03:30:25 devstack sudo[104358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:30:25 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-918c21ec-0774-4836-81ca-105b9612cc80 tempest-SnapshotMetadataTestJSON-1345646456 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:30:25 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-918c21ec-0774-4836-81ca-105b9612cc80 tempest-SnapshotMetadataTestJSON-1345646456 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:30:25 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-918c21ec-0774-4836-81ca-105b9612cc80 tempest-SnapshotMetadataTestJSON-1345646456 None] Creating offline snapshot 050daed6-d314-4e89-956a-6365d23a445b of volume d5a6fb56-c5d8-4322-88fd-f9b343f60a12 {{(pid=93468) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 29 03:30:25 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[85b02dc1-32ab-44b3-8831-af131085533e]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:30:25 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-918c21ec-0774-4836-81ca-105b9612cc80 tempest-SnapshotMetadataTestJSON-1345646456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-d5a6fb56-c5d8-4322-88fd-f9b343f60a12 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:30:25 devstack sudo[104358]: pam_unix(sudo:session): session closed for user root Jun 29 03:30:25 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-dcf45d02-fa70-4047-b465-e24d1f122cf6 tempest-VolumesExtendTest-1491885283 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9ad02ddf-9ce4-4b52-84f6-bbae3ef86489" returned: 0 in 1.044s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:30:25 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-dcf45d02-fa70-4047-b465-e24d1f122cf6 tempest-VolumesExtendTest-1491885283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9ad02ddf-9ce4-4b52-84f6-bbae3ef86489 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:30:25 devstack sudo[104361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-d5a6fb56-c5d8-4322-88fd-f9b343f60a12 Jun 29 03:30:25 devstack sudo[104361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:30:26 devstack sudo[104363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9ad02ddf-9ce4-4b52-84f6-bbae3ef86489 Jun 29 03:30:26 devstack sudo[104363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:30:26 devstack sudo[104363]: pam_unix(sudo:session): session closed for user root Jun 29 03:30:26 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-dcf45d02-fa70-4047-b465-e24d1f122cf6 tempest-VolumesExtendTest-1491885283 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9ad02ddf-9ce4-4b52-84f6-bbae3ef86489" returned: 1 in 0.894s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:30:26 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-dcf45d02-fa70-4047-b465-e24d1f122cf6 tempest-VolumesExtendTest-1491885283 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9ad02ddf-9ce4-4b52-84f6-bbae3ef86489' failed. Not Retrying. {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 29 03:30:26 devstack cinder-volume[93468]: DEBUG cinder.volume.volume_utils [None req-dcf45d02-fa70-4047-b465-e24d1f122cf6 tempest-VolumesExtendTest-1491885283 None] Downloaded image 24cf6ce1-1d2d-493f-a115-2a39928c82fb ((None, [{'url': 'file:///opt/stack/data/glance/images/24cf6ce1-1d2d-493f-a115-2a39928c82fb', 'metadata': {}}])) to volume 9ad02ddf-9ce4-4b52-84f6-bbae3ef86489 successfully. {{(pid=93468) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 29 03:30:26 devstack cinder-volume[93468]: DEBUG cinder.image.image_utils [None req-dcf45d02-fa70-4047-b465-e24d1f122cf6 tempest-VolumesExtendTest-1491885283 None] Temporary image 24cf6ce1-1d2d-493f-a115-2a39928c82fb for user 8244e3ddb5cf44298377b44a9395cc8a is deleted. {{(pid=93468) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 29 03:30:26 devstack cinder-volume[93468]: DEBUG cinder.volume.volume_utils [None req-dcf45d02-fa70-4047-b465-e24d1f122cf6 tempest-VolumesExtendTest-1491885283 None] Marking volume 9ad02ddf-9ce4-4b52-84f6-bbae3ef86489 as bootable. {{(pid=93468) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 29 03:30:26 devstack sudo[104361]: pam_unix(sudo:session): session closed for user root Jun 29 03:30:26 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-dcf45d02-fa70-4047-b465-e24d1f122cf6 tempest-VolumesExtendTest-1491885283 None] Copying metadata from image 24cf6ce1-1d2d-493f-a115-2a39928c82fb to 9ad02ddf-9ce4-4b52-84f6-bbae3ef86489. {{(pid=93468) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 29 03:30:26 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-dcf45d02-fa70-4047-b465-e24d1f122cf6 tempest-VolumesExtendTest-1491885283 None] Creating volume glance metadata for volume 9ad02ddf-9ce4-4b52-84f6-bbae3ef86489 backed by image 24cf6ce1-1d2d-493f-a115-2a39928c82fb with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '24cf6ce1-1d2d-493f-a115-2a39928c82fb', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=93468) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 29 03:30:26 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-918c21ec-0774-4836-81ca-105b9612cc80 tempest-SnapshotMetadataTestJSON-1345646456 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-d5a6fb56-c5d8-4322-88fd-f9b343f60a12" returned: 0 in 1.108s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:30:26 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-918c21ec-0774-4836-81ca-105b9612cc80 tempest-SnapshotMetadataTestJSON-1345646456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-d5a6fb56-c5d8-4322-88fd-f9b343f60a12,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-d5a6fb56-c5d8-4322-88fd-f9b343f60a12.050daed6-d314-4e89-956a-6365d23a445b 1G {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:30:26 devstack sudo[104372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-d5a6fb56-c5d8-4322-88fd-f9b343f60a12,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-d5a6fb56-c5d8-4322-88fd-f9b343f60a12.050daed6-d314-4e89-956a-6365d23a445b 1G Jun 29 03:30:26 devstack sudo[104372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:30:27 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-dcf45d02-fa70-4047-b465-e24d1f122cf6 tempest-VolumesExtendTest-1491885283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05b3ae82-8de5-4181-87bc-5450258b25da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ad02ddf-9ce4-4b52-84f6-bbae3ef86489', 'volume_size': 1, 'image_id': '24cf6ce1-1d2d-493f-a115-2a39928c82fb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/24cf6ce1-1d2d-493f-a115-2a39928c82fb', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1335b5873eea4762b9fea7f84dd1615c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '24cf6ce1-1d2d-493f-a115-2a39928c82fb', 'created_at': datetime.datetime(2026, 6, 29, 1, 13, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 29, 1, 13, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/24cf6ce1-1d2d-493f-a115-2a39928c82fb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:30:27 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-dcf45d02-fa70-4047-b465-e24d1f122cf6 tempest-VolumesExtendTest-1491885283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57dd72a9-3cf1-4f22-b508-6662acfce470) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:30:27 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-dcf45d02-fa70-4047-b465-e24d1f122cf6 tempest-VolumesExtendTest-1491885283 None] Volume volume-9ad02ddf-9ce4-4b52-84f6-bbae3ef86489 (9ad02ddf-9ce4-4b52-84f6-bbae3ef86489): created successfully Jun 29 03:30:27 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-dcf45d02-fa70-4047-b465-e24d1f122cf6 tempest-VolumesExtendTest-1491885283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57dd72a9-3cf1-4f22-b508-6662acfce470) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:30:27 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-dcf45d02-fa70-4047-b465-e24d1f122cf6 tempest-VolumesExtendTest-1491885283 None] Flow 'volume_create_manager' (4af42939-85b8-4419-ab01-cff1ea41a85d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:30:27 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-dcf45d02-fa70-4047-b465-e24d1f122cf6 tempest-VolumesExtendTest-1491885283 None] Created volume successfully. Jun 29 03:30:27 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-253c5b75-9527-47d1-b9be-9d35324d5088 tempest-VolumesListTestJSON-1640231735 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:30:27 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-253c5b75-9527-47d1-b9be-9d35324d5088 tempest-VolumesListTestJSON-1640231735 None] Flow 'volume_create_manager' (bcccde14-5fc6-4ae2-a20d-0ffc4b3fb20b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:30:27 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-253c5b75-9527-47d1-b9be-9d35324d5088 tempest-VolumesListTestJSON-1640231735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a09b78a-dab4-4197-a71e-855bd61c9804) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:30:27 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-253c5b75-9527-47d1-b9be-9d35324d5088 tempest-VolumesListTestJSON-1640231735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a09b78a-dab4-4197-a71e-855bd61c9804) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:30:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1851425016',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8220b712-fcfe-4377-8c4b-a2e679b20fd9,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='48fffe20de8148eba4cfaa6f9b130153',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:30:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:30:27Z,use_quota=True,user_id='6a181cd775824055b1f6a6496b974478',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:30:27 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-253c5b75-9527-47d1-b9be-9d35324d5088 tempest-VolumesListTestJSON-1640231735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bfa6793-2f05-4385-b98b-eb85dbf64a53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:30:27 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-253c5b75-9527-47d1-b9be-9d35324d5088 tempest-VolumesListTestJSON-1640231735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bfa6793-2f05-4385-b98b-eb85dbf64a53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:30:27 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-253c5b75-9527-47d1-b9be-9d35324d5088 tempest-VolumesListTestJSON-1640231735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a508c20-a7c9-4b7e-b2c0-4569cb4ce71a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:30:27 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-253c5b75-9527-47d1-b9be-9d35324d5088 tempest-VolumesListTestJSON-1640231735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a508c20-a7c9-4b7e-b2c0-4569cb4ce71a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8220b712-fcfe-4377-8c4b-a2e679b20fd9', 'volume_name': 'volume-8220b712-fcfe-4377-8c4b-a2e679b20fd9', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:30:27 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-253c5b75-9527-47d1-b9be-9d35324d5088 tempest-VolumesListTestJSON-1640231735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86b97301-9bae-4497-b1f1-5cc88acafe56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:30:27 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-253c5b75-9527-47d1-b9be-9d35324d5088 tempest-VolumesListTestJSON-1640231735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86b97301-9bae-4497-b1f1-5cc88acafe56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:30:27 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-253c5b75-9527-47d1-b9be-9d35324d5088 tempest-VolumesListTestJSON-1640231735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b409d79a-d854-4937-ab2e-5010f9fc59e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:30:27 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-253c5b75-9527-47d1-b9be-9d35324d5088 tempest-VolumesListTestJSON-1640231735 None] Volume 8220b712-fcfe-4377-8c4b-a2e679b20fd9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8220b712-fcfe-4377-8c4b-a2e679b20fd9', 'volume_size': 1} Jun 29 03:30:27 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-253c5b75-9527-47d1-b9be-9d35324d5088 tempest-VolumesListTestJSON-1640231735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:30:27 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-a172afb0-e9eb-4f23-8ff9-f577cee829f5 tempest-VolumesExtendTest-1491885283 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:30:27 devstack sudo[104372]: pam_unix(sudo:session): session closed for user root Jun 29 03:30:27 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-918c21ec-0774-4836-81ca-105b9612cc80 tempest-SnapshotMetadataTestJSON-1345646456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-d5a6fb56-c5d8-4322-88fd-f9b343f60a12,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-d5a6fb56-c5d8-4322-88fd-f9b343f60a12.050daed6-d314-4e89-956a-6365d23a445b 1G" returned: 0 in 1.016s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:30:27 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-918c21ec-0774-4836-81ca-105b9612cc80 tempest-SnapshotMetadataTestJSON-1345646456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d5a6fb56-c5d8-4322-88fd-f9b343f60a12 -F qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-d5a6fb56-c5d8-4322-88fd-f9b343f60a12.050daed6-d314-4e89-956a-6365d23a445b {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:30:27 devstack sudo[104377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d5a6fb56-c5d8-4322-88fd-f9b343f60a12 -F qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-d5a6fb56-c5d8-4322-88fd-f9b343f60a12.050daed6-d314-4e89-956a-6365d23a445b Jun 29 03:30:27 devstack sudo[104377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:30:28 devstack sudo[104377]: pam_unix(sudo:session): session closed for user root Jun 29 03:30:28 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-918c21ec-0774-4836-81ca-105b9612cc80 tempest-SnapshotMetadataTestJSON-1345646456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d5a6fb56-c5d8-4322-88fd-f9b343f60a12 -F qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-d5a6fb56-c5d8-4322-88fd-f9b343f60a12.050daed6-d314-4e89-956a-6365d23a445b" returned: 0 in 0.723s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:30:28 devstack cinder-volume[93468]: WARNING cinder.volume.drivers.remotefs [None req-918c21ec-0774-4836-81ca-105b9612cc80 tempest-SnapshotMetadataTestJSON-1345646456 None] /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-d5a6fb56-c5d8-4322-88fd-f9b343f60a12.050daed6-d314-4e89-956a-6365d23a445b is being set with open permissions: ugo+rw Jun 29 03:30:28 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-918c21ec-0774-4836-81ca-105b9612cc80 tempest-SnapshotMetadataTestJSON-1345646456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-d5a6fb56-c5d8-4322-88fd-f9b343f60a12.050daed6-d314-4e89-956a-6365d23a445b {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:30:28 devstack sudo[104382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-d5a6fb56-c5d8-4322-88fd-f9b343f60a12.050daed6-d314-4e89-956a-6365d23a445b Jun 29 03:30:28 devstack sudo[104382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:30:29 devstack sudo[104382]: pam_unix(sudo:session): session closed for user root Jun 29 03:30:29 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-918c21ec-0774-4836-81ca-105b9612cc80 tempest-SnapshotMetadataTestJSON-1345646456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-d5a6fb56-c5d8-4322-88fd-f9b343f60a12.050daed6-d314-4e89-956a-6365d23a445b" returned: 0 in 0.648s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:30:29 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-918c21ec-0774-4836-81ca-105b9612cc80 tempest-SnapshotMetadataTestJSON-1345646456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-d5a6fb56-c5d8-4322-88fd-f9b343f60a12.info {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:30:29 devstack sudo[104385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-d5a6fb56-c5d8-4322-88fd-f9b343f60a12.info Jun 29 03:30:29 devstack sudo[104385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:30:29 devstack sudo[104385]: pam_unix(sudo:session): session closed for user root Jun 29 03:30:30 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-918c21ec-0774-4836-81ca-105b9612cc80 tempest-SnapshotMetadataTestJSON-1345646456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-d5a6fb56-c5d8-4322-88fd-f9b343f60a12.info" returned: 0 in 0.648s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:30:30 devstack cinder-volume[93468]: WARNING cinder.volume.drivers.remotefs [None req-918c21ec-0774-4836-81ca-105b9612cc80 tempest-SnapshotMetadataTestJSON-1345646456 None] /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-d5a6fb56-c5d8-4322-88fd-f9b343f60a12.info is being set with open permissions: ugo+rw Jun 29 03:30:30 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-918c21ec-0774-4836-81ca-105b9612cc80 tempest-SnapshotMetadataTestJSON-1345646456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-d5a6fb56-c5d8-4322-88fd-f9b343f60a12.info {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:30:30 devstack sudo[104388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-d5a6fb56-c5d8-4322-88fd-f9b343f60a12.info Jun 29 03:30:30 devstack sudo[104388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:30:30 devstack sudo[104388]: pam_unix(sudo:session): session closed for user root Jun 29 03:30:30 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-918c21ec-0774-4836-81ca-105b9612cc80 tempest-SnapshotMetadataTestJSON-1345646456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-d5a6fb56-c5d8-4322-88fd-f9b343f60a12.info" returned: 0 in 0.639s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:30:30 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-918c21ec-0774-4836-81ca-105b9612cc80 tempest-SnapshotMetadataTestJSON-1345646456 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.894s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:30:30 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-253c5b75-9527-47d1-b9be-9d35324d5088 tempest-VolumesListTestJSON-1640231735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.017s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:30:30 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-253c5b75-9527-47d1-b9be-9d35324d5088 tempest-VolumesListTestJSON-1640231735 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:30:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1851425016',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8220b712-fcfe-4377-8c4b-a2e679b20fd9,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='48fffe20de8148eba4cfaa6f9b130153',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:30:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:30:27Z,use_quota=True,user_id='6a181cd775824055b1f6a6496b974478',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:30:30 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-253c5b75-9527-47d1-b9be-9d35324d5088 tempest-VolumesListTestJSON-1640231735 None] Creating volume 8220b712-fcfe-4377-8c4b-a2e679b20fd9 {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:30:30 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-253c5b75-9527-47d1-b9be-9d35324d5088 tempest-VolumesListTestJSON-1640231735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:30:30 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-253c5b75-9527-47d1-b9be-9d35324d5088 tempest-VolumesListTestJSON-1640231735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:30:30 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-253c5b75-9527-47d1-b9be-9d35324d5088 tempest-VolumesListTestJSON-1640231735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:30:30 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-253c5b75-9527-47d1-b9be-9d35324d5088 tempest-VolumesListTestJSON-1640231735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:30:30 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-253c5b75-9527-47d1-b9be-9d35324d5088 tempest-VolumesListTestJSON-1640231735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:30:30 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-253c5b75-9527-47d1-b9be-9d35324d5088 tempest-VolumesListTestJSON-1640231735 None] Selected osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:30:30 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-253c5b75-9527-47d1-b9be-9d35324d5088 tempest-VolumesListTestJSON-1640231735 None] casted to osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f Jun 29 03:30:30 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-253c5b75-9527-47d1-b9be-9d35324d5088 tempest-VolumesListTestJSON-1640231735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-8220b712-fcfe-4377-8c4b-a2e679b20fd9 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:30:30 devstack sudo[104391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-8220b712-fcfe-4377-8c4b-a2e679b20fd9 1073741824 Jun 29 03:30:30 devstack sudo[104391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:30:30 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-918c21ec-0774-4836-81ca-105b9612cc80 tempest-SnapshotMetadataTestJSON-1345646456 None] Create snapshot completed successfully Jun 29 03:30:31 devstack sudo[104391]: pam_unix(sudo:session): session closed for user root Jun 29 03:30:31 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-253c5b75-9527-47d1-b9be-9d35324d5088 tempest-VolumesListTestJSON-1640231735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-8220b712-fcfe-4377-8c4b-a2e679b20fd9 1073741824" returned: 0 in 0.942s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:30:31 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-253c5b75-9527-47d1-b9be-9d35324d5088 tempest-VolumesListTestJSON-1640231735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-8220b712-fcfe-4377-8c4b-a2e679b20fd9 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:30:31 devstack sudo[104399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-8220b712-fcfe-4377-8c4b-a2e679b20fd9 Jun 29 03:30:31 devstack sudo[104399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:30:31 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-0baa0244-64a1-4da5-80c9-fb13b31813cf tempest-SnapshotMetadataTestJSON-1345646456 None] Acquiring lock "cinder-050daed6-d314-4e89-956a-6365d23a445b-delete_snapshot" by "delete_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:30:31 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-0baa0244-64a1-4da5-80c9-fb13b31813cf tempest-SnapshotMetadataTestJSON-1345646456 None] Lock "cinder-050daed6-d314-4e89-956a-6365d23a445b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:30:31 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-0baa0244-64a1-4da5-80c9-fb13b31813cf tempest-SnapshotMetadataTestJSON-1345646456 None] Acquiring lock "cinder-quobyte-d5a6fb56-c5d8-4322-88fd-f9b343f60a12" by "delete_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:30:31 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-0baa0244-64a1-4da5-80c9-fb13b31813cf tempest-SnapshotMetadataTestJSON-1345646456 None] Lock "cinder-quobyte-d5a6fb56-c5d8-4322-88fd-f9b343f60a12" acquired by "delete_snapshot" :: waited 0.026s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:30:31 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-0baa0244-64a1-4da5-80c9-fb13b31813cf tempest-SnapshotMetadataTestJSON-1345646456 None] Acquiring lock "cinder-quobyte-050daed6-d314-4e89-956a-6365d23a445b" by "_delete_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:30:31 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-0baa0244-64a1-4da5-80c9-fb13b31813cf tempest-SnapshotMetadataTestJSON-1345646456 None] Lock "cinder-quobyte-050daed6-d314-4e89-956a-6365d23a445b" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:30:31 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-0baa0244-64a1-4da5-80c9-fb13b31813cf tempest-SnapshotMetadataTestJSON-1345646456 None] Deleting offline snapshot 050daed6-d314-4e89-956a-6365d23a445b of volume d5a6fb56-c5d8-4322-88fd-f9b343f60a12 {{(pid=93468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 29 03:30:31 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-0baa0244-64a1-4da5-80c9-fb13b31813cf tempest-SnapshotMetadataTestJSON-1345646456 None] snapshot_file for this snap is: volume-d5a6fb56-c5d8-4322-88fd-f9b343f60a12.050daed6-d314-4e89-956a-6365d23a445b {{(pid=93468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 29 03:30:31 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e44e6de-1038-462f-baf3-55f0830a944e]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:30:31 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-0baa0244-64a1-4da5-80c9-fb13b31813cf tempest-SnapshotMetadataTestJSON-1345646456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-d5a6fb56-c5d8-4322-88fd-f9b343f60a12.050daed6-d314-4e89-956a-6365d23a445b {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:30:32 devstack sudo[104401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-d5a6fb56-c5d8-4322-88fd-f9b343f60a12.050daed6-d314-4e89-956a-6365d23a445b Jun 29 03:30:32 devstack sudo[104401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:30:32 devstack sudo[104399]: pam_unix(sudo:session): session closed for user root Jun 29 03:30:32 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-253c5b75-9527-47d1-b9be-9d35324d5088 tempest-VolumesListTestJSON-1640231735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-8220b712-fcfe-4377-8c4b-a2e679b20fd9" returned: 0 in 0.707s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:30:32 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-253c5b75-9527-47d1-b9be-9d35324d5088 tempest-VolumesListTestJSON-1640231735 None] <== create_volume: return (1691ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:30:32 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-253c5b75-9527-47d1-b9be-9d35324d5088 tempest-VolumesListTestJSON-1640231735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.695s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:30:32 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-a172afb0-e9eb-4f23-8ff9-f577cee829f5 tempest-VolumesExtendTest-1491885283 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 4.691s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:30:32 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-253c5b75-9527-47d1-b9be-9d35324d5088 tempest-VolumesListTestJSON-1640231735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b409d79a-d854-4937-ab2e-5010f9fc59e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8220b712-fcfe-4377-8c4b-a2e679b20fd9', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:30:32 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-253c5b75-9527-47d1-b9be-9d35324d5088 tempest-VolumesListTestJSON-1640231735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (faab2567-19ee-4c24-8eaf-3d9398da6041) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:30:32 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[deddd15e-bc86-4f00-8cd2-394408a823f4]: (4, 'raw') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:30:32 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a172afb0-e9eb-4f23-8ff9-f577cee829f5 tempest-VolumesExtendTest-1491885283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9ad02ddf-9ce4-4b52-84f6-bbae3ef86489 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:30:32 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-253c5b75-9527-47d1-b9be-9d35324d5088 tempest-VolumesListTestJSON-1640231735 None] Volume volume-8220b712-fcfe-4377-8c4b-a2e679b20fd9 (8220b712-fcfe-4377-8c4b-a2e679b20fd9): created successfully Jun 29 03:30:32 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-253c5b75-9527-47d1-b9be-9d35324d5088 tempest-VolumesListTestJSON-1640231735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (faab2567-19ee-4c24-8eaf-3d9398da6041) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:30:32 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-253c5b75-9527-47d1-b9be-9d35324d5088 tempest-VolumesListTestJSON-1640231735 None] Flow 'volume_create_manager' (bcccde14-5fc6-4ae2-a20d-0ffc4b3fb20b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:30:32 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-253c5b75-9527-47d1-b9be-9d35324d5088 tempest-VolumesListTestJSON-1640231735 None] Created volume successfully. Jun 29 03:30:32 devstack sudo[104404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9ad02ddf-9ce4-4b52-84f6-bbae3ef86489 Jun 29 03:30:32 devstack sudo[104404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:30:32 devstack sudo[104401]: pam_unix(sudo:session): session closed for user root Jun 29 03:30:32 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-0baa0244-64a1-4da5-80c9-fb13b31813cf tempest-SnapshotMetadataTestJSON-1345646456 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-d5a6fb56-c5d8-4322-88fd-f9b343f60a12.050daed6-d314-4e89-956a-6365d23a445b" returned: 0 in 0.822s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:30:32 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-0baa0244-64a1-4da5-80c9-fb13b31813cf tempest-SnapshotMetadataTestJSON-1345646456 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d5a6fb56-c5d8-4322-88fd-f9b343f60a12(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93468) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 29 03:30:32 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[99b2c71c-1ed4-435e-a7e9-a901fbc3bd60]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:30:32 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-0baa0244-64a1-4da5-80c9-fb13b31813cf tempest-SnapshotMetadataTestJSON-1345646456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-d5a6fb56-c5d8-4322-88fd-f9b343f60a12 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:30:32 devstack sudo[104409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-d5a6fb56-c5d8-4322-88fd-f9b343f60a12 Jun 29 03:30:32 devstack sudo[104409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:30:33 devstack sudo[104404]: pam_unix(sudo:session): session closed for user root Jun 29 03:30:33 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a172afb0-e9eb-4f23-8ff9-f577cee829f5 tempest-VolumesExtendTest-1491885283 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9ad02ddf-9ce4-4b52-84f6-bbae3ef86489" returned: 0 in 0.896s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:30:33 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a172afb0-e9eb-4f23-8ff9-f577cee829f5 tempest-VolumesExtendTest-1491885283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9ad02ddf-9ce4-4b52-84f6-bbae3ef86489 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:30:33 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-87394ad4-d096-47e3-847f-9b5323a41531 tempest-VolumesListTestJSON-1640231735 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:30:33 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-87394ad4-d096-47e3-847f-9b5323a41531 tempest-VolumesListTestJSON-1640231735 None] Flow 'volume_create_manager' (74872a2b-ac8a-4779-89ab-c6aa8bbb31af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:30:33 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-87394ad4-d096-47e3-847f-9b5323a41531 tempest-VolumesListTestJSON-1640231735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eede03e2-abc9-446a-b234-eb54eab223b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:30:33 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-87394ad4-d096-47e3-847f-9b5323a41531 tempest-VolumesListTestJSON-1640231735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eede03e2-abc9-446a-b234-eb54eab223b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:30:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-402239073',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a2b1ad1-83e4-47e7-add3-d980be302406,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='48fffe20de8148eba4cfaa6f9b130153',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:30:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:30:33Z,use_quota=True,user_id='6a181cd775824055b1f6a6496b974478',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:30:33 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-87394ad4-d096-47e3-847f-9b5323a41531 tempest-VolumesListTestJSON-1640231735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3170d4d6-b817-40d6-a6cc-72fa5084386e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:30:33 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-87394ad4-d096-47e3-847f-9b5323a41531 tempest-VolumesListTestJSON-1640231735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3170d4d6-b817-40d6-a6cc-72fa5084386e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:30:33 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-87394ad4-d096-47e3-847f-9b5323a41531 tempest-VolumesListTestJSON-1640231735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4f2a429-f68e-4029-9bf7-8eb70e6916b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:30:33 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-87394ad4-d096-47e3-847f-9b5323a41531 tempest-VolumesListTestJSON-1640231735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4f2a429-f68e-4029-9bf7-8eb70e6916b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a2b1ad1-83e4-47e7-add3-d980be302406', 'volume_name': 'volume-1a2b1ad1-83e4-47e7-add3-d980be302406', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:30:33 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-87394ad4-d096-47e3-847f-9b5323a41531 tempest-VolumesListTestJSON-1640231735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a37c384f-ae22-45cb-b80c-5ab9586a9993) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:30:33 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-87394ad4-d096-47e3-847f-9b5323a41531 tempest-VolumesListTestJSON-1640231735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a37c384f-ae22-45cb-b80c-5ab9586a9993) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:30:33 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-87394ad4-d096-47e3-847f-9b5323a41531 tempest-VolumesListTestJSON-1640231735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1111a5d7-e1c5-41dc-b634-4bc4a96b2a0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:30:33 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-87394ad4-d096-47e3-847f-9b5323a41531 tempest-VolumesListTestJSON-1640231735 None] Volume 1a2b1ad1-83e4-47e7-add3-d980be302406: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a2b1ad1-83e4-47e7-add3-d980be302406', 'volume_size': 1} Jun 29 03:30:33 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-87394ad4-d096-47e3-847f-9b5323a41531 tempest-VolumesListTestJSON-1640231735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:30:33 devstack sudo[104413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9ad02ddf-9ce4-4b52-84f6-bbae3ef86489 Jun 29 03:30:33 devstack sudo[104413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:30:33 devstack sudo[104409]: pam_unix(sudo:session): session closed for user root Jun 29 03:30:33 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-0baa0244-64a1-4da5-80c9-fb13b31813cf tempest-SnapshotMetadataTestJSON-1345646456 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-d5a6fb56-c5d8-4322-88fd-f9b343f60a12" returned: 0 in 0.845s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:30:33 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-0baa0244-64a1-4da5-80c9-fb13b31813cf tempest-SnapshotMetadataTestJSON-1345646456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-d5a6fb56-c5d8-4322-88fd-f9b343f60a12.050daed6-d314-4e89-956a-6365d23a445b {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:30:33 devstack sudo[104418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-d5a6fb56-c5d8-4322-88fd-f9b343f60a12.050daed6-d314-4e89-956a-6365d23a445b Jun 29 03:30:33 devstack sudo[104418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:30:34 devstack sudo[104413]: pam_unix(sudo:session): session closed for user root Jun 29 03:30:34 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a172afb0-e9eb-4f23-8ff9-f577cee829f5 tempest-VolumesExtendTest-1491885283 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9ad02ddf-9ce4-4b52-84f6-bbae3ef86489" returned: 1 in 0.790s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:30:34 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a172afb0-e9eb-4f23-8ff9-f577cee829f5 tempest-VolumesExtendTest-1491885283 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9ad02ddf-9ce4-4b52-84f6-bbae3ef86489' failed. Not Retrying. {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 29 03:30:34 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a172afb0-e9eb-4f23-8ff9-f577cee829f5 tempest-VolumesExtendTest-1491885283 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9ad02ddf-9ce4-4b52-84f6-bbae3ef86489 2G {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:30:34 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a172afb0-e9eb-4f23-8ff9-f577cee829f5 tempest-VolumesExtendTest-1491885283 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9ad02ddf-9ce4-4b52-84f6-bbae3ef86489 2G" returned: 0 in 0.065s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:30:34 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-a172afb0-e9eb-4f23-8ff9-f577cee829f5 tempest-VolumesExtendTest-1491885283 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.800s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:30:34 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-87394ad4-d096-47e3-847f-9b5323a41531 tempest-VolumesListTestJSON-1640231735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.749s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:30:34 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-87394ad4-d096-47e3-847f-9b5323a41531 tempest-VolumesListTestJSON-1640231735 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:30:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-402239073',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a2b1ad1-83e4-47e7-add3-d980be302406,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='48fffe20de8148eba4cfaa6f9b130153',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:30:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:30:33Z,use_quota=True,user_id='6a181cd775824055b1f6a6496b974478',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:30:34 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-87394ad4-d096-47e3-847f-9b5323a41531 tempest-VolumesListTestJSON-1640231735 None] Creating volume 1a2b1ad1-83e4-47e7-add3-d980be302406 {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:30:34 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-87394ad4-d096-47e3-847f-9b5323a41531 tempest-VolumesListTestJSON-1640231735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:30:34 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-87394ad4-d096-47e3-847f-9b5323a41531 tempest-VolumesListTestJSON-1640231735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:30:34 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-87394ad4-d096-47e3-847f-9b5323a41531 tempest-VolumesListTestJSON-1640231735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:30:34 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-87394ad4-d096-47e3-847f-9b5323a41531 tempest-VolumesListTestJSON-1640231735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:30:34 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-87394ad4-d096-47e3-847f-9b5323a41531 tempest-VolumesListTestJSON-1640231735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:30:34 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-87394ad4-d096-47e3-847f-9b5323a41531 tempest-VolumesListTestJSON-1640231735 None] Selected osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:30:34 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-87394ad4-d096-47e3-847f-9b5323a41531 tempest-VolumesListTestJSON-1640231735 None] casted to osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f Jun 29 03:30:34 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-87394ad4-d096-47e3-847f-9b5323a41531 tempest-VolumesListTestJSON-1640231735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-1a2b1ad1-83e4-47e7-add3-d980be302406 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:30:34 devstack sudo[104428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-1a2b1ad1-83e4-47e7-add3-d980be302406 1073741824 Jun 29 03:30:34 devstack sudo[104428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:30:34 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-a172afb0-e9eb-4f23-8ff9-f577cee829f5 tempest-VolumesExtendTest-1491885283 None] Extend volume completed successfully. Jun 29 03:30:34 devstack sudo[104418]: pam_unix(sudo:session): session closed for user root Jun 29 03:30:34 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-0baa0244-64a1-4da5-80c9-fb13b31813cf tempest-SnapshotMetadataTestJSON-1345646456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-d5a6fb56-c5d8-4322-88fd-f9b343f60a12.050daed6-d314-4e89-956a-6365d23a445b" returned: 0 in 0.774s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:30:34 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-0baa0244-64a1-4da5-80c9-fb13b31813cf tempest-SnapshotMetadataTestJSON-1345646456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-d5a6fb56-c5d8-4322-88fd-f9b343f60a12.050daed6-d314-4e89-956a-6365d23a445b {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:30:34 devstack sudo[104432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-d5a6fb56-c5d8-4322-88fd-f9b343f60a12.050daed6-d314-4e89-956a-6365d23a445b Jun 29 03:30:34 devstack sudo[104432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:30:35 devstack sudo[104432]: pam_unix(sudo:session): session closed for user root Jun 29 03:30:35 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-0baa0244-64a1-4da5-80c9-fb13b31813cf tempest-SnapshotMetadataTestJSON-1345646456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-d5a6fb56-c5d8-4322-88fd-f9b343f60a12.050daed6-d314-4e89-956a-6365d23a445b" returned: 0 in 0.666s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:30:35 devstack sudo[104428]: pam_unix(sudo:session): session closed for user root Jun 29 03:30:35 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-87394ad4-d096-47e3-847f-9b5323a41531 tempest-VolumesListTestJSON-1640231735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-1a2b1ad1-83e4-47e7-add3-d980be302406 1073741824" returned: 0 in 0.878s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:30:35 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-0baa0244-64a1-4da5-80c9-fb13b31813cf tempest-SnapshotMetadataTestJSON-1345646456 None] Lock "cinder-quobyte-050daed6-d314-4e89-956a-6365d23a445b" released by "_delete_snapshot" :: held 3.243s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:30:35 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-0baa0244-64a1-4da5-80c9-fb13b31813cf tempest-SnapshotMetadataTestJSON-1345646456 None] Lock "cinder-quobyte-d5a6fb56-c5d8-4322-88fd-f9b343f60a12" released by "delete_snapshot" :: held 3.274s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:30:35 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-87394ad4-d096-47e3-847f-9b5323a41531 tempest-VolumesListTestJSON-1640231735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-1a2b1ad1-83e4-47e7-add3-d980be302406 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:30:35 devstack sudo[104438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-1a2b1ad1-83e4-47e7-add3-d980be302406 Jun 29 03:30:35 devstack sudo[104438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:30:35 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-0baa0244-64a1-4da5-80c9-fb13b31813cf tempest-SnapshotMetadataTestJSON-1345646456 None] Created reservations ['3510ca91-cfc0-4543-ad24-525df4d361c7', 'fb9ca763-e24e-4099-95fe-8cfa4ffa6aea', '14e0880d-1946-4151-a932-ec9ed970e2bc', 'baf9f249-40b6-4c27-96c2-02ee33a056c9'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:30:35 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-0baa0244-64a1-4da5-80c9-fb13b31813cf tempest-SnapshotMetadataTestJSON-1345646456 None] Delete snapshot completed successfully. Jun 29 03:30:35 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-0baa0244-64a1-4da5-80c9-fb13b31813cf tempest-SnapshotMetadataTestJSON-1345646456 None] Lock "cinder-050daed6-d314-4e89-956a-6365d23a445b-delete_snapshot" released by "delete_snapshot" :: held 3.463s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:30:35 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-85b835f1-609b-4bfd-bdfb-e86f1439df8a tempest-VolumesExtendTest-1491885283 None] Acquiring lock "cinder-9ad02ddf-9ce4-4b52-84f6-bbae3ef86489-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:30:35 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-85b835f1-609b-4bfd-bdfb-e86f1439df8a tempest-VolumesExtendTest-1491885283 None] Lock "cinder-9ad02ddf-9ce4-4b52-84f6-bbae3ef86489-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:30:35 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-85b835f1-609b-4bfd-bdfb-e86f1439df8a tempest-VolumesExtendTest-1491885283 None] Acquiring lock "cinder-quobyte-9ad02ddf-9ce4-4b52-84f6-bbae3ef86489" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:30:35 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-85b835f1-609b-4bfd-bdfb-e86f1439df8a tempest-VolumesExtendTest-1491885283 None] Lock "cinder-quobyte-9ad02ddf-9ce4-4b52-84f6-bbae3ef86489" acquired by "delete_volume" :: waited 0.018s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:30:35 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[7198ffaf-7ea9-418f-b215-58241998a0d8]: (4, 'raw') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:30:35 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-85b835f1-609b-4bfd-bdfb-e86f1439df8a tempest-VolumesExtendTest-1491885283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9ad02ddf-9ce4-4b52-84f6-bbae3ef86489 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:30:35 devstack sudo[104440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9ad02ddf-9ce4-4b52-84f6-bbae3ef86489 Jun 29 03:30:35 devstack sudo[104440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:30:35 devstack sudo[104438]: pam_unix(sudo:session): session closed for user root Jun 29 03:30:35 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-87394ad4-d096-47e3-847f-9b5323a41531 tempest-VolumesListTestJSON-1640231735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-1a2b1ad1-83e4-47e7-add3-d980be302406" returned: 0 in 0.695s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:30:35 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-87394ad4-d096-47e3-847f-9b5323a41531 tempest-VolumesListTestJSON-1640231735 None] <== create_volume: return (1650ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:30:35 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-87394ad4-d096-47e3-847f-9b5323a41531 tempest-VolumesListTestJSON-1640231735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.654s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:30:35 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-87394ad4-d096-47e3-847f-9b5323a41531 tempest-VolumesListTestJSON-1640231735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1111a5d7-e1c5-41dc-b634-4bc4a96b2a0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a2b1ad1-83e4-47e7-add3-d980be302406', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:30:35 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-87394ad4-d096-47e3-847f-9b5323a41531 tempest-VolumesListTestJSON-1640231735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51ccc05f-55da-4bdf-bab6-45e9b20d600d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:30:35 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-87394ad4-d096-47e3-847f-9b5323a41531 tempest-VolumesListTestJSON-1640231735 None] Volume volume-1a2b1ad1-83e4-47e7-add3-d980be302406 (1a2b1ad1-83e4-47e7-add3-d980be302406): created successfully Jun 29 03:30:35 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-87394ad4-d096-47e3-847f-9b5323a41531 tempest-VolumesListTestJSON-1640231735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51ccc05f-55da-4bdf-bab6-45e9b20d600d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:30:35 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-87394ad4-d096-47e3-847f-9b5323a41531 tempest-VolumesListTestJSON-1640231735 None] Flow 'volume_create_manager' (74872a2b-ac8a-4779-89ab-c6aa8bbb31af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:30:35 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-87394ad4-d096-47e3-847f-9b5323a41531 tempest-VolumesListTestJSON-1640231735 None] Created volume successfully. Jun 29 03:30:36 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-2ebe2d0e-d778-449d-a0b2-19d3d6df9036 tempest-SnapshotMetadataTestJSON-1345646456 None] Acquiring lock "cinder-d5a6fb56-c5d8-4322-88fd-f9b343f60a12-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:30:36 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-2ebe2d0e-d778-449d-a0b2-19d3d6df9036 tempest-SnapshotMetadataTestJSON-1345646456 None] Lock "cinder-d5a6fb56-c5d8-4322-88fd-f9b343f60a12-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:30:36 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-2ebe2d0e-d778-449d-a0b2-19d3d6df9036 tempest-SnapshotMetadataTestJSON-1345646456 None] Acquiring lock "cinder-quobyte-d5a6fb56-c5d8-4322-88fd-f9b343f60a12" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:30:36 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-2ebe2d0e-d778-449d-a0b2-19d3d6df9036 tempest-SnapshotMetadataTestJSON-1345646456 None] Lock "cinder-quobyte-d5a6fb56-c5d8-4322-88fd-f9b343f60a12" acquired by "delete_volume" :: waited 0.015s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:30:36 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[18339617-182e-48cb-8d1a-8e1637ae24c7]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:30:36 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2ebe2d0e-d778-449d-a0b2-19d3d6df9036 tempest-SnapshotMetadataTestJSON-1345646456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-d5a6fb56-c5d8-4322-88fd-f9b343f60a12 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:30:36 devstack sudo[104440]: pam_unix(sudo:session): session closed for user root Jun 29 03:30:36 devstack sudo[104445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-d5a6fb56-c5d8-4322-88fd-f9b343f60a12 Jun 29 03:30:36 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-85b835f1-609b-4bfd-bdfb-e86f1439df8a tempest-VolumesExtendTest-1491885283 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9ad02ddf-9ce4-4b52-84f6-bbae3ef86489" returned: 0 in 0.782s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:30:36 devstack sudo[104445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:30:36 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-85b835f1-609b-4bfd-bdfb-e86f1439df8a tempest-VolumesExtendTest-1491885283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9ad02ddf-9ce4-4b52-84f6-bbae3ef86489 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:30:36 devstack sudo[104447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9ad02ddf-9ce4-4b52-84f6-bbae3ef86489 Jun 29 03:30:36 devstack sudo[104447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:30:37 devstack sudo[104445]: pam_unix(sudo:session): session closed for user root Jun 29 03:30:37 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2ebe2d0e-d778-449d-a0b2-19d3d6df9036 tempest-SnapshotMetadataTestJSON-1345646456 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-d5a6fb56-c5d8-4322-88fd-f9b343f60a12" returned: 0 in 0.847s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:30:37 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2ebe2d0e-d778-449d-a0b2-19d3d6df9036 tempest-SnapshotMetadataTestJSON-1345646456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-d5a6fb56-c5d8-4322-88fd-f9b343f60a12 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:30:37 devstack sudo[104456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-d5a6fb56-c5d8-4322-88fd-f9b343f60a12 Jun 29 03:30:37 devstack sudo[104456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:30:37 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-134fb432-f2c5-4dac-aeb7-009a336c0731 tempest-VolumesListTestJSON-1640231735 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:30:37 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-134fb432-f2c5-4dac-aeb7-009a336c0731 tempest-VolumesListTestJSON-1640231735 None] Flow 'volume_create_manager' (383b54e5-369f-48ea-beb8-272a29b17832) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:30:37 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-134fb432-f2c5-4dac-aeb7-009a336c0731 tempest-VolumesListTestJSON-1640231735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66e22844-d453-4302-8914-5855075a8df2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:30:37 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-134fb432-f2c5-4dac-aeb7-009a336c0731 tempest-VolumesListTestJSON-1640231735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66e22844-d453-4302-8914-5855075a8df2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:30:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-926144704',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=962a7935-7d07-4493-9179-09c7011fc17b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='48fffe20de8148eba4cfaa6f9b130153',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:30:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:30:37Z,use_quota=True,user_id='6a181cd775824055b1f6a6496b974478',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:30:37 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-134fb432-f2c5-4dac-aeb7-009a336c0731 tempest-VolumesListTestJSON-1640231735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fbf8cef-d219-4c75-9b96-28e6969c1de8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:30:37 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-134fb432-f2c5-4dac-aeb7-009a336c0731 tempest-VolumesListTestJSON-1640231735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fbf8cef-d219-4c75-9b96-28e6969c1de8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:30:37 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-134fb432-f2c5-4dac-aeb7-009a336c0731 tempest-VolumesListTestJSON-1640231735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d0d1427-d4e4-4940-a1f8-fd4b968d46b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:30:37 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-134fb432-f2c5-4dac-aeb7-009a336c0731 tempest-VolumesListTestJSON-1640231735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d0d1427-d4e4-4940-a1f8-fd4b968d46b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '962a7935-7d07-4493-9179-09c7011fc17b', 'volume_name': 'volume-962a7935-7d07-4493-9179-09c7011fc17b', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:30:37 devstack sudo[104447]: pam_unix(sudo:session): session closed for user root Jun 29 03:30:37 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-134fb432-f2c5-4dac-aeb7-009a336c0731 tempest-VolumesListTestJSON-1640231735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba2411e3-ac45-4bdf-8a07-ad1e2a00f307) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:30:37 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-134fb432-f2c5-4dac-aeb7-009a336c0731 tempest-VolumesListTestJSON-1640231735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba2411e3-ac45-4bdf-8a07-ad1e2a00f307) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:30:37 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-134fb432-f2c5-4dac-aeb7-009a336c0731 tempest-VolumesListTestJSON-1640231735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97911838-4ac9-4160-8507-f25807301c5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:30:37 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-134fb432-f2c5-4dac-aeb7-009a336c0731 tempest-VolumesListTestJSON-1640231735 None] Volume 962a7935-7d07-4493-9179-09c7011fc17b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-962a7935-7d07-4493-9179-09c7011fc17b', 'volume_size': 1} Jun 29 03:30:37 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-134fb432-f2c5-4dac-aeb7-009a336c0731 tempest-VolumesListTestJSON-1640231735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:30:37 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-134fb432-f2c5-4dac-aeb7-009a336c0731 tempest-VolumesListTestJSON-1640231735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:30:37 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-134fb432-f2c5-4dac-aeb7-009a336c0731 tempest-VolumesListTestJSON-1640231735 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:30:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-926144704',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=962a7935-7d07-4493-9179-09c7011fc17b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='48fffe20de8148eba4cfaa6f9b130153',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:30:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:30:37Z,use_quota=True,user_id='6a181cd775824055b1f6a6496b974478',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:30:37 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-134fb432-f2c5-4dac-aeb7-009a336c0731 tempest-VolumesListTestJSON-1640231735 None] Creating volume 962a7935-7d07-4493-9179-09c7011fc17b {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:30:37 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-134fb432-f2c5-4dac-aeb7-009a336c0731 tempest-VolumesListTestJSON-1640231735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:30:37 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-134fb432-f2c5-4dac-aeb7-009a336c0731 tempest-VolumesListTestJSON-1640231735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:30:37 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-134fb432-f2c5-4dac-aeb7-009a336c0731 tempest-VolumesListTestJSON-1640231735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:30:37 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-134fb432-f2c5-4dac-aeb7-009a336c0731 tempest-VolumesListTestJSON-1640231735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:30:37 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-134fb432-f2c5-4dac-aeb7-009a336c0731 tempest-VolumesListTestJSON-1640231735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:30:37 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-134fb432-f2c5-4dac-aeb7-009a336c0731 tempest-VolumesListTestJSON-1640231735 None] Selected osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:30:37 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-134fb432-f2c5-4dac-aeb7-009a336c0731 tempest-VolumesListTestJSON-1640231735 None] casted to osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f Jun 29 03:30:37 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-134fb432-f2c5-4dac-aeb7-009a336c0731 tempest-VolumesListTestJSON-1640231735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-962a7935-7d07-4493-9179-09c7011fc17b 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:30:37 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-85b835f1-609b-4bfd-bdfb-e86f1439df8a tempest-VolumesExtendTest-1491885283 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9ad02ddf-9ce4-4b52-84f6-bbae3ef86489" returned: 1 in 0.895s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:30:37 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-85b835f1-609b-4bfd-bdfb-e86f1439df8a tempest-VolumesExtendTest-1491885283 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9ad02ddf-9ce4-4b52-84f6-bbae3ef86489' failed. Not Retrying. {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 29 03:30:37 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-85b835f1-609b-4bfd-bdfb-e86f1439df8a tempest-VolumesExtendTest-1491885283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9ad02ddf-9ce4-4b52-84f6-bbae3ef86489 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:30:37 devstack sudo[104458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-962a7935-7d07-4493-9179-09c7011fc17b 1073741824 Jun 29 03:30:37 devstack sudo[104458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:30:37 devstack sudo[104459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9ad02ddf-9ce4-4b52-84f6-bbae3ef86489 Jun 29 03:30:37 devstack sudo[104459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:30:37 devstack sudo[104456]: pam_unix(sudo:session): session closed for user root Jun 29 03:30:37 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2ebe2d0e-d778-449d-a0b2-19d3d6df9036 tempest-SnapshotMetadataTestJSON-1345646456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-d5a6fb56-c5d8-4322-88fd-f9b343f60a12" returned: 0 in 0.796s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:30:37 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-2ebe2d0e-d778-449d-a0b2-19d3d6df9036 tempest-SnapshotMetadataTestJSON-1345646456 None] Lock "cinder-quobyte-d5a6fb56-c5d8-4322-88fd-f9b343f60a12" released by "delete_volume" :: held 1.710s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:30:37 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-2ebe2d0e-d778-449d-a0b2-19d3d6df9036 tempest-SnapshotMetadataTestJSON-1345646456 None] Created reservations ['c7d8b1d6-5b07-4174-8b9a-d68dbfa2b58c', 'b92e343f-5b9c-4678-bdbf-e5bdb3bae760', '1ac9b4da-122a-48fa-b4e6-854963a949b5', '2fe87cdf-4f1e-4a77-b7a3-c1c887ebd36c'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:30:37 devstack sudo[104459]: pam_unix(sudo:session): session closed for user root Jun 29 03:30:37 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-85b835f1-609b-4bfd-bdfb-e86f1439df8a tempest-VolumesExtendTest-1491885283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9ad02ddf-9ce4-4b52-84f6-bbae3ef86489" returned: 0 in 0.758s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:30:37 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-85b835f1-609b-4bfd-bdfb-e86f1439df8a tempest-VolumesExtendTest-1491885283 None] Lock "cinder-quobyte-9ad02ddf-9ce4-4b52-84f6-bbae3ef86489" released by "delete_volume" :: held 2.506s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:30:38 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-2ebe2d0e-d778-449d-a0b2-19d3d6df9036 tempest-SnapshotMetadataTestJSON-1345646456 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:30:38 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-2ebe2d0e-d778-449d-a0b2-19d3d6df9036 tempest-SnapshotMetadataTestJSON-1345646456 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:30:38 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-2ebe2d0e-d778-449d-a0b2-19d3d6df9036 tempest-SnapshotMetadataTestJSON-1345646456 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:30:38 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-2ebe2d0e-d778-449d-a0b2-19d3d6df9036 tempest-SnapshotMetadataTestJSON-1345646456 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:30:38 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-2ebe2d0e-d778-449d-a0b2-19d3d6df9036 tempest-SnapshotMetadataTestJSON-1345646456 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:30:38 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2ebe2d0e-d778-449d-a0b2-19d3d6df9036 tempest-SnapshotMetadataTestJSON-1345646456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:30:38 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-85b835f1-609b-4bfd-bdfb-e86f1439df8a tempest-VolumesExtendTest-1491885283 None] Created reservations ['3cc0e0a7-dc86-431f-b8c2-b87a063d2586', '577ce575-2257-417b-947a-dd98e52fbab4', '94922b0f-c92a-4afb-925a-9c8606a8602b', '0d07ca44-c020-4da1-b720-6369765dcc07'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:30:38 devstack sudo[104467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf Jun 29 03:30:38 devstack sudo[104467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:30:38 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-85b835f1-609b-4bfd-bdfb-e86f1439df8a tempest-VolumesExtendTest-1491885283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:30:38 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-85b835f1-609b-4bfd-bdfb-e86f1439df8a tempest-VolumesExtendTest-1491885283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:30:38 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-85b835f1-609b-4bfd-bdfb-e86f1439df8a tempest-VolumesExtendTest-1491885283 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:30:38 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-85b835f1-609b-4bfd-bdfb-e86f1439df8a tempest-VolumesExtendTest-1491885283 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:30:38 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-85b835f1-609b-4bfd-bdfb-e86f1439df8a tempest-VolumesExtendTest-1491885283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:30:38 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-85b835f1-609b-4bfd-bdfb-e86f1439df8a tempest-VolumesExtendTest-1491885283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:30:38 devstack sudo[104458]: pam_unix(sudo:session): session closed for user root Jun 29 03:30:38 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-134fb432-f2c5-4dac-aeb7-009a336c0731 tempest-VolumesListTestJSON-1640231735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-962a7935-7d07-4493-9179-09c7011fc17b 1073741824" returned: 0 in 1.068s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:30:38 devstack sudo[104469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf Jun 29 03:30:38 devstack sudo[104469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:30:38 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-134fb432-f2c5-4dac-aeb7-009a336c0731 tempest-VolumesListTestJSON-1640231735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-962a7935-7d07-4493-9179-09c7011fc17b {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:30:38 devstack sudo[104471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-962a7935-7d07-4493-9179-09c7011fc17b Jun 29 03:30:38 devstack sudo[104471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:30:39 devstack sudo[104467]: pam_unix(sudo:session): session closed for user root Jun 29 03:30:39 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2ebe2d0e-d778-449d-a0b2-19d3d6df9036 tempest-SnapshotMetadataTestJSON-1345646456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf" returned: 0 in 1.040s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:30:39 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-2ebe2d0e-d778-449d-a0b2-19d3d6df9036 tempest-SnapshotMetadataTestJSON-1345646456 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:30:39 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-2ebe2d0e-d778-449d-a0b2-19d3d6df9036 tempest-SnapshotMetadataTestJSON-1345646456 None] Deleted volume successfully. Jun 29 03:30:39 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-2ebe2d0e-d778-449d-a0b2-19d3d6df9036 tempest-SnapshotMetadataTestJSON-1345646456 None] Lock "cinder-d5a6fb56-c5d8-4322-88fd-f9b343f60a12-delete_volume" released by "delete_volume" :: held 3.066s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:30:39 devstack sudo[104469]: pam_unix(sudo:session): session closed for user root Jun 29 03:30:39 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-85b835f1-609b-4bfd-bdfb-e86f1439df8a tempest-VolumesExtendTest-1491885283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf" returned: 0 in 1.142s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:30:39 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-85b835f1-609b-4bfd-bdfb-e86f1439df8a tempest-VolumesExtendTest-1491885283 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:30:39 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-85b835f1-609b-4bfd-bdfb-e86f1439df8a tempest-VolumesExtendTest-1491885283 None] Deleted volume successfully. Jun 29 03:30:39 devstack sudo[104471]: pam_unix(sudo:session): session closed for user root Jun 29 03:30:39 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-134fb432-f2c5-4dac-aeb7-009a336c0731 tempest-VolumesListTestJSON-1640231735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-962a7935-7d07-4493-9179-09c7011fc17b" returned: 0 in 1.062s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:30:39 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-134fb432-f2c5-4dac-aeb7-009a336c0731 tempest-VolumesListTestJSON-1640231735 None] <== create_volume: return (2203ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:30:39 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-134fb432-f2c5-4dac-aeb7-009a336c0731 tempest-VolumesListTestJSON-1640231735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.207s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:30:39 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-85b835f1-609b-4bfd-bdfb-e86f1439df8a tempest-VolumesExtendTest-1491885283 None] Lock "cinder-9ad02ddf-9ce4-4b52-84f6-bbae3ef86489-delete_volume" released by "delete_volume" :: held 3.984s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:30:39 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-134fb432-f2c5-4dac-aeb7-009a336c0731 tempest-VolumesListTestJSON-1640231735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97911838-4ac9-4160-8507-f25807301c5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-962a7935-7d07-4493-9179-09c7011fc17b', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:30:39 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-134fb432-f2c5-4dac-aeb7-009a336c0731 tempest-VolumesListTestJSON-1640231735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50c79d22-be10-425d-8517-3111840b376a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:30:39 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-134fb432-f2c5-4dac-aeb7-009a336c0731 tempest-VolumesListTestJSON-1640231735 None] Volume volume-962a7935-7d07-4493-9179-09c7011fc17b (962a7935-7d07-4493-9179-09c7011fc17b): created successfully Jun 29 03:30:39 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-134fb432-f2c5-4dac-aeb7-009a336c0731 tempest-VolumesListTestJSON-1640231735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50c79d22-be10-425d-8517-3111840b376a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:30:39 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-134fb432-f2c5-4dac-aeb7-009a336c0731 tempest-VolumesListTestJSON-1640231735 None] Flow 'volume_create_manager' (383b54e5-369f-48ea-beb8-272a29b17832) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:30:39 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-134fb432-f2c5-4dac-aeb7-009a336c0731 tempest-VolumesListTestJSON-1640231735 None] Created volume successfully. Jun 29 03:30:39 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-278e14c8-b661-4e37-a20e-7297d592f75f tempest-VolumesExtendTest-1491885283 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:30:39 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-278e14c8-b661-4e37-a20e-7297d592f75f tempest-VolumesExtendTest-1491885283 None] Flow 'volume_create_manager' (dbd20f25-f84a-4fae-8c56-7007214a0449) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:30:39 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-278e14c8-b661-4e37-a20e-7297d592f75f tempest-VolumesExtendTest-1491885283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4920819c-d96d-4e22-9637-a22245b275d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:30:39 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-278e14c8-b661-4e37-a20e-7297d592f75f tempest-VolumesExtendTest-1491885283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4920819c-d96d-4e22-9637-a22245b275d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:30:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1686941252',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18ebe93c-5d60-48b2-b6c9-381d53f2187d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af692eda75a64a209207ebf0feb1875e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:30:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:30:39Z,use_quota=True,user_id='8244e3ddb5cf44298377b44a9395cc8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:30:39 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-278e14c8-b661-4e37-a20e-7297d592f75f tempest-VolumesExtendTest-1491885283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (236a65c6-a592-48ff-80e4-1c1660f32544) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:30:39 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-278e14c8-b661-4e37-a20e-7297d592f75f tempest-VolumesExtendTest-1491885283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (236a65c6-a592-48ff-80e4-1c1660f32544) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:30:39 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-278e14c8-b661-4e37-a20e-7297d592f75f tempest-VolumesExtendTest-1491885283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0bce93b4-c5f2-4a16-b1d4-c82d1f748515) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:30:39 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-278e14c8-b661-4e37-a20e-7297d592f75f tempest-VolumesExtendTest-1491885283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0bce93b4-c5f2-4a16-b1d4-c82d1f748515) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '18ebe93c-5d60-48b2-b6c9-381d53f2187d', 'volume_name': 'volume-18ebe93c-5d60-48b2-b6c9-381d53f2187d', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:30:39 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-278e14c8-b661-4e37-a20e-7297d592f75f tempest-VolumesExtendTest-1491885283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bb54c6a-cdf5-44fb-b783-e90473e43d7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:30:39 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-278e14c8-b661-4e37-a20e-7297d592f75f tempest-VolumesExtendTest-1491885283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bb54c6a-cdf5-44fb-b783-e90473e43d7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:30:39 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-278e14c8-b661-4e37-a20e-7297d592f75f tempest-VolumesExtendTest-1491885283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b12fe174-3dc5-4472-a0c1-7662cf453a7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:30:39 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-278e14c8-b661-4e37-a20e-7297d592f75f tempest-VolumesExtendTest-1491885283 None] Volume 18ebe93c-5d60-48b2-b6c9-381d53f2187d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-18ebe93c-5d60-48b2-b6c9-381d53f2187d', 'volume_size': 1} Jun 29 03:30:39 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-278e14c8-b661-4e37-a20e-7297d592f75f tempest-VolumesExtendTest-1491885283 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:30:39 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-278e14c8-b661-4e37-a20e-7297d592f75f tempest-VolumesExtendTest-1491885283 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:30:39 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-278e14c8-b661-4e37-a20e-7297d592f75f tempest-VolumesExtendTest-1491885283 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:30:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1686941252',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18ebe93c-5d60-48b2-b6c9-381d53f2187d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af692eda75a64a209207ebf0feb1875e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:30:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:30:39Z,use_quota=True,user_id='8244e3ddb5cf44298377b44a9395cc8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:30:39 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-278e14c8-b661-4e37-a20e-7297d592f75f tempest-VolumesExtendTest-1491885283 None] Creating volume 18ebe93c-5d60-48b2-b6c9-381d53f2187d {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:30:39 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-278e14c8-b661-4e37-a20e-7297d592f75f tempest-VolumesExtendTest-1491885283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:30:39 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-278e14c8-b661-4e37-a20e-7297d592f75f tempest-VolumesExtendTest-1491885283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:30:39 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-278e14c8-b661-4e37-a20e-7297d592f75f tempest-VolumesExtendTest-1491885283 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:30:39 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-278e14c8-b661-4e37-a20e-7297d592f75f tempest-VolumesExtendTest-1491885283 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:30:39 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-278e14c8-b661-4e37-a20e-7297d592f75f tempest-VolumesExtendTest-1491885283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:30:39 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-278e14c8-b661-4e37-a20e-7297d592f75f tempest-VolumesExtendTest-1491885283 None] Selected osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:30:39 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-278e14c8-b661-4e37-a20e-7297d592f75f tempest-VolumesExtendTest-1491885283 None] casted to osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f Jun 29 03:30:39 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-278e14c8-b661-4e37-a20e-7297d592f75f tempest-VolumesExtendTest-1491885283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-18ebe93c-5d60-48b2-b6c9-381d53f2187d 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:30:39 devstack sudo[104476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-18ebe93c-5d60-48b2-b6c9-381d53f2187d 1073741824 Jun 29 03:30:39 devstack sudo[104476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:30:40 devstack sudo[104476]: pam_unix(sudo:session): session closed for user root Jun 29 03:30:40 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-278e14c8-b661-4e37-a20e-7297d592f75f tempest-VolumesExtendTest-1491885283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-18ebe93c-5d60-48b2-b6c9-381d53f2187d 1073741824" returned: 0 in 1.051s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:30:40 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-278e14c8-b661-4e37-a20e-7297d592f75f tempest-VolumesExtendTest-1491885283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-18ebe93c-5d60-48b2-b6c9-381d53f2187d {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:30:40 devstack sudo[104518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-18ebe93c-5d60-48b2-b6c9-381d53f2187d Jun 29 03:30:40 devstack sudo[104518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:30:41 devstack sudo[104518]: pam_unix(sudo:session): session closed for user root Jun 29 03:30:41 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-278e14c8-b661-4e37-a20e-7297d592f75f tempest-VolumesExtendTest-1491885283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-18ebe93c-5d60-48b2-b6c9-381d53f2187d" returned: 0 in 0.787s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:30:41 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-278e14c8-b661-4e37-a20e-7297d592f75f tempest-VolumesExtendTest-1491885283 None] <== create_volume: return (1887ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:30:41 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-278e14c8-b661-4e37-a20e-7297d592f75f tempest-VolumesExtendTest-1491885283 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.889s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:30:41 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-278e14c8-b661-4e37-a20e-7297d592f75f tempest-VolumesExtendTest-1491885283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b12fe174-3dc5-4472-a0c1-7662cf453a7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-18ebe93c-5d60-48b2-b6c9-381d53f2187d', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:30:41 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-278e14c8-b661-4e37-a20e-7297d592f75f tempest-VolumesExtendTest-1491885283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bbf3180-53b3-49e9-9b5c-f73f281ded41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:30:41 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-278e14c8-b661-4e37-a20e-7297d592f75f tempest-VolumesExtendTest-1491885283 None] Volume volume-18ebe93c-5d60-48b2-b6c9-381d53f2187d (18ebe93c-5d60-48b2-b6c9-381d53f2187d): created successfully Jun 29 03:30:41 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-278e14c8-b661-4e37-a20e-7297d592f75f tempest-VolumesExtendTest-1491885283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bbf3180-53b3-49e9-9b5c-f73f281ded41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:30:41 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-278e14c8-b661-4e37-a20e-7297d592f75f tempest-VolumesExtendTest-1491885283 None] Flow 'volume_create_manager' (dbd20f25-f84a-4fae-8c56-7007214a0449) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:30:41 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-278e14c8-b661-4e37-a20e-7297d592f75f tempest-VolumesExtendTest-1491885283 None] Created volume successfully. Jun 29 03:30:42 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-0992b935-2c78-4d60-aec0-2d1118294ddc tempest-VolumesListTestJSON-1640231735 None] Acquiring lock "cinder-962a7935-7d07-4493-9179-09c7011fc17b-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:30:42 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-0992b935-2c78-4d60-aec0-2d1118294ddc tempest-VolumesListTestJSON-1640231735 None] Lock "cinder-962a7935-7d07-4493-9179-09c7011fc17b-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:30:42 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-ebf58455-8d44-4c4e-bdde-d742a2f48028 tempest-VolumesExtendTest-1491885283 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:30:42 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-ebf58455-8d44-4c4e-bdde-d742a2f48028 tempest-VolumesExtendTest-1491885283 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:30:43 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-ebf58455-8d44-4c4e-bdde-d742a2f48028 tempest-VolumesExtendTest-1491885283 None] Creating offline snapshot 87e9253d-f1c5-4c7d-b229-69c1eaafc506 of volume 18ebe93c-5d60-48b2-b6c9-381d53f2187d {{(pid=93468) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 29 03:30:43 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-0992b935-2c78-4d60-aec0-2d1118294ddc tempest-VolumesListTestJSON-1640231735 None] Acquiring lock "cinder-quobyte-962a7935-7d07-4493-9179-09c7011fc17b" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:30:43 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[5af1bf06-0008-46d8-acc7-1bd9d378d54f]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:30:43 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ebf58455-8d44-4c4e-bdde-d742a2f48028 tempest-VolumesExtendTest-1491885283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-18ebe93c-5d60-48b2-b6c9-381d53f2187d {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:30:43 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-0992b935-2c78-4d60-aec0-2d1118294ddc tempest-VolumesListTestJSON-1640231735 None] Lock "cinder-quobyte-962a7935-7d07-4493-9179-09c7011fc17b" acquired by "delete_volume" :: waited 0.037s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:30:43 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c399226-a047-4c35-9423-532d7367f84b]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:30:43 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-0992b935-2c78-4d60-aec0-2d1118294ddc tempest-VolumesListTestJSON-1640231735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-962a7935-7d07-4493-9179-09c7011fc17b {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:30:43 devstack sudo[104525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-18ebe93c-5d60-48b2-b6c9-381d53f2187d Jun 29 03:30:43 devstack sudo[104525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:30:43 devstack sudo[104526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-962a7935-7d07-4493-9179-09c7011fc17b Jun 29 03:30:43 devstack sudo[104526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:30:44 devstack sudo[104525]: pam_unix(sudo:session): session closed for user root Jun 29 03:30:44 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ebf58455-8d44-4c4e-bdde-d742a2f48028 tempest-VolumesExtendTest-1491885283 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-18ebe93c-5d60-48b2-b6c9-381d53f2187d" returned: 0 in 1.082s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:30:44 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ebf58455-8d44-4c4e-bdde-d742a2f48028 tempest-VolumesExtendTest-1491885283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-18ebe93c-5d60-48b2-b6c9-381d53f2187d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-18ebe93c-5d60-48b2-b6c9-381d53f2187d.87e9253d-f1c5-4c7d-b229-69c1eaafc506 1G {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:30:44 devstack sudo[104576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-18ebe93c-5d60-48b2-b6c9-381d53f2187d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-18ebe93c-5d60-48b2-b6c9-381d53f2187d.87e9253d-f1c5-4c7d-b229-69c1eaafc506 1G Jun 29 03:30:44 devstack sudo[104576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:30:44 devstack sudo[104526]: pam_unix(sudo:session): session closed for user root Jun 29 03:30:44 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-0992b935-2c78-4d60-aec0-2d1118294ddc tempest-VolumesListTestJSON-1640231735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-962a7935-7d07-4493-9179-09c7011fc17b" returned: 0 in 1.125s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:30:44 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-0992b935-2c78-4d60-aec0-2d1118294ddc tempest-VolumesListTestJSON-1640231735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-962a7935-7d07-4493-9179-09c7011fc17b {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:30:44 devstack sudo[104578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-962a7935-7d07-4493-9179-09c7011fc17b Jun 29 03:30:44 devstack sudo[104578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:30:45 devstack sudo[104578]: pam_unix(sudo:session): session closed for user root Jun 29 03:30:45 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-0992b935-2c78-4d60-aec0-2d1118294ddc tempest-VolumesListTestJSON-1640231735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-962a7935-7d07-4493-9179-09c7011fc17b" returned: 0 in 0.847s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:30:45 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-0992b935-2c78-4d60-aec0-2d1118294ddc tempest-VolumesListTestJSON-1640231735 None] Lock "cinder-quobyte-962a7935-7d07-4493-9179-09c7011fc17b" released by "delete_volume" :: held 2.032s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:30:45 devstack sudo[104576]: pam_unix(sudo:session): session closed for user root Jun 29 03:30:45 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ebf58455-8d44-4c4e-bdde-d742a2f48028 tempest-VolumesExtendTest-1491885283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-18ebe93c-5d60-48b2-b6c9-381d53f2187d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-18ebe93c-5d60-48b2-b6c9-381d53f2187d.87e9253d-f1c5-4c7d-b229-69c1eaafc506 1G" returned: 0 in 1.078s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:30:45 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ebf58455-8d44-4c4e-bdde-d742a2f48028 tempest-VolumesExtendTest-1491885283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-18ebe93c-5d60-48b2-b6c9-381d53f2187d -F qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-18ebe93c-5d60-48b2-b6c9-381d53f2187d.87e9253d-f1c5-4c7d-b229-69c1eaafc506 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:30:45 devstack sudo[104588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-18ebe93c-5d60-48b2-b6c9-381d53f2187d -F qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-18ebe93c-5d60-48b2-b6c9-381d53f2187d.87e9253d-f1c5-4c7d-b229-69c1eaafc506 Jun 29 03:30:45 devstack sudo[104588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:30:45 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-0992b935-2c78-4d60-aec0-2d1118294ddc tempest-VolumesListTestJSON-1640231735 None] Created reservations ['72f0551d-308f-48d9-bc3d-245315e64e46', '52957250-1178-446b-bba0-ad73e9034972', '1aeea22d-eaf1-47cf-98af-e09bbbe16087', '413e7e73-4ca0-4591-bdf7-4e0140b8c7b8'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:30:45 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-0992b935-2c78-4d60-aec0-2d1118294ddc tempest-VolumesListTestJSON-1640231735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:30:45 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-0992b935-2c78-4d60-aec0-2d1118294ddc tempest-VolumesListTestJSON-1640231735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:30:45 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-0992b935-2c78-4d60-aec0-2d1118294ddc tempest-VolumesListTestJSON-1640231735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:30:45 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-0992b935-2c78-4d60-aec0-2d1118294ddc tempest-VolumesListTestJSON-1640231735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:30:45 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-0992b935-2c78-4d60-aec0-2d1118294ddc tempest-VolumesListTestJSON-1640231735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:30:45 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-0992b935-2c78-4d60-aec0-2d1118294ddc tempest-VolumesListTestJSON-1640231735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:30:45 devstack sudo[104590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf Jun 29 03:30:45 devstack sudo[104590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:30:46 devstack sudo[104588]: pam_unix(sudo:session): session closed for user root Jun 29 03:30:46 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ebf58455-8d44-4c4e-bdde-d742a2f48028 tempest-VolumesExtendTest-1491885283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-18ebe93c-5d60-48b2-b6c9-381d53f2187d -F qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-18ebe93c-5d60-48b2-b6c9-381d53f2187d.87e9253d-f1c5-4c7d-b229-69c1eaafc506" returned: 0 in 0.860s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:30:46 devstack cinder-volume[93468]: WARNING cinder.volume.drivers.remotefs [None req-ebf58455-8d44-4c4e-bdde-d742a2f48028 tempest-VolumesExtendTest-1491885283 None] /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-18ebe93c-5d60-48b2-b6c9-381d53f2187d.87e9253d-f1c5-4c7d-b229-69c1eaafc506 is being set with open permissions: ugo+rw Jun 29 03:30:46 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ebf58455-8d44-4c4e-bdde-d742a2f48028 tempest-VolumesExtendTest-1491885283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-18ebe93c-5d60-48b2-b6c9-381d53f2187d.87e9253d-f1c5-4c7d-b229-69c1eaafc506 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:30:46 devstack sudo[104596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-18ebe93c-5d60-48b2-b6c9-381d53f2187d.87e9253d-f1c5-4c7d-b229-69c1eaafc506 Jun 29 03:30:46 devstack sudo[104596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:30:46 devstack sudo[104590]: pam_unix(sudo:session): session closed for user root Jun 29 03:30:46 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-0992b935-2c78-4d60-aec0-2d1118294ddc tempest-VolumesListTestJSON-1640231735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf" returned: 0 in 1.009s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:30:46 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-0992b935-2c78-4d60-aec0-2d1118294ddc tempest-VolumesListTestJSON-1640231735 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:30:46 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-0992b935-2c78-4d60-aec0-2d1118294ddc tempest-VolumesListTestJSON-1640231735 None] Deleted volume successfully. Jun 29 03:30:46 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-cd690fa7-1a6c-4e55-a4d7-a7e8161d3bed tempest-VolumesListTestJSON-1640231735 None] Acquiring lock "cinder-1a2b1ad1-83e4-47e7-add3-d980be302406-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:30:46 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-0992b935-2c78-4d60-aec0-2d1118294ddc tempest-VolumesListTestJSON-1640231735 None] Lock "cinder-962a7935-7d07-4493-9179-09c7011fc17b-delete_volume" released by "delete_volume" :: held 3.492s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:30:46 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-cd690fa7-1a6c-4e55-a4d7-a7e8161d3bed tempest-VolumesListTestJSON-1640231735 None] Lock "cinder-1a2b1ad1-83e4-47e7-add3-d980be302406-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:30:46 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-cd690fa7-1a6c-4e55-a4d7-a7e8161d3bed tempest-VolumesListTestJSON-1640231735 None] Acquiring lock "cinder-quobyte-1a2b1ad1-83e4-47e7-add3-d980be302406" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:30:46 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-cd690fa7-1a6c-4e55-a4d7-a7e8161d3bed tempest-VolumesListTestJSON-1640231735 None] Lock "cinder-quobyte-1a2b1ad1-83e4-47e7-add3-d980be302406" acquired by "delete_volume" :: waited 0.017s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:30:46 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[29ce2b31-a0c7-4b25-8bcb-91953bc5150c]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:30:46 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-cd690fa7-1a6c-4e55-a4d7-a7e8161d3bed tempest-VolumesListTestJSON-1640231735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-1a2b1ad1-83e4-47e7-add3-d980be302406 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:30:46 devstack sudo[104600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-1a2b1ad1-83e4-47e7-add3-d980be302406 Jun 29 03:30:46 devstack sudo[104600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:30:46 devstack sudo[104596]: pam_unix(sudo:session): session closed for user root Jun 29 03:30:46 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ebf58455-8d44-4c4e-bdde-d742a2f48028 tempest-VolumesExtendTest-1491885283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-18ebe93c-5d60-48b2-b6c9-381d53f2187d.87e9253d-f1c5-4c7d-b229-69c1eaafc506" returned: 0 in 0.843s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:30:46 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ebf58455-8d44-4c4e-bdde-d742a2f48028 tempest-VolumesExtendTest-1491885283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-18ebe93c-5d60-48b2-b6c9-381d53f2187d.info {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:30:46 devstack sudo[104603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-18ebe93c-5d60-48b2-b6c9-381d53f2187d.info Jun 29 03:30:46 devstack sudo[104603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:30:47 devstack sudo[104600]: pam_unix(sudo:session): session closed for user root Jun 29 03:30:47 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-cd690fa7-1a6c-4e55-a4d7-a7e8161d3bed tempest-VolumesListTestJSON-1640231735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-1a2b1ad1-83e4-47e7-add3-d980be302406" returned: 0 in 1.093s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:30:47 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-cd690fa7-1a6c-4e55-a4d7-a7e8161d3bed tempest-VolumesListTestJSON-1640231735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-1a2b1ad1-83e4-47e7-add3-d980be302406 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:30:47 devstack sudo[104608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-1a2b1ad1-83e4-47e7-add3-d980be302406 Jun 29 03:30:47 devstack sudo[104608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:30:47 devstack sudo[104603]: pam_unix(sudo:session): session closed for user root Jun 29 03:30:47 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ebf58455-8d44-4c4e-bdde-d742a2f48028 tempest-VolumesExtendTest-1491885283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-18ebe93c-5d60-48b2-b6c9-381d53f2187d.info" returned: 0 in 0.999s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:30:47 devstack cinder-volume[93468]: WARNING cinder.volume.drivers.remotefs [None req-ebf58455-8d44-4c4e-bdde-d742a2f48028 tempest-VolumesExtendTest-1491885283 None] /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-18ebe93c-5d60-48b2-b6c9-381d53f2187d.info is being set with open permissions: ugo+rw Jun 29 03:30:47 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ebf58455-8d44-4c4e-bdde-d742a2f48028 tempest-VolumesExtendTest-1491885283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-18ebe93c-5d60-48b2-b6c9-381d53f2187d.info {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:30:48 devstack sudo[104611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-18ebe93c-5d60-48b2-b6c9-381d53f2187d.info Jun 29 03:30:48 devstack sudo[104611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:30:48 devstack sudo[104608]: pam_unix(sudo:session): session closed for user root Jun 29 03:30:48 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-cd690fa7-1a6c-4e55-a4d7-a7e8161d3bed tempest-VolumesListTestJSON-1640231735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-1a2b1ad1-83e4-47e7-add3-d980be302406" returned: 0 in 0.828s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:30:48 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-cd690fa7-1a6c-4e55-a4d7-a7e8161d3bed tempest-VolumesListTestJSON-1640231735 None] Lock "cinder-quobyte-1a2b1ad1-83e4-47e7-add3-d980be302406" released by "delete_volume" :: held 1.977s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:30:48 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-cd690fa7-1a6c-4e55-a4d7-a7e8161d3bed tempest-VolumesListTestJSON-1640231735 None] Created reservations ['13a5deea-45a9-4bd1-bbba-803fef92813a', '5d87c4a6-6232-4def-a845-df20b31b4f8b', 'f881fac9-d856-4623-8cb5-295efb6e51fd', '0a417162-4895-4e0f-9a3e-41ef9061ba97'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:30:48 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-cd690fa7-1a6c-4e55-a4d7-a7e8161d3bed tempest-VolumesListTestJSON-1640231735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:30:48 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-cd690fa7-1a6c-4e55-a4d7-a7e8161d3bed tempest-VolumesListTestJSON-1640231735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:30:48 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-cd690fa7-1a6c-4e55-a4d7-a7e8161d3bed tempest-VolumesListTestJSON-1640231735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:30:48 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-cd690fa7-1a6c-4e55-a4d7-a7e8161d3bed tempest-VolumesListTestJSON-1640231735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:30:48 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-cd690fa7-1a6c-4e55-a4d7-a7e8161d3bed tempest-VolumesListTestJSON-1640231735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:30:48 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-cd690fa7-1a6c-4e55-a4d7-a7e8161d3bed tempest-VolumesListTestJSON-1640231735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:30:48 devstack sudo[104615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf Jun 29 03:30:48 devstack sudo[104615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:30:48 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-324a9487-550a-49a7-a02b-02521b200733 tempest-VolumesListTestJSON-1640231735 None] Acquiring lock "cinder-8220b712-fcfe-4377-8c4b-a2e679b20fd9-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:30:48 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-324a9487-550a-49a7-a02b-02521b200733 tempest-VolumesListTestJSON-1640231735 None] Lock "cinder-8220b712-fcfe-4377-8c4b-a2e679b20fd9-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:30:48 devstack sudo[104611]: pam_unix(sudo:session): session closed for user root Jun 29 03:30:48 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ebf58455-8d44-4c4e-bdde-d742a2f48028 tempest-VolumesExtendTest-1491885283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-18ebe93c-5d60-48b2-b6c9-381d53f2187d.info" returned: 0 in 0.970s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:30:48 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-ebf58455-8d44-4c4e-bdde-d742a2f48028 tempest-VolumesExtendTest-1491885283 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.983s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:30:49 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-324a9487-550a-49a7-a02b-02521b200733 tempest-VolumesListTestJSON-1640231735 None] Acquiring lock "cinder-quobyte-8220b712-fcfe-4377-8c4b-a2e679b20fd9" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:30:49 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-ebf58455-8d44-4c4e-bdde-d742a2f48028 tempest-VolumesExtendTest-1491885283 None] Create snapshot completed successfully Jun 29 03:30:49 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-324a9487-550a-49a7-a02b-02521b200733 tempest-VolumesListTestJSON-1640231735 None] Lock "cinder-quobyte-8220b712-fcfe-4377-8c4b-a2e679b20fd9" acquired by "delete_volume" :: waited 0.031s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:30:49 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[48c5c79e-75ec-43a3-baed-2acf83db8f67]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:30:49 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-324a9487-550a-49a7-a02b-02521b200733 tempest-VolumesListTestJSON-1640231735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-8220b712-fcfe-4377-8c4b-a2e679b20fd9 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:30:49 devstack sudo[104618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-8220b712-fcfe-4377-8c4b-a2e679b20fd9 Jun 29 03:30:49 devstack sudo[104618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:30:49 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-9c994295-26ba-4291-8b06-8e8421754fef tempest-VolumesExtendTest-1491885283 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:30:49 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-9c994295-26ba-4291-8b06-8e8421754fef tempest-VolumesExtendTest-1491885283 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.003s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:30:49 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a29b50d-2c64-4421-a434-8eaa6764e42f]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:30:49 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-9c994295-26ba-4291-8b06-8e8421754fef tempest-VolumesExtendTest-1491885283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-18ebe93c-5d60-48b2-b6c9-381d53f2187d {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:30:49 devstack sudo[104620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-18ebe93c-5d60-48b2-b6c9-381d53f2187d Jun 29 03:30:49 devstack sudo[104620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:30:49 devstack sudo[104615]: pam_unix(sudo:session): session closed for user root Jun 29 03:30:49 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-cd690fa7-1a6c-4e55-a4d7-a7e8161d3bed tempest-VolumesListTestJSON-1640231735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf" returned: 0 in 1.217s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:30:49 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-cd690fa7-1a6c-4e55-a4d7-a7e8161d3bed tempest-VolumesListTestJSON-1640231735 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:30:49 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-cd690fa7-1a6c-4e55-a4d7-a7e8161d3bed tempest-VolumesListTestJSON-1640231735 None] Deleted volume successfully. Jun 29 03:30:49 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-cd690fa7-1a6c-4e55-a4d7-a7e8161d3bed tempest-VolumesListTestJSON-1640231735 None] Lock "cinder-1a2b1ad1-83e4-47e7-add3-d980be302406-delete_volume" released by "delete_volume" :: held 3.490s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:30:50 devstack sudo[104618]: pam_unix(sudo:session): session closed for user root Jun 29 03:30:50 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-324a9487-550a-49a7-a02b-02521b200733 tempest-VolumesListTestJSON-1640231735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-8220b712-fcfe-4377-8c4b-a2e679b20fd9" returned: 0 in 1.407s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:30:50 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-324a9487-550a-49a7-a02b-02521b200733 tempest-VolumesListTestJSON-1640231735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-8220b712-fcfe-4377-8c4b-a2e679b20fd9 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:30:50 devstack sudo[104626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-8220b712-fcfe-4377-8c4b-a2e679b20fd9 Jun 29 03:30:50 devstack sudo[104626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:30:50 devstack sudo[104620]: pam_unix(sudo:session): session closed for user root Jun 29 03:30:50 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-9c994295-26ba-4291-8b06-8e8421754fef tempest-VolumesExtendTest-1491885283 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-18ebe93c-5d60-48b2-b6c9-381d53f2187d" returned: 0 in 1.355s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:30:51 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-9c994295-26ba-4291-8b06-8e8421754fef tempest-VolumesExtendTest-1491885283 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-18ebe93c-5d60-48b2-b6c9-381d53f2187d.87e9253d-f1c5-4c7d-b229-69c1eaafc506 2G {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:30:51 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-9c994295-26ba-4291-8b06-8e8421754fef tempest-VolumesExtendTest-1491885283 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-18ebe93c-5d60-48b2-b6c9-381d53f2187d.87e9253d-f1c5-4c7d-b229-69c1eaafc506 2G" returned: 0 in 0.217s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:30:51 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-9c994295-26ba-4291-8b06-8e8421754fef tempest-VolumesExtendTest-1491885283 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.622s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:30:51 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-9c994295-26ba-4291-8b06-8e8421754fef tempest-VolumesExtendTest-1491885283 None] Extend volume completed successfully. Jun 29 03:30:51 devstack sudo[104626]: pam_unix(sudo:session): session closed for user root Jun 29 03:30:51 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-324a9487-550a-49a7-a02b-02521b200733 tempest-VolumesListTestJSON-1640231735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-8220b712-fcfe-4377-8c4b-a2e679b20fd9" returned: 0 in 0.969s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:30:51 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-324a9487-550a-49a7-a02b-02521b200733 tempest-VolumesListTestJSON-1640231735 None] Lock "cinder-quobyte-8220b712-fcfe-4377-8c4b-a2e679b20fd9" released by "delete_volume" :: held 2.462s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:30:51 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-324a9487-550a-49a7-a02b-02521b200733 tempest-VolumesListTestJSON-1640231735 None] Created reservations ['24ad52ac-48ae-4440-be20-d5aba92f0941', '0ce9d6ff-6795-42ad-8d18-563c17eb8875', '7fa7d964-5e32-470c-bea7-2add71317b2b', 'c4f6c27d-7d62-4032-95aa-a15f470398e9'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:30:51 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-324a9487-550a-49a7-a02b-02521b200733 tempest-VolumesListTestJSON-1640231735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:30:51 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-324a9487-550a-49a7-a02b-02521b200733 tempest-VolumesListTestJSON-1640231735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:30:51 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-324a9487-550a-49a7-a02b-02521b200733 tempest-VolumesListTestJSON-1640231735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:30:51 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-324a9487-550a-49a7-a02b-02521b200733 tempest-VolumesListTestJSON-1640231735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:30:51 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-324a9487-550a-49a7-a02b-02521b200733 tempest-VolumesListTestJSON-1640231735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:30:51 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-324a9487-550a-49a7-a02b-02521b200733 tempest-VolumesListTestJSON-1640231735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:30:51 devstack sudo[104636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf Jun 29 03:30:51 devstack sudo[104636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:30:52 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-427821f0-3062-464f-9fe2-06ea69cf9340 tempest-VolumesExtendTest-1491885283 None] Acquiring lock "cinder-87e9253d-f1c5-4c7d-b229-69c1eaafc506-delete_snapshot" by "delete_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:30:52 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-427821f0-3062-464f-9fe2-06ea69cf9340 tempest-VolumesExtendTest-1491885283 None] Lock "cinder-87e9253d-f1c5-4c7d-b229-69c1eaafc506-delete_snapshot" acquired by "delete_snapshot" :: waited 0.061s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:30:52 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-427821f0-3062-464f-9fe2-06ea69cf9340 tempest-VolumesExtendTest-1491885283 None] Acquiring lock "cinder-quobyte-18ebe93c-5d60-48b2-b6c9-381d53f2187d" by "delete_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:30:52 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-427821f0-3062-464f-9fe2-06ea69cf9340 tempest-VolumesExtendTest-1491885283 None] Lock "cinder-quobyte-18ebe93c-5d60-48b2-b6c9-381d53f2187d" acquired by "delete_snapshot" :: waited 0.058s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:30:52 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-427821f0-3062-464f-9fe2-06ea69cf9340 tempest-VolumesExtendTest-1491885283 None] Acquiring lock "cinder-quobyte-87e9253d-f1c5-4c7d-b229-69c1eaafc506" by "_delete_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:30:52 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-427821f0-3062-464f-9fe2-06ea69cf9340 tempest-VolumesExtendTest-1491885283 None] Lock "cinder-quobyte-87e9253d-f1c5-4c7d-b229-69c1eaafc506" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:30:52 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-427821f0-3062-464f-9fe2-06ea69cf9340 tempest-VolumesExtendTest-1491885283 None] Deleting offline snapshot 87e9253d-f1c5-4c7d-b229-69c1eaafc506 of volume 18ebe93c-5d60-48b2-b6c9-381d53f2187d {{(pid=93468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 29 03:30:52 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-427821f0-3062-464f-9fe2-06ea69cf9340 tempest-VolumesExtendTest-1491885283 None] snapshot_file for this snap is: volume-18ebe93c-5d60-48b2-b6c9-381d53f2187d.87e9253d-f1c5-4c7d-b229-69c1eaafc506 {{(pid=93468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 29 03:30:52 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[26cdecd3-bd26-48b2-8482-f143ea373480]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:30:52 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-427821f0-3062-464f-9fe2-06ea69cf9340 tempest-VolumesExtendTest-1491885283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-18ebe93c-5d60-48b2-b6c9-381d53f2187d.87e9253d-f1c5-4c7d-b229-69c1eaafc506 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:30:52 devstack sudo[104638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-18ebe93c-5d60-48b2-b6c9-381d53f2187d.87e9253d-f1c5-4c7d-b229-69c1eaafc506 Jun 29 03:30:52 devstack sudo[104638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:30:52 devstack sudo[104636]: pam_unix(sudo:session): session closed for user root Jun 29 03:30:52 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-324a9487-550a-49a7-a02b-02521b200733 tempest-VolumesListTestJSON-1640231735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf" returned: 0 in 1.174s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:30:52 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-324a9487-550a-49a7-a02b-02521b200733 tempest-VolumesListTestJSON-1640231735 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:30:52 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-324a9487-550a-49a7-a02b-02521b200733 tempest-VolumesListTestJSON-1640231735 None] Deleted volume successfully. Jun 29 03:30:52 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-324a9487-550a-49a7-a02b-02521b200733 tempest-VolumesListTestJSON-1640231735 None] Lock "cinder-8220b712-fcfe-4377-8c4b-a2e679b20fd9-delete_volume" released by "delete_volume" :: held 4.030s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:30:53 devstack sudo[104638]: pam_unix(sudo:session): session closed for user root Jun 29 03:30:53 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-427821f0-3062-464f-9fe2-06ea69cf9340 tempest-VolumesExtendTest-1491885283 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-18ebe93c-5d60-48b2-b6c9-381d53f2187d.87e9253d-f1c5-4c7d-b229-69c1eaafc506" returned: 0 in 1.193s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:30:53 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-427821f0-3062-464f-9fe2-06ea69cf9340 tempest-VolumesExtendTest-1491885283 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-18ebe93c-5d60-48b2-b6c9-381d53f2187d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93468) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 29 03:30:53 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[05e52c6d-2aae-437c-b559-ed948690b87b]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:30:53 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-427821f0-3062-464f-9fe2-06ea69cf9340 tempest-VolumesExtendTest-1491885283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-18ebe93c-5d60-48b2-b6c9-381d53f2187d {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:30:53 devstack sudo[104645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-18ebe93c-5d60-48b2-b6c9-381d53f2187d Jun 29 03:30:53 devstack sudo[104645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:30:54 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-d776e05a-e526-4506-a061-4b85171d8536 tempest-VolumesActionsTest-882954247 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:30:54 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-d776e05a-e526-4506-a061-4b85171d8536 tempest-VolumesActionsTest-882954247 None] Flow 'volume_create_manager' (363d7ef5-a1f4-4d4d-9a69-0f00ffda1b0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:30:54 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-d776e05a-e526-4506-a061-4b85171d8536 tempest-VolumesActionsTest-882954247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd481409-a002-4188-8cb3-7f0a2b53c83a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:30:54 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-d776e05a-e526-4506-a061-4b85171d8536 tempest-VolumesActionsTest-882954247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd481409-a002-4188-8cb3-7f0a2b53c83a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:30:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-936081963',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ab012d6-eec7-4252-8797-e69a378d83ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b3aacf190344707adbe5c7b0116790e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:30:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:30:54Z,use_quota=True,user_id='d9cce1caa8b4403aac82c873e363fc82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:30:54 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-d776e05a-e526-4506-a061-4b85171d8536 tempest-VolumesActionsTest-882954247 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f52f0e8b-1d8d-4182-9d3a-94dbfb75c3f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:30:54 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-d776e05a-e526-4506-a061-4b85171d8536 tempest-VolumesActionsTest-882954247 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f52f0e8b-1d8d-4182-9d3a-94dbfb75c3f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:30:54 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-d776e05a-e526-4506-a061-4b85171d8536 tempest-VolumesActionsTest-882954247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a6d86fb-361c-4fe4-9cc7-dec1223f3ad3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:30:54 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-d776e05a-e526-4506-a061-4b85171d8536 tempest-VolumesActionsTest-882954247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a6d86fb-361c-4fe4-9cc7-dec1223f3ad3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ab012d6-eec7-4252-8797-e69a378d83ae', 'volume_name': 'volume-9ab012d6-eec7-4252-8797-e69a378d83ae', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:30:54 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-d776e05a-e526-4506-a061-4b85171d8536 tempest-VolumesActionsTest-882954247 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6dfd55b6-b05e-4f9a-ba11-498212c880d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:30:54 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-d776e05a-e526-4506-a061-4b85171d8536 tempest-VolumesActionsTest-882954247 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6dfd55b6-b05e-4f9a-ba11-498212c880d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:30:54 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-d776e05a-e526-4506-a061-4b85171d8536 tempest-VolumesActionsTest-882954247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e12300b-0598-46ab-93ef-11d31fc59822) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:30:54 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-d776e05a-e526-4506-a061-4b85171d8536 tempest-VolumesActionsTest-882954247 None] Volume 9ab012d6-eec7-4252-8797-e69a378d83ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ab012d6-eec7-4252-8797-e69a378d83ae', 'volume_size': 1} Jun 29 03:30:54 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-d776e05a-e526-4506-a061-4b85171d8536 tempest-VolumesActionsTest-882954247 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:30:54 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-d776e05a-e526-4506-a061-4b85171d8536 tempest-VolumesActionsTest-882954247 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:30:54 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-d776e05a-e526-4506-a061-4b85171d8536 tempest-VolumesActionsTest-882954247 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:30:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-936081963',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ab012d6-eec7-4252-8797-e69a378d83ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b3aacf190344707adbe5c7b0116790e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:30:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:30:54Z,use_quota=True,user_id='d9cce1caa8b4403aac82c873e363fc82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:30:54 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-d776e05a-e526-4506-a061-4b85171d8536 tempest-VolumesActionsTest-882954247 None] Creating volume 9ab012d6-eec7-4252-8797-e69a378d83ae {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:30:54 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-d776e05a-e526-4506-a061-4b85171d8536 tempest-VolumesActionsTest-882954247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:30:54 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-d776e05a-e526-4506-a061-4b85171d8536 tempest-VolumesActionsTest-882954247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:30:54 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-d776e05a-e526-4506-a061-4b85171d8536 tempest-VolumesActionsTest-882954247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:30:54 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-d776e05a-e526-4506-a061-4b85171d8536 tempest-VolumesActionsTest-882954247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:30:54 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-d776e05a-e526-4506-a061-4b85171d8536 tempest-VolumesActionsTest-882954247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:30:54 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-d776e05a-e526-4506-a061-4b85171d8536 tempest-VolumesActionsTest-882954247 None] Selected osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:30:54 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-d776e05a-e526-4506-a061-4b85171d8536 tempest-VolumesActionsTest-882954247 None] casted to osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f Jun 29 03:30:54 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d776e05a-e526-4506-a061-4b85171d8536 tempest-VolumesActionsTest-882954247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9ab012d6-eec7-4252-8797-e69a378d83ae 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:30:54 devstack sudo[104648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9ab012d6-eec7-4252-8797-e69a378d83ae 1073741824 Jun 29 03:30:54 devstack sudo[104648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:30:54 devstack sudo[104645]: pam_unix(sudo:session): session closed for user root Jun 29 03:30:54 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-427821f0-3062-464f-9fe2-06ea69cf9340 tempest-VolumesExtendTest-1491885283 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-18ebe93c-5d60-48b2-b6c9-381d53f2187d" returned: 0 in 1.062s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:30:54 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-427821f0-3062-464f-9fe2-06ea69cf9340 tempest-VolumesExtendTest-1491885283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-18ebe93c-5d60-48b2-b6c9-381d53f2187d.87e9253d-f1c5-4c7d-b229-69c1eaafc506 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:30:54 devstack sudo[104653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-18ebe93c-5d60-48b2-b6c9-381d53f2187d.87e9253d-f1c5-4c7d-b229-69c1eaafc506 Jun 29 03:30:54 devstack sudo[104653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:30:55 devstack sudo[104648]: pam_unix(sudo:session): session closed for user root Jun 29 03:30:55 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d776e05a-e526-4506-a061-4b85171d8536 tempest-VolumesActionsTest-882954247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9ab012d6-eec7-4252-8797-e69a378d83ae 1073741824" returned: 0 in 1.059s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:30:55 devstack cinder-volume[93468]: DEBUG dbcounter [-] [93468] Writing DB stats cinder:SELECT=104,cinder:UPDATE=124,cinder:INSERT=36,cinder:DELETE=11 {{(pid=93468) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 29 03:30:55 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d776e05a-e526-4506-a061-4b85171d8536 tempest-VolumesActionsTest-882954247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9ab012d6-eec7-4252-8797-e69a378d83ae {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:30:55 devstack sudo[104661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9ab012d6-eec7-4252-8797-e69a378d83ae Jun 29 03:30:55 devstack sudo[104661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:30:55 devstack sudo[104653]: pam_unix(sudo:session): session closed for user root Jun 29 03:30:55 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-427821f0-3062-464f-9fe2-06ea69cf9340 tempest-VolumesExtendTest-1491885283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-18ebe93c-5d60-48b2-b6c9-381d53f2187d.87e9253d-f1c5-4c7d-b229-69c1eaafc506" returned: 0 in 0.974s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:30:55 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-427821f0-3062-464f-9fe2-06ea69cf9340 tempest-VolumesExtendTest-1491885283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-18ebe93c-5d60-48b2-b6c9-381d53f2187d.87e9253d-f1c5-4c7d-b229-69c1eaafc506 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:30:55 devstack sudo[104663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-18ebe93c-5d60-48b2-b6c9-381d53f2187d.87e9253d-f1c5-4c7d-b229-69c1eaafc506 Jun 29 03:30:55 devstack sudo[104663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:30:56 devstack sudo[104661]: pam_unix(sudo:session): session closed for user root Jun 29 03:30:56 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d776e05a-e526-4506-a061-4b85171d8536 tempest-VolumesActionsTest-882954247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9ab012d6-eec7-4252-8797-e69a378d83ae" returned: 0 in 0.940s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:30:56 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-d776e05a-e526-4506-a061-4b85171d8536 tempest-VolumesActionsTest-882954247 None] <== create_volume: return (2054ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:30:56 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-d776e05a-e526-4506-a061-4b85171d8536 tempest-VolumesActionsTest-882954247 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.057s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:30:56 devstack cinder-volume[93468]: DEBUG dbcounter [-] [93468] Writing DB stats cinder:UPDATE=131,cinder:SELECT=87,cinder:INSERT=34,cinder:DELETE=11 {{(pid=93468) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 29 03:30:56 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-d776e05a-e526-4506-a061-4b85171d8536 tempest-VolumesActionsTest-882954247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e12300b-0598-46ab-93ef-11d31fc59822) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ab012d6-eec7-4252-8797-e69a378d83ae', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:30:56 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-d776e05a-e526-4506-a061-4b85171d8536 tempest-VolumesActionsTest-882954247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0f9fe29-64d6-431e-b311-178ca1d8984b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:30:56 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-d776e05a-e526-4506-a061-4b85171d8536 tempest-VolumesActionsTest-882954247 None] Volume volume-9ab012d6-eec7-4252-8797-e69a378d83ae (9ab012d6-eec7-4252-8797-e69a378d83ae): created successfully Jun 29 03:30:56 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-d776e05a-e526-4506-a061-4b85171d8536 tempest-VolumesActionsTest-882954247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0f9fe29-64d6-431e-b311-178ca1d8984b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:30:56 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-d776e05a-e526-4506-a061-4b85171d8536 tempest-VolumesActionsTest-882954247 None] Flow 'volume_create_manager' (363d7ef5-a1f4-4d4d-9a69-0f00ffda1b0a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:30:56 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-d776e05a-e526-4506-a061-4b85171d8536 tempest-VolumesActionsTest-882954247 None] Created volume successfully. Jun 29 03:30:56 devstack sudo[104663]: pam_unix(sudo:session): session closed for user root Jun 29 03:30:56 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-427821f0-3062-464f-9fe2-06ea69cf9340 tempest-VolumesExtendTest-1491885283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-18ebe93c-5d60-48b2-b6c9-381d53f2187d.87e9253d-f1c5-4c7d-b229-69c1eaafc506" returned: 0 in 0.885s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:30:56 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-427821f0-3062-464f-9fe2-06ea69cf9340 tempest-VolumesExtendTest-1491885283 None] Lock "cinder-quobyte-87e9253d-f1c5-4c7d-b229-69c1eaafc506" released by "_delete_snapshot" :: held 4.292s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:30:56 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-427821f0-3062-464f-9fe2-06ea69cf9340 tempest-VolumesExtendTest-1491885283 None] Lock "cinder-quobyte-18ebe93c-5d60-48b2-b6c9-381d53f2187d" released by "delete_snapshot" :: held 4.319s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:30:56 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-427821f0-3062-464f-9fe2-06ea69cf9340 tempest-VolumesExtendTest-1491885283 None] Created reservations ['0da088ba-f037-473b-87af-22ff3af15af7', 'd7fce72f-26f0-44fd-a5a6-a33eba34b232', 'd023eb25-d6a7-4e78-866a-dbd51a9e7c6e', '573a375f-0ad9-4208-91c1-0d2e844bcf39'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:30:56 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-427821f0-3062-464f-9fe2-06ea69cf9340 tempest-VolumesExtendTest-1491885283 None] Delete snapshot completed successfully. Jun 29 03:30:56 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-427821f0-3062-464f-9fe2-06ea69cf9340 tempest-VolumesExtendTest-1491885283 None] Lock "cinder-87e9253d-f1c5-4c7d-b229-69c1eaafc506-delete_snapshot" released by "delete_snapshot" :: held 4.518s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:30:57 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-f30658bf-1e4f-4fa3-9ece-87f671e20e74 tempest-VolumesExtendTest-1491885283 None] Acquiring lock "cinder-18ebe93c-5d60-48b2-b6c9-381d53f2187d-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:30:57 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-f30658bf-1e4f-4fa3-9ece-87f671e20e74 tempest-VolumesExtendTest-1491885283 None] Lock "cinder-18ebe93c-5d60-48b2-b6c9-381d53f2187d-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:30:57 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-f30658bf-1e4f-4fa3-9ece-87f671e20e74 tempest-VolumesExtendTest-1491885283 None] Acquiring lock "cinder-quobyte-18ebe93c-5d60-48b2-b6c9-381d53f2187d" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:30:57 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-f30658bf-1e4f-4fa3-9ece-87f671e20e74 tempest-VolumesExtendTest-1491885283 None] Lock "cinder-quobyte-18ebe93c-5d60-48b2-b6c9-381d53f2187d" acquired by "delete_volume" :: waited 0.014s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:30:57 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ebb1fea-b11b-43b3-8bb6-621bebb0ebd3]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:30:57 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-f30658bf-1e4f-4fa3-9ece-87f671e20e74 tempest-VolumesExtendTest-1491885283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-18ebe93c-5d60-48b2-b6c9-381d53f2187d {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:30:57 devstack sudo[104670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-18ebe93c-5d60-48b2-b6c9-381d53f2187d Jun 29 03:30:57 devstack sudo[104670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:30:58 devstack sudo[104670]: pam_unix(sudo:session): session closed for user root Jun 29 03:30:58 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-f30658bf-1e4f-4fa3-9ece-87f671e20e74 tempest-VolumesExtendTest-1491885283 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-18ebe93c-5d60-48b2-b6c9-381d53f2187d" returned: 0 in 0.942s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:30:58 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-f30658bf-1e4f-4fa3-9ece-87f671e20e74 tempest-VolumesExtendTest-1491885283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-18ebe93c-5d60-48b2-b6c9-381d53f2187d {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:30:58 devstack sudo[104679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-18ebe93c-5d60-48b2-b6c9-381d53f2187d Jun 29 03:30:58 devstack sudo[104679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:30:59 devstack sudo[104679]: pam_unix(sudo:session): session closed for user root Jun 29 03:30:59 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-f30658bf-1e4f-4fa3-9ece-87f671e20e74 tempest-VolumesExtendTest-1491885283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-18ebe93c-5d60-48b2-b6c9-381d53f2187d" returned: 0 in 0.797s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:30:59 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-f30658bf-1e4f-4fa3-9ece-87f671e20e74 tempest-VolumesExtendTest-1491885283 None] Lock "cinder-quobyte-18ebe93c-5d60-48b2-b6c9-381d53f2187d" released by "delete_volume" :: held 1.814s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:30:59 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-f30658bf-1e4f-4fa3-9ece-87f671e20e74 tempest-VolumesExtendTest-1491885283 None] Created reservations ['3a6ecbfd-1adb-4fc9-a23c-45caf03d2d0e', 'd5088061-2679-40f3-bf90-bf28828c2a36', '770d4c28-6ebc-4f8d-afc2-f468f2f2c9ec', '3d5c14ca-22d2-4968-aaa7-1a71c8927b55'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:30:59 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-f30658bf-1e4f-4fa3-9ece-87f671e20e74 tempest-VolumesExtendTest-1491885283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:30:59 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-f30658bf-1e4f-4fa3-9ece-87f671e20e74 tempest-VolumesExtendTest-1491885283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:30:59 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-f30658bf-1e4f-4fa3-9ece-87f671e20e74 tempest-VolumesExtendTest-1491885283 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:30:59 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-f30658bf-1e4f-4fa3-9ece-87f671e20e74 tempest-VolumesExtendTest-1491885283 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:30:59 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-f30658bf-1e4f-4fa3-9ece-87f671e20e74 tempest-VolumesExtendTest-1491885283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:30:59 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-f30658bf-1e4f-4fa3-9ece-87f671e20e74 tempest-VolumesExtendTest-1491885283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:30:59 devstack sudo[104683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf Jun 29 03:30:59 devstack sudo[104683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:31:00 devstack sudo[104683]: pam_unix(sudo:session): session closed for user root Jun 29 03:31:00 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-f30658bf-1e4f-4fa3-9ece-87f671e20e74 tempest-VolumesExtendTest-1491885283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf" returned: 0 in 0.771s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:31:00 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-f30658bf-1e4f-4fa3-9ece-87f671e20e74 tempest-VolumesExtendTest-1491885283 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:31:00 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-f30658bf-1e4f-4fa3-9ece-87f671e20e74 tempest-VolumesExtendTest-1491885283 None] Deleted volume successfully. Jun 29 03:31:00 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-f30658bf-1e4f-4fa3-9ece-87f671e20e74 tempest-VolumesExtendTest-1491885283 None] Lock "cinder-18ebe93c-5d60-48b2-b6c9-381d53f2187d-delete_volume" released by "delete_volume" :: held 2.834s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:31:03 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b092449-37b7-42b6-898a-b9a979780de0 tempest-VolumesSnapshotListTestJSON-285436761 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:31:03 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-3b092449-37b7-42b6-898a-b9a979780de0 tempest-VolumesSnapshotListTestJSON-285436761 None] Flow 'volume_create_manager' (27717c61-2617-4576-9118-1af65fe60ed5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:31:03 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-3b092449-37b7-42b6-898a-b9a979780de0 tempest-VolumesSnapshotListTestJSON-285436761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27670787-5cfa-4d9e-92f9-0f28eb3e113f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:31:03 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-3b092449-37b7-42b6-898a-b9a979780de0 tempest-VolumesSnapshotListTestJSON-285436761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27670787-5cfa-4d9e-92f9-0f28eb3e113f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:31:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-798848704',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3aff4088-7d2a-47cc-8fe7-abde995d4e54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b92f4c334afa439599f5689f69d84ceb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:31:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:31:04Z,use_quota=True,user_id='6f63d5216b364841bae8a8ecac814a84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:31:03 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-3b092449-37b7-42b6-898a-b9a979780de0 tempest-VolumesSnapshotListTestJSON-285436761 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ec60eee-a9ee-4466-aa15-83b04556479e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:31:03 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-3b092449-37b7-42b6-898a-b9a979780de0 tempest-VolumesSnapshotListTestJSON-285436761 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ec60eee-a9ee-4466-aa15-83b04556479e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:31:03 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-3b092449-37b7-42b6-898a-b9a979780de0 tempest-VolumesSnapshotListTestJSON-285436761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7078f77c-cd17-44b5-8d26-7c231c046615) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:31:03 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-3b092449-37b7-42b6-898a-b9a979780de0 tempest-VolumesSnapshotListTestJSON-285436761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7078f77c-cd17-44b5-8d26-7c231c046615) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3aff4088-7d2a-47cc-8fe7-abde995d4e54', 'volume_name': 'volume-3aff4088-7d2a-47cc-8fe7-abde995d4e54', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:31:03 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-3b092449-37b7-42b6-898a-b9a979780de0 tempest-VolumesSnapshotListTestJSON-285436761 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3af02762-a02e-4788-b899-b8eab4ab5ac8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:31:03 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-3b092449-37b7-42b6-898a-b9a979780de0 tempest-VolumesSnapshotListTestJSON-285436761 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3af02762-a02e-4788-b899-b8eab4ab5ac8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:31:03 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-3b092449-37b7-42b6-898a-b9a979780de0 tempest-VolumesSnapshotListTestJSON-285436761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f61b7d0b-fbbb-407f-b116-ec32f13f1bc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:31:03 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-3b092449-37b7-42b6-898a-b9a979780de0 tempest-VolumesSnapshotListTestJSON-285436761 None] Volume 3aff4088-7d2a-47cc-8fe7-abde995d4e54: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3aff4088-7d2a-47cc-8fe7-abde995d4e54', 'volume_size': 1} Jun 29 03:31:03 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-3b092449-37b7-42b6-898a-b9a979780de0 tempest-VolumesSnapshotListTestJSON-285436761 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:31:03 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-3b092449-37b7-42b6-898a-b9a979780de0 tempest-VolumesSnapshotListTestJSON-285436761 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:31:03 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-3b092449-37b7-42b6-898a-b9a979780de0 tempest-VolumesSnapshotListTestJSON-285436761 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:31:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-798848704',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3aff4088-7d2a-47cc-8fe7-abde995d4e54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b92f4c334afa439599f5689f69d84ceb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:31:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:31:04Z,use_quota=True,user_id='6f63d5216b364841bae8a8ecac814a84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:31:03 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-3b092449-37b7-42b6-898a-b9a979780de0 tempest-VolumesSnapshotListTestJSON-285436761 None] Creating volume 3aff4088-7d2a-47cc-8fe7-abde995d4e54 {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:31:03 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-3b092449-37b7-42b6-898a-b9a979780de0 tempest-VolumesSnapshotListTestJSON-285436761 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:31:03 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-3b092449-37b7-42b6-898a-b9a979780de0 tempest-VolumesSnapshotListTestJSON-285436761 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:31:03 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-3b092449-37b7-42b6-898a-b9a979780de0 tempest-VolumesSnapshotListTestJSON-285436761 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:31:03 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-3b092449-37b7-42b6-898a-b9a979780de0 tempest-VolumesSnapshotListTestJSON-285436761 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:31:03 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-3b092449-37b7-42b6-898a-b9a979780de0 tempest-VolumesSnapshotListTestJSON-285436761 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:31:03 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-3b092449-37b7-42b6-898a-b9a979780de0 tempest-VolumesSnapshotListTestJSON-285436761 None] Selected osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:31:03 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-3b092449-37b7-42b6-898a-b9a979780de0 tempest-VolumesSnapshotListTestJSON-285436761 None] casted to osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f Jun 29 03:31:03 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-3b092449-37b7-42b6-898a-b9a979780de0 tempest-VolumesSnapshotListTestJSON-285436761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-3aff4088-7d2a-47cc-8fe7-abde995d4e54 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:31:03 devstack sudo[104687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-3aff4088-7d2a-47cc-8fe7-abde995d4e54 1073741824 Jun 29 03:31:03 devstack sudo[104687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:31:04 devstack sudo[104687]: pam_unix(sudo:session): session closed for user root Jun 29 03:31:04 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-3b092449-37b7-42b6-898a-b9a979780de0 tempest-VolumesSnapshotListTestJSON-285436761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-3aff4088-7d2a-47cc-8fe7-abde995d4e54 1073741824" returned: 0 in 1.197s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:31:04 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-3b092449-37b7-42b6-898a-b9a979780de0 tempest-VolumesSnapshotListTestJSON-285436761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-3aff4088-7d2a-47cc-8fe7-abde995d4e54 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:31:04 devstack sudo[104709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-3aff4088-7d2a-47cc-8fe7-abde995d4e54 Jun 29 03:31:04 devstack sudo[104709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:31:05 devstack sudo[104709]: pam_unix(sudo:session): session closed for user root Jun 29 03:31:05 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-3b092449-37b7-42b6-898a-b9a979780de0 tempest-VolumesSnapshotListTestJSON-285436761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-3aff4088-7d2a-47cc-8fe7-abde995d4e54" returned: 0 in 0.859s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:31:05 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-3b092449-37b7-42b6-898a-b9a979780de0 tempest-VolumesSnapshotListTestJSON-285436761 None] <== create_volume: return (2126ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:31:05 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-3b092449-37b7-42b6-898a-b9a979780de0 tempest-VolumesSnapshotListTestJSON-285436761 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.130s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:31:05 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-3b092449-37b7-42b6-898a-b9a979780de0 tempest-VolumesSnapshotListTestJSON-285436761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f61b7d0b-fbbb-407f-b116-ec32f13f1bc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3aff4088-7d2a-47cc-8fe7-abde995d4e54', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:31:05 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-3b092449-37b7-42b6-898a-b9a979780de0 tempest-VolumesSnapshotListTestJSON-285436761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c1296d1-60cb-4f82-9f90-f0201cc23b0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:31:05 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-3b092449-37b7-42b6-898a-b9a979780de0 tempest-VolumesSnapshotListTestJSON-285436761 None] Volume volume-3aff4088-7d2a-47cc-8fe7-abde995d4e54 (3aff4088-7d2a-47cc-8fe7-abde995d4e54): created successfully Jun 29 03:31:05 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-3b092449-37b7-42b6-898a-b9a979780de0 tempest-VolumesSnapshotListTestJSON-285436761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c1296d1-60cb-4f82-9f90-f0201cc23b0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:31:05 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-3b092449-37b7-42b6-898a-b9a979780de0 tempest-VolumesSnapshotListTestJSON-285436761 None] Flow 'volume_create_manager' (27717c61-2617-4576-9118-1af65fe60ed5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:31:05 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-3b092449-37b7-42b6-898a-b9a979780de0 tempest-VolumesSnapshotListTestJSON-285436761 None] Created volume successfully. Jun 29 03:31:07 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-69b70de1-e2a3-4d92-b96f-1bea1baf334f tempest-VolumesSnapshotListTestJSON-285436761 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:31:07 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-69b70de1-e2a3-4d92-b96f-1bea1baf334f tempest-VolumesSnapshotListTestJSON-285436761 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:31:07 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-69b70de1-e2a3-4d92-b96f-1bea1baf334f tempest-VolumesSnapshotListTestJSON-285436761 None] Creating offline snapshot a93ac7ff-170c-4476-b3b2-52d5d4ed44f4 of volume 3aff4088-7d2a-47cc-8fe7-abde995d4e54 {{(pid=93468) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 29 03:31:07 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1bc2623-fac7-4696-88fe-1d12af719e0a]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:31:07 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-69b70de1-e2a3-4d92-b96f-1bea1baf334f tempest-VolumesSnapshotListTestJSON-285436761 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-3aff4088-7d2a-47cc-8fe7-abde995d4e54 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:31:07 devstack sudo[104732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-3aff4088-7d2a-47cc-8fe7-abde995d4e54 Jun 29 03:31:07 devstack sudo[104732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:31:08 devstack sudo[104732]: pam_unix(sudo:session): session closed for user root Jun 29 03:31:08 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-69b70de1-e2a3-4d92-b96f-1bea1baf334f tempest-VolumesSnapshotListTestJSON-285436761 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-3aff4088-7d2a-47cc-8fe7-abde995d4e54" returned: 0 in 0.992s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:31:08 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-69b70de1-e2a3-4d92-b96f-1bea1baf334f tempest-VolumesSnapshotListTestJSON-285436761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-3aff4088-7d2a-47cc-8fe7-abde995d4e54,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-3aff4088-7d2a-47cc-8fe7-abde995d4e54.a93ac7ff-170c-4476-b3b2-52d5d4ed44f4 1G {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:31:08 devstack sudo[104738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-3aff4088-7d2a-47cc-8fe7-abde995d4e54,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-3aff4088-7d2a-47cc-8fe7-abde995d4e54.a93ac7ff-170c-4476-b3b2-52d5d4ed44f4 1G Jun 29 03:31:08 devstack sudo[104738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:31:09 devstack sudo[104738]: pam_unix(sudo:session): session closed for user root Jun 29 03:31:09 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-69b70de1-e2a3-4d92-b96f-1bea1baf334f tempest-VolumesSnapshotListTestJSON-285436761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-3aff4088-7d2a-47cc-8fe7-abde995d4e54,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-3aff4088-7d2a-47cc-8fe7-abde995d4e54.a93ac7ff-170c-4476-b3b2-52d5d4ed44f4 1G" returned: 0 in 1.144s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:31:09 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-69b70de1-e2a3-4d92-b96f-1bea1baf334f tempest-VolumesSnapshotListTestJSON-285436761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3aff4088-7d2a-47cc-8fe7-abde995d4e54 -F qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-3aff4088-7d2a-47cc-8fe7-abde995d4e54.a93ac7ff-170c-4476-b3b2-52d5d4ed44f4 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:31:09 devstack sudo[104745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3aff4088-7d2a-47cc-8fe7-abde995d4e54 -F qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-3aff4088-7d2a-47cc-8fe7-abde995d4e54.a93ac7ff-170c-4476-b3b2-52d5d4ed44f4 Jun 29 03:31:09 devstack sudo[104745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:31:10 devstack sudo[104745]: pam_unix(sudo:session): session closed for user root Jun 29 03:31:10 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-69b70de1-e2a3-4d92-b96f-1bea1baf334f tempest-VolumesSnapshotListTestJSON-285436761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3aff4088-7d2a-47cc-8fe7-abde995d4e54 -F qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-3aff4088-7d2a-47cc-8fe7-abde995d4e54.a93ac7ff-170c-4476-b3b2-52d5d4ed44f4" returned: 0 in 1.003s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:31:10 devstack cinder-volume[93468]: WARNING cinder.volume.drivers.remotefs [None req-69b70de1-e2a3-4d92-b96f-1bea1baf334f tempest-VolumesSnapshotListTestJSON-285436761 None] /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-3aff4088-7d2a-47cc-8fe7-abde995d4e54.a93ac7ff-170c-4476-b3b2-52d5d4ed44f4 is being set with open permissions: ugo+rw Jun 29 03:31:10 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-69b70de1-e2a3-4d92-b96f-1bea1baf334f tempest-VolumesSnapshotListTestJSON-285436761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-3aff4088-7d2a-47cc-8fe7-abde995d4e54.a93ac7ff-170c-4476-b3b2-52d5d4ed44f4 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:31:10 devstack sudo[104750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-3aff4088-7d2a-47cc-8fe7-abde995d4e54.a93ac7ff-170c-4476-b3b2-52d5d4ed44f4 Jun 29 03:31:10 devstack sudo[104750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:31:11 devstack sudo[104750]: pam_unix(sudo:session): session closed for user root Jun 29 03:31:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-69b70de1-e2a3-4d92-b96f-1bea1baf334f tempest-VolumesSnapshotListTestJSON-285436761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-3aff4088-7d2a-47cc-8fe7-abde995d4e54.a93ac7ff-170c-4476-b3b2-52d5d4ed44f4" returned: 0 in 0.788s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:31:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-69b70de1-e2a3-4d92-b96f-1bea1baf334f tempest-VolumesSnapshotListTestJSON-285436761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-3aff4088-7d2a-47cc-8fe7-abde995d4e54.info {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:31:11 devstack sudo[104757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-3aff4088-7d2a-47cc-8fe7-abde995d4e54.info Jun 29 03:31:11 devstack sudo[104757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:31:11 devstack cinder-volume[93468]: DEBUG oslo_service.periodic_task [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Running periodic task VolumeManager._thread_info {{(pid=93468) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 29 03:31:11 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] thread count: 28 {{(pid=93468) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 29 03:31:11 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] thread info: [<_MainThread(MainThread, started 132331377287296)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93468) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 29 03:31:11 devstack sudo[104757]: pam_unix(sudo:session): session closed for user root Jun 29 03:31:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-69b70de1-e2a3-4d92-b96f-1bea1baf334f tempest-VolumesSnapshotListTestJSON-285436761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-3aff4088-7d2a-47cc-8fe7-abde995d4e54.info" returned: 0 in 0.743s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:31:11 devstack cinder-volume[93468]: WARNING cinder.volume.drivers.remotefs [None req-69b70de1-e2a3-4d92-b96f-1bea1baf334f tempest-VolumesSnapshotListTestJSON-285436761 None] /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-3aff4088-7d2a-47cc-8fe7-abde995d4e54.info is being set with open permissions: ugo+rw Jun 29 03:31:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-69b70de1-e2a3-4d92-b96f-1bea1baf334f tempest-VolumesSnapshotListTestJSON-285436761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-3aff4088-7d2a-47cc-8fe7-abde995d4e54.info {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:31:11 devstack sudo[104766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-3aff4088-7d2a-47cc-8fe7-abde995d4e54.info Jun 29 03:31:11 devstack sudo[104766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:31:12 devstack sudo[104766]: pam_unix(sudo:session): session closed for user root Jun 29 03:31:12 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-69b70de1-e2a3-4d92-b96f-1bea1baf334f tempest-VolumesSnapshotListTestJSON-285436761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-3aff4088-7d2a-47cc-8fe7-abde995d4e54.info" returned: 0 in 0.758s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:31:12 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-69b70de1-e2a3-4d92-b96f-1bea1baf334f tempest-VolumesSnapshotListTestJSON-285436761 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.603s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:31:12 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-69b70de1-e2a3-4d92-b96f-1bea1baf334f tempest-VolumesSnapshotListTestJSON-285436761 None] Create snapshot completed successfully Jun 29 03:31:13 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-d535e8ff-12aa-4680-b47c-358eadefa26d tempest-VolumesSnapshotListTestJSON-285436761 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:31:13 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-d535e8ff-12aa-4680-b47c-358eadefa26d tempest-VolumesSnapshotListTestJSON-285436761 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:31:13 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-d535e8ff-12aa-4680-b47c-358eadefa26d tempest-VolumesSnapshotListTestJSON-285436761 None] Creating offline snapshot 6a423dbf-857a-443e-8bad-00376486c6d4 of volume 3aff4088-7d2a-47cc-8fe7-abde995d4e54 {{(pid=93468) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 29 03:31:13 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbeaeec0-f3c9-418f-81e0-90a139dc70ff]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:31:13 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d535e8ff-12aa-4680-b47c-358eadefa26d tempest-VolumesSnapshotListTestJSON-285436761 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-3aff4088-7d2a-47cc-8fe7-abde995d4e54.a93ac7ff-170c-4476-b3b2-52d5d4ed44f4 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:31:13 devstack sudo[104794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-3aff4088-7d2a-47cc-8fe7-abde995d4e54.a93ac7ff-170c-4476-b3b2-52d5d4ed44f4 Jun 29 03:31:13 devstack sudo[104794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:31:15 devstack sudo[104794]: pam_unix(sudo:session): session closed for user root Jun 29 03:31:15 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d535e8ff-12aa-4680-b47c-358eadefa26d tempest-VolumesSnapshotListTestJSON-285436761 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-3aff4088-7d2a-47cc-8fe7-abde995d4e54.a93ac7ff-170c-4476-b3b2-52d5d4ed44f4" returned: 0 in 1.526s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:31:15 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-d535e8ff-12aa-4680-b47c-358eadefa26d tempest-VolumesSnapshotListTestJSON-285436761 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3aff4088-7d2a-47cc-8fe7-abde995d4e54(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93468) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 29 03:31:15 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d535e8ff-12aa-4680-b47c-358eadefa26d tempest-VolumesSnapshotListTestJSON-285436761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-3aff4088-7d2a-47cc-8fe7-abde995d4e54.a93ac7ff-170c-4476-b3b2-52d5d4ed44f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-3aff4088-7d2a-47cc-8fe7-abde995d4e54.6a423dbf-857a-443e-8bad-00376486c6d4 1G {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:31:15 devstack sudo[104903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-3aff4088-7d2a-47cc-8fe7-abde995d4e54.a93ac7ff-170c-4476-b3b2-52d5d4ed44f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-3aff4088-7d2a-47cc-8fe7-abde995d4e54.6a423dbf-857a-443e-8bad-00376486c6d4 1G Jun 29 03:31:15 devstack sudo[104903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:31:17 devstack sudo[104903]: pam_unix(sudo:session): session closed for user root Jun 29 03:31:17 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d535e8ff-12aa-4680-b47c-358eadefa26d tempest-VolumesSnapshotListTestJSON-285436761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-3aff4088-7d2a-47cc-8fe7-abde995d4e54.a93ac7ff-170c-4476-b3b2-52d5d4ed44f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-3aff4088-7d2a-47cc-8fe7-abde995d4e54.6a423dbf-857a-443e-8bad-00376486c6d4 1G" returned: 0 in 2.042s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:31:17 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d535e8ff-12aa-4680-b47c-358eadefa26d tempest-VolumesSnapshotListTestJSON-285436761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3aff4088-7d2a-47cc-8fe7-abde995d4e54.a93ac7ff-170c-4476-b3b2-52d5d4ed44f4 -F qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-3aff4088-7d2a-47cc-8fe7-abde995d4e54.6a423dbf-857a-443e-8bad-00376486c6d4 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:31:17 devstack sudo[104938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3aff4088-7d2a-47cc-8fe7-abde995d4e54.a93ac7ff-170c-4476-b3b2-52d5d4ed44f4 -F qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-3aff4088-7d2a-47cc-8fe7-abde995d4e54.6a423dbf-857a-443e-8bad-00376486c6d4 Jun 29 03:31:17 devstack sudo[104938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:31:18 devstack sudo[104938]: pam_unix(sudo:session): session closed for user root Jun 29 03:31:18 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d535e8ff-12aa-4680-b47c-358eadefa26d tempest-VolumesSnapshotListTestJSON-285436761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3aff4088-7d2a-47cc-8fe7-abde995d4e54.a93ac7ff-170c-4476-b3b2-52d5d4ed44f4 -F qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-3aff4088-7d2a-47cc-8fe7-abde995d4e54.6a423dbf-857a-443e-8bad-00376486c6d4" returned: 0 in 1.315s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:31:18 devstack cinder-volume[93468]: WARNING cinder.volume.drivers.remotefs [None req-d535e8ff-12aa-4680-b47c-358eadefa26d tempest-VolumesSnapshotListTestJSON-285436761 None] /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-3aff4088-7d2a-47cc-8fe7-abde995d4e54.6a423dbf-857a-443e-8bad-00376486c6d4 is being set with open permissions: ugo+rw Jun 29 03:31:18 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d535e8ff-12aa-4680-b47c-358eadefa26d tempest-VolumesSnapshotListTestJSON-285436761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-3aff4088-7d2a-47cc-8fe7-abde995d4e54.6a423dbf-857a-443e-8bad-00376486c6d4 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:31:18 devstack sudo[104947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-3aff4088-7d2a-47cc-8fe7-abde995d4e54.6a423dbf-857a-443e-8bad-00376486c6d4 Jun 29 03:31:18 devstack sudo[104947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:31:19 devstack sudo[104947]: pam_unix(sudo:session): session closed for user root Jun 29 03:31:19 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d535e8ff-12aa-4680-b47c-358eadefa26d tempest-VolumesSnapshotListTestJSON-285436761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-3aff4088-7d2a-47cc-8fe7-abde995d4e54.6a423dbf-857a-443e-8bad-00376486c6d4" returned: 0 in 1.044s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:31:19 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-d535e8ff-12aa-4680-b47c-358eadefa26d tempest-VolumesSnapshotListTestJSON-285436761 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.120s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:31:19 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-d535e8ff-12aa-4680-b47c-358eadefa26d tempest-VolumesSnapshotListTestJSON-285436761 None] Create snapshot completed successfully Jun 29 03:31:20 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-e1e60170-56ed-4d60-a8cc-c02506bb03fe tempest-VolumesSnapshotListTestJSON-285436761 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:31:20 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-e1e60170-56ed-4d60-a8cc-c02506bb03fe tempest-VolumesSnapshotListTestJSON-285436761 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.013s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:31:20 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-e1e60170-56ed-4d60-a8cc-c02506bb03fe tempest-VolumesSnapshotListTestJSON-285436761 None] Creating offline snapshot a57559b2-0752-40fe-bde0-67dedfe616d3 of volume 3aff4088-7d2a-47cc-8fe7-abde995d4e54 {{(pid=93468) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 29 03:31:20 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef65f772-b008-49fa-8f29-ef8aad6121ac]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:31:20 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-e1e60170-56ed-4d60-a8cc-c02506bb03fe tempest-VolumesSnapshotListTestJSON-285436761 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-3aff4088-7d2a-47cc-8fe7-abde995d4e54.6a423dbf-857a-443e-8bad-00376486c6d4 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:31:21 devstack sudo[104951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-3aff4088-7d2a-47cc-8fe7-abde995d4e54.6a423dbf-857a-443e-8bad-00376486c6d4 Jun 29 03:31:21 devstack sudo[104951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:31:22 devstack sudo[104951]: pam_unix(sudo:session): session closed for user root Jun 29 03:31:22 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-e1e60170-56ed-4d60-a8cc-c02506bb03fe tempest-VolumesSnapshotListTestJSON-285436761 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-3aff4088-7d2a-47cc-8fe7-abde995d4e54.6a423dbf-857a-443e-8bad-00376486c6d4" returned: 0 in 1.674s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:31:22 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-e1e60170-56ed-4d60-a8cc-c02506bb03fe tempest-VolumesSnapshotListTestJSON-285436761 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3aff4088-7d2a-47cc-8fe7-abde995d4e54(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93468) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 29 03:31:22 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-e1e60170-56ed-4d60-a8cc-c02506bb03fe tempest-VolumesSnapshotListTestJSON-285436761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-3aff4088-7d2a-47cc-8fe7-abde995d4e54.6a423dbf-857a-443e-8bad-00376486c6d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-3aff4088-7d2a-47cc-8fe7-abde995d4e54.a57559b2-0752-40fe-bde0-67dedfe616d3 1G {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:31:22 devstack sudo[104957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-3aff4088-7d2a-47cc-8fe7-abde995d4e54.6a423dbf-857a-443e-8bad-00376486c6d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-3aff4088-7d2a-47cc-8fe7-abde995d4e54.a57559b2-0752-40fe-bde0-67dedfe616d3 1G Jun 29 03:31:22 devstack sudo[104957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:31:24 devstack sudo[104957]: pam_unix(sudo:session): session closed for user root Jun 29 03:31:24 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-e1e60170-56ed-4d60-a8cc-c02506bb03fe tempest-VolumesSnapshotListTestJSON-285436761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-3aff4088-7d2a-47cc-8fe7-abde995d4e54.6a423dbf-857a-443e-8bad-00376486c6d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-3aff4088-7d2a-47cc-8fe7-abde995d4e54.a57559b2-0752-40fe-bde0-67dedfe616d3 1G" returned: 0 in 1.986s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:31:24 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-e1e60170-56ed-4d60-a8cc-c02506bb03fe tempest-VolumesSnapshotListTestJSON-285436761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3aff4088-7d2a-47cc-8fe7-abde995d4e54.6a423dbf-857a-443e-8bad-00376486c6d4 -F qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-3aff4088-7d2a-47cc-8fe7-abde995d4e54.a57559b2-0752-40fe-bde0-67dedfe616d3 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:31:24 devstack sudo[104964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3aff4088-7d2a-47cc-8fe7-abde995d4e54.6a423dbf-857a-443e-8bad-00376486c6d4 -F qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-3aff4088-7d2a-47cc-8fe7-abde995d4e54.a57559b2-0752-40fe-bde0-67dedfe616d3 Jun 29 03:31:24 devstack sudo[104964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:31:25 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-37991bd2-8eaa-4cab-a487-ab99018bcd67 tempest-VolumesActionsTest-882954247 None] Acquiring lock "cinder-9ab012d6-eec7-4252-8797-e69a378d83ae" by "attach_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:31:25 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-37991bd2-8eaa-4cab-a487-ab99018bcd67 tempest-VolumesActionsTest-882954247 None] Lock "cinder-9ab012d6-eec7-4252-8797-e69a378d83ae" acquired by "attach_volume" :: waited 0.097s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:31:25 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-37991bd2-8eaa-4cab-a487-ab99018bcd67 tempest-VolumesActionsTest-882954247 None] Attaching volume 9ab012d6-eec7-4252-8797-e69a378d83ae to instance 8cf5b5f8-ac7b-46eb-b245-beda5be231e8 at mountpoint /dev/vdb on host None. Jun 29 03:31:25 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-37991bd2-8eaa-4cab-a487-ab99018bcd67 tempest-VolumesActionsTest-882954247 None] Attach volume completed successfully. Jun 29 03:31:25 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-37991bd2-8eaa-4cab-a487-ab99018bcd67 tempest-VolumesActionsTest-882954247 None] Lock "cinder-9ab012d6-eec7-4252-8797-e69a378d83ae" released by "attach_volume" :: held 0.287s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:31:26 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-6415e0f5-a08e-42a5-855d-670afbe302a9 tempest-VolumesActionsTest-882954247 None] Acquiring lock "cinder-9ab012d6-eec7-4252-8797-e69a378d83ae-detach_volume" by "detach_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:31:26 devstack sudo[104964]: pam_unix(sudo:session): session closed for user root Jun 29 03:31:26 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-e1e60170-56ed-4d60-a8cc-c02506bb03fe tempest-VolumesSnapshotListTestJSON-285436761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3aff4088-7d2a-47cc-8fe7-abde995d4e54.6a423dbf-857a-443e-8bad-00376486c6d4 -F qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-3aff4088-7d2a-47cc-8fe7-abde995d4e54.a57559b2-0752-40fe-bde0-67dedfe616d3" returned: 0 in 1.670s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:31:26 devstack cinder-volume[93468]: WARNING cinder.volume.drivers.remotefs [None req-e1e60170-56ed-4d60-a8cc-c02506bb03fe tempest-VolumesSnapshotListTestJSON-285436761 None] /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-3aff4088-7d2a-47cc-8fe7-abde995d4e54.a57559b2-0752-40fe-bde0-67dedfe616d3 is being set with open permissions: ugo+rw Jun 29 03:31:26 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-e1e60170-56ed-4d60-a8cc-c02506bb03fe tempest-VolumesSnapshotListTestJSON-285436761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-3aff4088-7d2a-47cc-8fe7-abde995d4e54.a57559b2-0752-40fe-bde0-67dedfe616d3 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:31:26 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-6415e0f5-a08e-42a5-855d-670afbe302a9 tempest-VolumesActionsTest-882954247 None] Lock "cinder-9ab012d6-eec7-4252-8797-e69a378d83ae-detach_volume" acquired by "detach_volume" :: waited 0.064s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:31:26 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-6415e0f5-a08e-42a5-855d-670afbe302a9 tempest-VolumesActionsTest-882954247 None] Detaching volume 9ab012d6-eec7-4252-8797-e69a378d83ae from instance 8cf5b5f8-ac7b-46eb-b245-beda5be231e8. Jun 29 03:31:26 devstack sudo[104975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-3aff4088-7d2a-47cc-8fe7-abde995d4e54.a57559b2-0752-40fe-bde0-67dedfe616d3 Jun 29 03:31:26 devstack sudo[104975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:31:26 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-6415e0f5-a08e-42a5-855d-670afbe302a9 tempest-VolumesActionsTest-882954247 None] Detach volume completed successfully. Jun 29 03:31:26 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-6415e0f5-a08e-42a5-855d-670afbe302a9 tempest-VolumesActionsTest-882954247 None] Lock "cinder-9ab012d6-eec7-4252-8797-e69a378d83ae-detach_volume" released by "detach_volume" :: held 0.179s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:31:28 devstack sudo[104975]: pam_unix(sudo:session): session closed for user root Jun 29 03:31:28 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-e1e60170-56ed-4d60-a8cc-c02506bb03fe tempest-VolumesSnapshotListTestJSON-285436761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-3aff4088-7d2a-47cc-8fe7-abde995d4e54.a57559b2-0752-40fe-bde0-67dedfe616d3" returned: 0 in 1.943s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:31:28 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-e1e60170-56ed-4d60-a8cc-c02506bb03fe tempest-VolumesSnapshotListTestJSON-285436761 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 7.463s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:31:28 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-e1e60170-56ed-4d60-a8cc-c02506bb03fe tempest-VolumesSnapshotListTestJSON-285436761 None] Create snapshot completed successfully Jun 29 03:31:29 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-7bbc1bfa-30c3-4b82-b3a0-c6679e68e6f0 tempest-VolumesSnapshotListTestJSON-285436761 None] Acquiring lock "cinder-a57559b2-0752-40fe-bde0-67dedfe616d3-delete_snapshot" by "delete_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:31:29 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-7bbc1bfa-30c3-4b82-b3a0-c6679e68e6f0 tempest-VolumesSnapshotListTestJSON-285436761 None] Lock "cinder-a57559b2-0752-40fe-bde0-67dedfe616d3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:31:29 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-7bbc1bfa-30c3-4b82-b3a0-c6679e68e6f0 tempest-VolumesSnapshotListTestJSON-285436761 None] Acquiring lock "cinder-quobyte-3aff4088-7d2a-47cc-8fe7-abde995d4e54" by "delete_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:31:29 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-7bbc1bfa-30c3-4b82-b3a0-c6679e68e6f0 tempest-VolumesSnapshotListTestJSON-285436761 None] Lock "cinder-quobyte-3aff4088-7d2a-47cc-8fe7-abde995d4e54" acquired by "delete_snapshot" :: waited 0.023s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:31:29 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-7bbc1bfa-30c3-4b82-b3a0-c6679e68e6f0 tempest-VolumesSnapshotListTestJSON-285436761 None] Acquiring lock "cinder-quobyte-a57559b2-0752-40fe-bde0-67dedfe616d3" by "_delete_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:31:29 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-7bbc1bfa-30c3-4b82-b3a0-c6679e68e6f0 tempest-VolumesSnapshotListTestJSON-285436761 None] Lock "cinder-quobyte-a57559b2-0752-40fe-bde0-67dedfe616d3" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:31:29 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-7bbc1bfa-30c3-4b82-b3a0-c6679e68e6f0 tempest-VolumesSnapshotListTestJSON-285436761 None] Deleting offline snapshot a57559b2-0752-40fe-bde0-67dedfe616d3 of volume 3aff4088-7d2a-47cc-8fe7-abde995d4e54 {{(pid=93468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 29 03:31:29 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-7bbc1bfa-30c3-4b82-b3a0-c6679e68e6f0 tempest-VolumesSnapshotListTestJSON-285436761 None] snapshot_file for this snap is: volume-3aff4088-7d2a-47cc-8fe7-abde995d4e54.a57559b2-0752-40fe-bde0-67dedfe616d3 {{(pid=93468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 29 03:31:29 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[aac7ccbd-7b6e-45a8-821c-33f2fd37c36d]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:31:29 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-7bbc1bfa-30c3-4b82-b3a0-c6679e68e6f0 tempest-VolumesSnapshotListTestJSON-285436761 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-3aff4088-7d2a-47cc-8fe7-abde995d4e54.a57559b2-0752-40fe-bde0-67dedfe616d3 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:31:29 devstack sudo[105017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-3aff4088-7d2a-47cc-8fe7-abde995d4e54.a57559b2-0752-40fe-bde0-67dedfe616d3 Jun 29 03:31:29 devstack sudo[105017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:31:30 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-7bbc1bfa-30c3-4b82-b3a0-c6679e68e6f0 tempest-VolumesSnapshotListTestJSON-285436761 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-3aff4088-7d2a-47cc-8fe7-abde995d4e54.a57559b2-0752-40fe-bde0-67dedfe616d3" returned: 0 in 1.079s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:31:30 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-7bbc1bfa-30c3-4b82-b3a0-c6679e68e6f0 tempest-VolumesSnapshotListTestJSON-285436761 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3aff4088-7d2a-47cc-8fe7-abde995d4e54(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93468) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 29 03:31:30 devstack sudo[105017]: pam_unix(sudo:session): session closed for user root Jun 29 03:31:31 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[29655e2b-69e5-4d9a-a7f2-d944dca48ceb]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:31:31 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-7bbc1bfa-30c3-4b82-b3a0-c6679e68e6f0 tempest-VolumesSnapshotListTestJSON-285436761 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-3aff4088-7d2a-47cc-8fe7-abde995d4e54.6a423dbf-857a-443e-8bad-00376486c6d4 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:31:31 devstack sudo[105049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-3aff4088-7d2a-47cc-8fe7-abde995d4e54.6a423dbf-857a-443e-8bad-00376486c6d4 Jun 29 03:31:31 devstack sudo[105049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:31:31 devstack sudo[105049]: pam_unix(sudo:session): session closed for user root Jun 29 03:31:31 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-7bbc1bfa-30c3-4b82-b3a0-c6679e68e6f0 tempest-VolumesSnapshotListTestJSON-285436761 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-3aff4088-7d2a-47cc-8fe7-abde995d4e54.6a423dbf-857a-443e-8bad-00376486c6d4" returned: 0 in 0.863s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:31:31 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-7bbc1bfa-30c3-4b82-b3a0-c6679e68e6f0 tempest-VolumesSnapshotListTestJSON-285436761 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3aff4088-7d2a-47cc-8fe7-abde995d4e54(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93468) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 29 03:31:31 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-7bbc1bfa-30c3-4b82-b3a0-c6679e68e6f0 tempest-VolumesSnapshotListTestJSON-285436761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-3aff4088-7d2a-47cc-8fe7-abde995d4e54.a57559b2-0752-40fe-bde0-67dedfe616d3 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:31:31 devstack sudo[105056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-3aff4088-7d2a-47cc-8fe7-abde995d4e54.a57559b2-0752-40fe-bde0-67dedfe616d3 Jun 29 03:31:31 devstack sudo[105056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:31:31 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-64a54140-ca26-4e15-9275-b5e50ac2d43e tempest-TestInstancesWithCinderVolumes-816660254 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:31:31 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-64a54140-ca26-4e15-9275-b5e50ac2d43e tempest-TestInstancesWithCinderVolumes-816660254 None] Flow 'volume_create_manager' (b6532fbe-7032-4cbe-9959-374f6acead61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:31:32 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-64a54140-ca26-4e15-9275-b5e50ac2d43e tempest-TestInstancesWithCinderVolumes-816660254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (961ef227-b550-4f2a-ad5d-194cb9daecc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:31:32 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-64a54140-ca26-4e15-9275-b5e50ac2d43e tempest-TestInstancesWithCinderVolumes-816660254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (961ef227-b550-4f2a-ad5d-194cb9daecc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:31:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-474530435',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47a2a0b2-eddf-4fbb-a753-0e856fc86fe8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78257196e3dd42fc8b9f17f5008f135f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:31:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:31:32Z,use_quota=True,user_id='6ddd6e7d294f40458afa9cce668be12d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2350c12c-62da-4b1c-8e9c-991d23fa296b),volume_type_id=2350c12c-62da-4b1c-8e9c-991d23fa296b)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:31:32 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-64a54140-ca26-4e15-9275-b5e50ac2d43e tempest-TestInstancesWithCinderVolumes-816660254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1deebac0-fdae-4732-8dbc-9e48e90b6a99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:31:32 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-64a54140-ca26-4e15-9275-b5e50ac2d43e tempest-TestInstancesWithCinderVolumes-816660254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1deebac0-fdae-4732-8dbc-9e48e90b6a99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:31:32 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-64a54140-ca26-4e15-9275-b5e50ac2d43e tempest-TestInstancesWithCinderVolumes-816660254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d453745-0d6e-4e09-93ea-f6c95f92db8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:31:32 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-64a54140-ca26-4e15-9275-b5e50ac2d43e tempest-TestInstancesWithCinderVolumes-816660254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d453745-0d6e-4e09-93ea-f6c95f92db8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '47a2a0b2-eddf-4fbb-a753-0e856fc86fe8', 'volume_name': 'volume-47a2a0b2-eddf-4fbb-a753-0e856fc86fe8', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:31:32 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-64a54140-ca26-4e15-9275-b5e50ac2d43e tempest-TestInstancesWithCinderVolumes-816660254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a685a8dd-ecf8-4375-b8a1-871d5e0ad188) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:31:32 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-64a54140-ca26-4e15-9275-b5e50ac2d43e tempest-TestInstancesWithCinderVolumes-816660254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a685a8dd-ecf8-4375-b8a1-871d5e0ad188) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:31:32 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-64a54140-ca26-4e15-9275-b5e50ac2d43e tempest-TestInstancesWithCinderVolumes-816660254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb604964-5bc9-4066-aad5-80c0aa5c4b9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:31:32 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-64a54140-ca26-4e15-9275-b5e50ac2d43e tempest-TestInstancesWithCinderVolumes-816660254 None] Volume 47a2a0b2-eddf-4fbb-a753-0e856fc86fe8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-47a2a0b2-eddf-4fbb-a753-0e856fc86fe8', 'volume_size': 1} Jun 29 03:31:32 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-64a54140-ca26-4e15-9275-b5e50ac2d43e tempest-TestInstancesWithCinderVolumes-816660254 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:31:32 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-64a54140-ca26-4e15-9275-b5e50ac2d43e tempest-TestInstancesWithCinderVolumes-816660254 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:31:32 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-64a54140-ca26-4e15-9275-b5e50ac2d43e tempest-TestInstancesWithCinderVolumes-816660254 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:31:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-474530435',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47a2a0b2-eddf-4fbb-a753-0e856fc86fe8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78257196e3dd42fc8b9f17f5008f135f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:31:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:31:32Z,use_quota=True,user_id='6ddd6e7d294f40458afa9cce668be12d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2350c12c-62da-4b1c-8e9c-991d23fa296b),volume_type_id=2350c12c-62da-4b1c-8e9c-991d23fa296b)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:31:32 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-64a54140-ca26-4e15-9275-b5e50ac2d43e tempest-TestInstancesWithCinderVolumes-816660254 None] Creating volume 47a2a0b2-eddf-4fbb-a753-0e856fc86fe8 {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:31:32 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-64a54140-ca26-4e15-9275-b5e50ac2d43e tempest-TestInstancesWithCinderVolumes-816660254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:31:32 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-64a54140-ca26-4e15-9275-b5e50ac2d43e tempest-TestInstancesWithCinderVolumes-816660254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:31:32 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-64a54140-ca26-4e15-9275-b5e50ac2d43e tempest-TestInstancesWithCinderVolumes-816660254 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:31:32 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-64a54140-ca26-4e15-9275-b5e50ac2d43e tempest-TestInstancesWithCinderVolumes-816660254 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:31:32 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-64a54140-ca26-4e15-9275-b5e50ac2d43e tempest-TestInstancesWithCinderVolumes-816660254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:31:32 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-64a54140-ca26-4e15-9275-b5e50ac2d43e tempest-TestInstancesWithCinderVolumes-816660254 None] Selected osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:31:32 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-64a54140-ca26-4e15-9275-b5e50ac2d43e tempest-TestInstancesWithCinderVolumes-816660254 None] casted to osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f Jun 29 03:31:32 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-64a54140-ca26-4e15-9275-b5e50ac2d43e tempest-TestInstancesWithCinderVolumes-816660254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-47a2a0b2-eddf-4fbb-a753-0e856fc86fe8 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:31:32 devstack sudo[105058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-47a2a0b2-eddf-4fbb-a753-0e856fc86fe8 1073741824 Jun 29 03:31:32 devstack sudo[105058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:31:32 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-77fc42bf-eec0-4be8-962d-1aeee8a80171 tempest-TestInstancesWithCinderVolumes-816660254 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:31:32 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-77fc42bf-eec0-4be8-962d-1aeee8a80171 tempest-TestInstancesWithCinderVolumes-816660254 None] Flow 'volume_create_manager' (43c3a3f7-a517-4547-a055-d5e0dd0e14c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:31:32 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-77fc42bf-eec0-4be8-962d-1aeee8a80171 tempest-TestInstancesWithCinderVolumes-816660254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fde47cbc-0912-42e9-bddf-88260eefea70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:31:32 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-77fc42bf-eec0-4be8-962d-1aeee8a80171 tempest-TestInstancesWithCinderVolumes-816660254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fde47cbc-0912-42e9-bddf-88260eefea70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:31:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-744569615',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f2e765d-fff0-4c4d-b402-3ec90d0d609c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78257196e3dd42fc8b9f17f5008f135f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:31:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:31:32Z,use_quota=True,user_id='6ddd6e7d294f40458afa9cce668be12d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ffb78695-b504-4af2-b914-8f74fd1e4627),volume_type_id=ffb78695-b504-4af2-b914-8f74fd1e4627)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:31:32 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-77fc42bf-eec0-4be8-962d-1aeee8a80171 tempest-TestInstancesWithCinderVolumes-816660254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43840fa5-7b79-4b30-9ae0-ffa440489def) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:31:32 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-77fc42bf-eec0-4be8-962d-1aeee8a80171 tempest-TestInstancesWithCinderVolumes-816660254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43840fa5-7b79-4b30-9ae0-ffa440489def) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:31:32 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-77fc42bf-eec0-4be8-962d-1aeee8a80171 tempest-TestInstancesWithCinderVolumes-816660254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a25a0e1-5299-4104-9e54-d24cb9fc8404) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:31:32 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-77fc42bf-eec0-4be8-962d-1aeee8a80171 tempest-TestInstancesWithCinderVolumes-816660254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a25a0e1-5299-4104-9e54-d24cb9fc8404) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f2e765d-fff0-4c4d-b402-3ec90d0d609c', 'volume_name': 'volume-2f2e765d-fff0-4c4d-b402-3ec90d0d609c', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:31:32 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-77fc42bf-eec0-4be8-962d-1aeee8a80171 tempest-TestInstancesWithCinderVolumes-816660254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ccf66e3-eb77-4f7d-868a-43ed19d3de87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:31:32 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-77fc42bf-eec0-4be8-962d-1aeee8a80171 tempest-TestInstancesWithCinderVolumes-816660254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ccf66e3-eb77-4f7d-868a-43ed19d3de87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:31:32 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-77fc42bf-eec0-4be8-962d-1aeee8a80171 tempest-TestInstancesWithCinderVolumes-816660254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41f08e08-b99e-40ee-9a3a-f501ad2de4a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:31:32 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-77fc42bf-eec0-4be8-962d-1aeee8a80171 tempest-TestInstancesWithCinderVolumes-816660254 None] Volume 2f2e765d-fff0-4c4d-b402-3ec90d0d609c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f2e765d-fff0-4c4d-b402-3ec90d0d609c', 'volume_size': 1} Jun 29 03:31:32 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-77fc42bf-eec0-4be8-962d-1aeee8a80171 tempest-TestInstancesWithCinderVolumes-816660254 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:31:33 devstack sudo[105056]: pam_unix(sudo:session): session closed for user root Jun 29 03:31:33 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-7bbc1bfa-30c3-4b82-b3a0-c6679e68e6f0 tempest-VolumesSnapshotListTestJSON-285436761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-3aff4088-7d2a-47cc-8fe7-abde995d4e54.a57559b2-0752-40fe-bde0-67dedfe616d3" returned: 0 in 1.176s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:31:33 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-7bbc1bfa-30c3-4b82-b3a0-c6679e68e6f0 tempest-VolumesSnapshotListTestJSON-285436761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-3aff4088-7d2a-47cc-8fe7-abde995d4e54.a57559b2-0752-40fe-bde0-67dedfe616d3 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:31:33 devstack sudo[105068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-3aff4088-7d2a-47cc-8fe7-abde995d4e54.a57559b2-0752-40fe-bde0-67dedfe616d3 Jun 29 03:31:33 devstack sudo[105068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:31:33 devstack sudo[105058]: pam_unix(sudo:session): session closed for user root Jun 29 03:31:33 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-64a54140-ca26-4e15-9275-b5e50ac2d43e tempest-TestInstancesWithCinderVolumes-816660254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-47a2a0b2-eddf-4fbb-a753-0e856fc86fe8 1073741824" returned: 0 in 1.125s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:31:33 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-08a2530f-1914-4272-bb7d-7be435d7c08f tempest-TestInstancesWithCinderVolumes-816660254 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:31:33 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-08a2530f-1914-4272-bb7d-7be435d7c08f tempest-TestInstancesWithCinderVolumes-816660254 None] Flow 'volume_create_manager' (6f42ac87-065d-4649-bc14-8fab2c93ad9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:31:33 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-08a2530f-1914-4272-bb7d-7be435d7c08f tempest-TestInstancesWithCinderVolumes-816660254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6234829f-41bb-41ab-b18d-db145e5e0511) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:31:33 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-08a2530f-1914-4272-bb7d-7be435d7c08f tempest-TestInstancesWithCinderVolumes-816660254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6234829f-41bb-41ab-b18d-db145e5e0511) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:31:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-405757941',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=330e8f60-b546-42e1-b2b8-7296ced87a6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78257196e3dd42fc8b9f17f5008f135f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:31:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:31:33Z,use_quota=True,user_id='6ddd6e7d294f40458afa9cce668be12d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0bfbce01-7042-4038-b4fa-50cd55c7fbf2),volume_type_id=0bfbce01-7042-4038-b4fa-50cd55c7fbf2)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:31:33 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-08a2530f-1914-4272-bb7d-7be435d7c08f tempest-TestInstancesWithCinderVolumes-816660254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6253d79f-ae54-4d87-96db-2a9378ee91fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:31:33 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-08a2530f-1914-4272-bb7d-7be435d7c08f tempest-TestInstancesWithCinderVolumes-816660254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6253d79f-ae54-4d87-96db-2a9378ee91fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:31:33 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-08a2530f-1914-4272-bb7d-7be435d7c08f tempest-TestInstancesWithCinderVolumes-816660254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9739073-7111-4122-ad56-ff3b3da005ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:31:33 devstack cinder-volume[93468]: DEBUG cinder.image.glance [None req-08a2530f-1914-4272-bb7d-7be435d7c08f tempest-TestInstancesWithCinderVolumes-816660254 None] Creating Keystone auth plugin from conf {{(pid=93468) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 29 03:31:33 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-64a54140-ca26-4e15-9275-b5e50ac2d43e tempest-TestInstancesWithCinderVolumes-816660254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-47a2a0b2-eddf-4fbb-a753-0e856fc86fe8 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:31:33 devstack sudo[105070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-47a2a0b2-eddf-4fbb-a753-0e856fc86fe8 Jun 29 03:31:33 devstack sudo[105070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:31:33 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-08a2530f-1914-4272-bb7d-7be435d7c08f tempest-TestInstancesWithCinderVolumes-816660254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9739073-7111-4122-ad56-ff3b3da005ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '330e8f60-b546-42e1-b2b8-7296ced87a6d', 'volume_name': 'volume-330e8f60-b546-42e1-b2b8-7296ced87a6d', 'volume_size': 1, 'image_id': 'c11e85d7-c260-455f-9d23-7850da7aaf17', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c11e85d7-c260-455f-9d23-7850da7aaf17', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--2093908642', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '78257196e3dd42fc8b9f17f5008f135f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c11e85d7-c260-455f-9d23-7850da7aaf17', 'created_at': datetime.datetime(2026, 6, 29, 1, 31, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 29, 1, 31, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c11e85d7-c260-455f-9d23-7850da7aaf17/file', 'properties': {}}, 'image_service': }' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:31:33 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-08a2530f-1914-4272-bb7d-7be435d7c08f tempest-TestInstancesWithCinderVolumes-816660254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f18bc1b-bf6c-411b-b3ea-180b222230ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:31:33 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-08a2530f-1914-4272-bb7d-7be435d7c08f tempest-TestInstancesWithCinderVolumes-816660254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f18bc1b-bf6c-411b-b3ea-180b222230ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:31:33 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-08a2530f-1914-4272-bb7d-7be435d7c08f tempest-TestInstancesWithCinderVolumes-816660254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (034e8e9f-2519-4b5c-86bc-6ee3bca2503f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:31:33 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-08a2530f-1914-4272-bb7d-7be435d7c08f tempest-TestInstancesWithCinderVolumes-816660254 None] Volume 330e8f60-b546-42e1-b2b8-7296ced87a6d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-330e8f60-b546-42e1-b2b8-7296ced87a6d', 'volume_size': 1, 'image_id': 'c11e85d7-c260-455f-9d23-7850da7aaf17', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c11e85d7-c260-455f-9d23-7850da7aaf17', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--2093908642', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '78257196e3dd42fc8b9f17f5008f135f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c11e85d7-c260-455f-9d23-7850da7aaf17', 'created_at': datetime.datetime(2026, 6, 29, 1, 31, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 29, 1, 31, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c11e85d7-c260-455f-9d23-7850da7aaf17/file', 'properties': {}}, 'image_service': } Jun 29 03:31:33 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-08a2530f-1914-4272-bb7d-7be435d7c08f tempest-TestInstancesWithCinderVolumes-816660254 None] Trying to clone 330e8f60-b546-42e1-b2b8-7296ced87a6d from image c11e85d7-c260-455f-9d23-7850da7aaf17 at location (None, [{'url': 'file:///opt/stack/data/glance/images/c11e85d7-c260-455f-9d23-7850da7aaf17', 'metadata': {}}]). {{(pid=93468) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 29 03:31:33 devstack sudo[105068]: pam_unix(sudo:session): session closed for user root Jun 29 03:31:33 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-7bbc1bfa-30c3-4b82-b3a0-c6679e68e6f0 tempest-VolumesSnapshotListTestJSON-285436761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-3aff4088-7d2a-47cc-8fe7-abde995d4e54.a57559b2-0752-40fe-bde0-67dedfe616d3" returned: 0 in 0.819s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:31:33 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-7bbc1bfa-30c3-4b82-b3a0-c6679e68e6f0 tempest-VolumesSnapshotListTestJSON-285436761 None] Lock "cinder-quobyte-a57559b2-0752-40fe-bde0-67dedfe616d3" released by "_delete_snapshot" :: held 4.121s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:31:33 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-7bbc1bfa-30c3-4b82-b3a0-c6679e68e6f0 tempest-VolumesSnapshotListTestJSON-285436761 None] Lock "cinder-quobyte-3aff4088-7d2a-47cc-8fe7-abde995d4e54" released by "delete_snapshot" :: held 4.154s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:31:34 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-7bbc1bfa-30c3-4b82-b3a0-c6679e68e6f0 tempest-VolumesSnapshotListTestJSON-285436761 None] Created reservations ['b9ac7b46-69a3-4ff8-a225-cb34ef64dec4', 'b6d6711e-95ad-425e-8336-bcfd5f2c1962', '13969ecb-eff5-4019-a1ae-07d313d40b5f', 'bdef4347-494f-4af9-8402-f5b806ba5dc2'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:31:34 devstack sudo[105070]: pam_unix(sudo:session): session closed for user root Jun 29 03:31:34 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-64a54140-ca26-4e15-9275-b5e50ac2d43e tempest-TestInstancesWithCinderVolumes-816660254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-47a2a0b2-eddf-4fbb-a753-0e856fc86fe8" returned: 0 in 0.732s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:31:34 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-64a54140-ca26-4e15-9275-b5e50ac2d43e tempest-TestInstancesWithCinderVolumes-816660254 None] <== create_volume: return (1964ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:31:34 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-64a54140-ca26-4e15-9275-b5e50ac2d43e tempest-TestInstancesWithCinderVolumes-816660254 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.966s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:31:34 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-77fc42bf-eec0-4be8-962d-1aeee8a80171 tempest-TestInstancesWithCinderVolumes-816660254 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.537s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:31:34 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-77fc42bf-eec0-4be8-962d-1aeee8a80171 tempest-TestInstancesWithCinderVolumes-816660254 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:31:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-744569615',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f2e765d-fff0-4c4d-b402-3ec90d0d609c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78257196e3dd42fc8b9f17f5008f135f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:31:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:31:32Z,use_quota=True,user_id='6ddd6e7d294f40458afa9cce668be12d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ffb78695-b504-4af2-b914-8f74fd1e4627),volume_type_id=ffb78695-b504-4af2-b914-8f74fd1e4627)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:31:34 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-77fc42bf-eec0-4be8-962d-1aeee8a80171 tempest-TestInstancesWithCinderVolumes-816660254 None] Creating volume 2f2e765d-fff0-4c4d-b402-3ec90d0d609c {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:31:34 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-77fc42bf-eec0-4be8-962d-1aeee8a80171 tempest-TestInstancesWithCinderVolumes-816660254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:31:34 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-77fc42bf-eec0-4be8-962d-1aeee8a80171 tempest-TestInstancesWithCinderVolumes-816660254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:31:34 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-77fc42bf-eec0-4be8-962d-1aeee8a80171 tempest-TestInstancesWithCinderVolumes-816660254 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:31:34 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-77fc42bf-eec0-4be8-962d-1aeee8a80171 tempest-TestInstancesWithCinderVolumes-816660254 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:31:34 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-77fc42bf-eec0-4be8-962d-1aeee8a80171 tempest-TestInstancesWithCinderVolumes-816660254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:31:34 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-77fc42bf-eec0-4be8-962d-1aeee8a80171 tempest-TestInstancesWithCinderVolumes-816660254 None] Selected osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:31:34 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-77fc42bf-eec0-4be8-962d-1aeee8a80171 tempest-TestInstancesWithCinderVolumes-816660254 None] casted to osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f Jun 29 03:31:34 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-77fc42bf-eec0-4be8-962d-1aeee8a80171 tempest-TestInstancesWithCinderVolumes-816660254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-2f2e765d-fff0-4c4d-b402-3ec90d0d609c 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:31:34 devstack sudo[105074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-2f2e765d-fff0-4c4d-b402-3ec90d0d609c 1073741824 Jun 29 03:31:34 devstack sudo[105074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:31:34 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-64a54140-ca26-4e15-9275-b5e50ac2d43e tempest-TestInstancesWithCinderVolumes-816660254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb604964-5bc9-4066-aad5-80c0aa5c4b9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47a2a0b2-eddf-4fbb-a753-0e856fc86fe8', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:31:34 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-64a54140-ca26-4e15-9275-b5e50ac2d43e tempest-TestInstancesWithCinderVolumes-816660254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97c90f60-d3f5-4dbc-a99d-ec68fedfd3c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:31:34 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-7bbc1bfa-30c3-4b82-b3a0-c6679e68e6f0 tempest-VolumesSnapshotListTestJSON-285436761 None] Delete snapshot completed successfully. Jun 29 03:31:34 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-64a54140-ca26-4e15-9275-b5e50ac2d43e tempest-TestInstancesWithCinderVolumes-816660254 None] Volume volume-47a2a0b2-eddf-4fbb-a753-0e856fc86fe8 (47a2a0b2-eddf-4fbb-a753-0e856fc86fe8): created successfully Jun 29 03:31:34 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-64a54140-ca26-4e15-9275-b5e50ac2d43e tempest-TestInstancesWithCinderVolumes-816660254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97c90f60-d3f5-4dbc-a99d-ec68fedfd3c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:31:34 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-64a54140-ca26-4e15-9275-b5e50ac2d43e tempest-TestInstancesWithCinderVolumes-816660254 None] Flow 'volume_create_manager' (b6532fbe-7032-4cbe-9959-374f6acead61) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:31:34 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-7bbc1bfa-30c3-4b82-b3a0-c6679e68e6f0 tempest-VolumesSnapshotListTestJSON-285436761 None] Lock "cinder-a57559b2-0752-40fe-bde0-67dedfe616d3-delete_snapshot" released by "delete_snapshot" :: held 4.406s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:31:34 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-64a54140-ca26-4e15-9275-b5e50ac2d43e tempest-TestInstancesWithCinderVolumes-816660254 None] Created volume successfully. Jun 29 03:31:34 devstack sudo[105074]: pam_unix(sudo:session): session closed for user root Jun 29 03:31:34 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-77fc42bf-eec0-4be8-962d-1aeee8a80171 tempest-TestInstancesWithCinderVolumes-816660254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-2f2e765d-fff0-4c4d-b402-3ec90d0d609c 1073741824" returned: 0 in 0.918s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:31:35 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-77fc42bf-eec0-4be8-962d-1aeee8a80171 tempest-TestInstancesWithCinderVolumes-816660254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-2f2e765d-fff0-4c4d-b402-3ec90d0d609c {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:31:35 devstack sudo[105080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-2f2e765d-fff0-4c4d-b402-3ec90d0d609c Jun 29 03:31:35 devstack sudo[105080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:31:35 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-db93762c-72af-4239-a828-5902a23fd90b tempest-VolumesSnapshotListTestJSON-285436761 None] Acquiring lock "cinder-6a423dbf-857a-443e-8bad-00376486c6d4-delete_snapshot" by "delete_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:31:35 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-db93762c-72af-4239-a828-5902a23fd90b tempest-VolumesSnapshotListTestJSON-285436761 None] Lock "cinder-6a423dbf-857a-443e-8bad-00376486c6d4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:31:35 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-db93762c-72af-4239-a828-5902a23fd90b tempest-VolumesSnapshotListTestJSON-285436761 None] Acquiring lock "cinder-quobyte-3aff4088-7d2a-47cc-8fe7-abde995d4e54" by "delete_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:31:35 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-db93762c-72af-4239-a828-5902a23fd90b tempest-VolumesSnapshotListTestJSON-285436761 None] Lock "cinder-quobyte-3aff4088-7d2a-47cc-8fe7-abde995d4e54" acquired by "delete_snapshot" :: waited 0.019s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:31:35 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-db93762c-72af-4239-a828-5902a23fd90b tempest-VolumesSnapshotListTestJSON-285436761 None] Acquiring lock "cinder-quobyte-6a423dbf-857a-443e-8bad-00376486c6d4" by "_delete_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:31:35 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-db93762c-72af-4239-a828-5902a23fd90b tempest-VolumesSnapshotListTestJSON-285436761 None] Lock "cinder-quobyte-6a423dbf-857a-443e-8bad-00376486c6d4" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:31:35 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-db93762c-72af-4239-a828-5902a23fd90b tempest-VolumesSnapshotListTestJSON-285436761 None] Deleting offline snapshot 6a423dbf-857a-443e-8bad-00376486c6d4 of volume 3aff4088-7d2a-47cc-8fe7-abde995d4e54 {{(pid=93468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 29 03:31:35 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-db93762c-72af-4239-a828-5902a23fd90b tempest-VolumesSnapshotListTestJSON-285436761 None] snapshot_file for this snap is: volume-3aff4088-7d2a-47cc-8fe7-abde995d4e54.6a423dbf-857a-443e-8bad-00376486c6d4 {{(pid=93468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 29 03:31:35 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3d78738-ec08-443b-8cdd-30f69856d707]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:31:35 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-db93762c-72af-4239-a828-5902a23fd90b tempest-VolumesSnapshotListTestJSON-285436761 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-3aff4088-7d2a-47cc-8fe7-abde995d4e54.6a423dbf-857a-443e-8bad-00376486c6d4 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:31:35 devstack sudo[105082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-3aff4088-7d2a-47cc-8fe7-abde995d4e54.6a423dbf-857a-443e-8bad-00376486c6d4 Jun 29 03:31:35 devstack sudo[105082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:31:35 devstack sudo[105080]: pam_unix(sudo:session): session closed for user root Jun 29 03:31:35 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-77fc42bf-eec0-4be8-962d-1aeee8a80171 tempest-TestInstancesWithCinderVolumes-816660254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-2f2e765d-fff0-4c4d-b402-3ec90d0d609c" returned: 0 in 0.697s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:31:35 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-77fc42bf-eec0-4be8-962d-1aeee8a80171 tempest-TestInstancesWithCinderVolumes-816660254 None] <== create_volume: return (1667ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:31:35 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-77fc42bf-eec0-4be8-962d-1aeee8a80171 tempest-TestInstancesWithCinderVolumes-816660254 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.670s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:31:35 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-77fc42bf-eec0-4be8-962d-1aeee8a80171 tempest-TestInstancesWithCinderVolumes-816660254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41f08e08-b99e-40ee-9a3a-f501ad2de4a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f2e765d-fff0-4c4d-b402-3ec90d0d609c', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:31:35 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-77fc42bf-eec0-4be8-962d-1aeee8a80171 tempest-TestInstancesWithCinderVolumes-816660254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62a696b8-112c-49e9-b1ef-479cce1697a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:31:35 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-77fc42bf-eec0-4be8-962d-1aeee8a80171 tempest-TestInstancesWithCinderVolumes-816660254 None] Volume volume-2f2e765d-fff0-4c4d-b402-3ec90d0d609c (2f2e765d-fff0-4c4d-b402-3ec90d0d609c): created successfully Jun 29 03:31:35 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-77fc42bf-eec0-4be8-962d-1aeee8a80171 tempest-TestInstancesWithCinderVolumes-816660254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62a696b8-112c-49e9-b1ef-479cce1697a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:31:35 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-77fc42bf-eec0-4be8-962d-1aeee8a80171 tempest-TestInstancesWithCinderVolumes-816660254 None] Flow 'volume_create_manager' (43c3a3f7-a517-4547-a055-d5e0dd0e14c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:31:35 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-77fc42bf-eec0-4be8-962d-1aeee8a80171 tempest-TestInstancesWithCinderVolumes-816660254 None] Created volume successfully. Jun 29 03:31:36 devstack sudo[105082]: pam_unix(sudo:session): session closed for user root Jun 29 03:31:36 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-db93762c-72af-4239-a828-5902a23fd90b tempest-VolumesSnapshotListTestJSON-285436761 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-3aff4088-7d2a-47cc-8fe7-abde995d4e54.6a423dbf-857a-443e-8bad-00376486c6d4" returned: 0 in 0.848s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:31:36 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-db93762c-72af-4239-a828-5902a23fd90b tempest-VolumesSnapshotListTestJSON-285436761 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3aff4088-7d2a-47cc-8fe7-abde995d4e54(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93468) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 29 03:31:36 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f3b5a04-f08c-49cf-9266-0f2bd7d4c662]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:31:36 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-db93762c-72af-4239-a828-5902a23fd90b tempest-VolumesSnapshotListTestJSON-285436761 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-3aff4088-7d2a-47cc-8fe7-abde995d4e54.a93ac7ff-170c-4476-b3b2-52d5d4ed44f4 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:31:36 devstack sudo[105088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-3aff4088-7d2a-47cc-8fe7-abde995d4e54.a93ac7ff-170c-4476-b3b2-52d5d4ed44f4 Jun 29 03:31:36 devstack sudo[105088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:31:36 devstack sudo[105088]: pam_unix(sudo:session): session closed for user root Jun 29 03:31:36 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-db93762c-72af-4239-a828-5902a23fd90b tempest-VolumesSnapshotListTestJSON-285436761 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-3aff4088-7d2a-47cc-8fe7-abde995d4e54.a93ac7ff-170c-4476-b3b2-52d5d4ed44f4" returned: 0 in 0.853s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:31:36 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-db93762c-72af-4239-a828-5902a23fd90b tempest-VolumesSnapshotListTestJSON-285436761 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3aff4088-7d2a-47cc-8fe7-abde995d4e54(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93468) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 29 03:31:36 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-db93762c-72af-4239-a828-5902a23fd90b tempest-VolumesSnapshotListTestJSON-285436761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-3aff4088-7d2a-47cc-8fe7-abde995d4e54.6a423dbf-857a-443e-8bad-00376486c6d4 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:31:36 devstack sudo[105096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-3aff4088-7d2a-47cc-8fe7-abde995d4e54.6a423dbf-857a-443e-8bad-00376486c6d4 Jun 29 03:31:36 devstack sudo[105096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:31:37 devstack cinder-volume[93468]: DEBUG cinder.image.image_utils [None req-08a2530f-1914-4272-bb7d-7be435d7c08f tempest-TestInstancesWithCinderVolumes-816660254 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c11e85d7-c260-455f-9d23-7850da7aaf17_d3921gamdevstack@QuobyteHD, size 20.69 MB, duration 3.86 sec {{(pid=93468) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 29 03:31:37 devstack cinder-volume[93468]: INFO cinder.image.image_utils [None req-08a2530f-1914-4272-bb7d-7be435d7c08f tempest-TestInstancesWithCinderVolumes-816660254 None] Image download 20.69 MB at 5.37 MB/s Jun 29 03:31:37 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[a755d533-1fc7-4dd9-9968-907f4fc61c11]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:31:37 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-08a2530f-1914-4272-bb7d-7be435d7c08f tempest-TestInstancesWithCinderVolumes-816660254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c11e85d7-c260-455f-9d23-7850da7aaf17_d3921gamdevstack@QuobyteHD {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:31:37 devstack sudo[105098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c11e85d7-c260-455f-9d23-7850da7aaf17_d3921gamdevstack@QuobyteHD Jun 29 03:31:37 devstack sudo[105098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:31:37 devstack sudo[105096]: pam_unix(sudo:session): session closed for user root Jun 29 03:31:37 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-db93762c-72af-4239-a828-5902a23fd90b tempest-VolumesSnapshotListTestJSON-285436761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-3aff4088-7d2a-47cc-8fe7-abde995d4e54.6a423dbf-857a-443e-8bad-00376486c6d4" returned: 0 in 0.773s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:31:37 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-db93762c-72af-4239-a828-5902a23fd90b tempest-VolumesSnapshotListTestJSON-285436761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-3aff4088-7d2a-47cc-8fe7-abde995d4e54.6a423dbf-857a-443e-8bad-00376486c6d4 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:31:37 devstack sudo[105103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-3aff4088-7d2a-47cc-8fe7-abde995d4e54.6a423dbf-857a-443e-8bad-00376486c6d4 Jun 29 03:31:37 devstack sudo[105103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:31:38 devstack sudo[105098]: pam_unix(sudo:session): session closed for user root Jun 29 03:31:38 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-08a2530f-1914-4272-bb7d-7be435d7c08f tempest-TestInstancesWithCinderVolumes-816660254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c11e85d7-c260-455f-9d23-7850da7aaf17_d3921gamdevstack@QuobyteHD" returned: 0 in 0.778s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:31:38 devstack cinder-volume[93468]: DEBUG cinder.image.image_utils [None req-08a2530f-1914-4272-bb7d-7be435d7c08f tempest-TestInstancesWithCinderVolumes-816660254 None] Temporary image c11e85d7-c260-455f-9d23-7850da7aaf17 is fetched for user 6ddd6e7d294f40458afa9cce668be12d. {{(pid=93468) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 29 03:31:38 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecd646ff-c4da-4018-94f0-57919d853396]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:31:38 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-08a2530f-1914-4272-bb7d-7be435d7c08f tempest-TestInstancesWithCinderVolumes-816660254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c11e85d7-c260-455f-9d23-7850da7aaf17_d3921gamdevstack@QuobyteHD {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:31:38 devstack sudo[105108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c11e85d7-c260-455f-9d23-7850da7aaf17_d3921gamdevstack@QuobyteHD Jun 29 03:31:38 devstack sudo[105108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:31:38 devstack sudo[105103]: pam_unix(sudo:session): session closed for user root Jun 29 03:31:38 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-db93762c-72af-4239-a828-5902a23fd90b tempest-VolumesSnapshotListTestJSON-285436761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-3aff4088-7d2a-47cc-8fe7-abde995d4e54.6a423dbf-857a-443e-8bad-00376486c6d4" returned: 0 in 0.723s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:31:38 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-db93762c-72af-4239-a828-5902a23fd90b tempest-VolumesSnapshotListTestJSON-285436761 None] Lock "cinder-quobyte-6a423dbf-857a-443e-8bad-00376486c6d4" released by "_delete_snapshot" :: held 3.324s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:31:38 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-db93762c-72af-4239-a828-5902a23fd90b tempest-VolumesSnapshotListTestJSON-285436761 None] Lock "cinder-quobyte-3aff4088-7d2a-47cc-8fe7-abde995d4e54" released by "delete_snapshot" :: held 3.353s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:31:38 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-db93762c-72af-4239-a828-5902a23fd90b tempest-VolumesSnapshotListTestJSON-285436761 None] Created reservations ['f288fe16-3607-4dd8-b967-5db2eb56f5cf', '11f56a7f-9377-4c53-8346-edaddde7c09e', '0373abb7-40f8-44a9-944f-3f6b4a61109c', '7d3e2d06-7b06-459f-8b4d-83091fc849c0'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:31:38 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-db93762c-72af-4239-a828-5902a23fd90b tempest-VolumesSnapshotListTestJSON-285436761 None] Delete snapshot completed successfully. Jun 29 03:31:38 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-db93762c-72af-4239-a828-5902a23fd90b tempest-VolumesSnapshotListTestJSON-285436761 None] Lock "cinder-6a423dbf-857a-443e-8bad-00376486c6d4-delete_snapshot" released by "delete_snapshot" :: held 3.549s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:31:39 devstack sudo[105108]: pam_unix(sudo:session): session closed for user root Jun 29 03:31:39 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-08a2530f-1914-4272-bb7d-7be435d7c08f tempest-TestInstancesWithCinderVolumes-816660254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c11e85d7-c260-455f-9d23-7850da7aaf17_d3921gamdevstack@QuobyteHD" returned: 0 in 0.784s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:31:39 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-08a2530f-1914-4272-bb7d-7be435d7c08f tempest-TestInstancesWithCinderVolumes-816660254 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:31:39 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-08a2530f-1914-4272-bb7d-7be435d7c08f tempest-TestInstancesWithCinderVolumes-816660254 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:31:39 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-08a2530f-1914-4272-bb7d-7be435d7c08f tempest-TestInstancesWithCinderVolumes-816660254 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:31:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-405757941',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=330e8f60-b546-42e1-b2b8-7296ced87a6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78257196e3dd42fc8b9f17f5008f135f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:31:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:31:33Z,use_quota=True,user_id='6ddd6e7d294f40458afa9cce668be12d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0bfbce01-7042-4038-b4fa-50cd55c7fbf2),volume_type_id=0bfbce01-7042-4038-b4fa-50cd55c7fbf2)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:31:39 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-08a2530f-1914-4272-bb7d-7be435d7c08f tempest-TestInstancesWithCinderVolumes-816660254 None] Creating volume 330e8f60-b546-42e1-b2b8-7296ced87a6d {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:31:39 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-08a2530f-1914-4272-bb7d-7be435d7c08f tempest-TestInstancesWithCinderVolumes-816660254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:31:39 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-08a2530f-1914-4272-bb7d-7be435d7c08f tempest-TestInstancesWithCinderVolumes-816660254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:31:39 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-08a2530f-1914-4272-bb7d-7be435d7c08f tempest-TestInstancesWithCinderVolumes-816660254 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:31:39 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-08a2530f-1914-4272-bb7d-7be435d7c08f tempest-TestInstancesWithCinderVolumes-816660254 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:31:39 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-08a2530f-1914-4272-bb7d-7be435d7c08f tempest-TestInstancesWithCinderVolumes-816660254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:31:39 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-08a2530f-1914-4272-bb7d-7be435d7c08f tempest-TestInstancesWithCinderVolumes-816660254 None] Selected osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:31:39 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-08a2530f-1914-4272-bb7d-7be435d7c08f tempest-TestInstancesWithCinderVolumes-816660254 None] casted to osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f Jun 29 03:31:39 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-08a2530f-1914-4272-bb7d-7be435d7c08f tempest-TestInstancesWithCinderVolumes-816660254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-330e8f60-b546-42e1-b2b8-7296ced87a6d 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:31:39 devstack sudo[105115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-330e8f60-b546-42e1-b2b8-7296ced87a6d 1073741824 Jun 29 03:31:39 devstack sudo[105115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:31:39 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-00d3dc90-8026-4227-a220-1270b1aad376 tempest-VolumesSnapshotListTestJSON-285436761 None] Acquiring lock "cinder-a93ac7ff-170c-4476-b3b2-52d5d4ed44f4-delete_snapshot" by "delete_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:31:39 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-00d3dc90-8026-4227-a220-1270b1aad376 tempest-VolumesSnapshotListTestJSON-285436761 None] Lock "cinder-a93ac7ff-170c-4476-b3b2-52d5d4ed44f4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:31:39 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-00d3dc90-8026-4227-a220-1270b1aad376 tempest-VolumesSnapshotListTestJSON-285436761 None] Acquiring lock "cinder-quobyte-3aff4088-7d2a-47cc-8fe7-abde995d4e54" by "delete_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:31:39 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-00d3dc90-8026-4227-a220-1270b1aad376 tempest-VolumesSnapshotListTestJSON-285436761 None] Lock "cinder-quobyte-3aff4088-7d2a-47cc-8fe7-abde995d4e54" acquired by "delete_snapshot" :: waited 0.018s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:31:39 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-00d3dc90-8026-4227-a220-1270b1aad376 tempest-VolumesSnapshotListTestJSON-285436761 None] Acquiring lock "cinder-quobyte-a93ac7ff-170c-4476-b3b2-52d5d4ed44f4" by "_delete_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:31:39 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-00d3dc90-8026-4227-a220-1270b1aad376 tempest-VolumesSnapshotListTestJSON-285436761 None] Lock "cinder-quobyte-a93ac7ff-170c-4476-b3b2-52d5d4ed44f4" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:31:39 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-00d3dc90-8026-4227-a220-1270b1aad376 tempest-VolumesSnapshotListTestJSON-285436761 None] Deleting offline snapshot a93ac7ff-170c-4476-b3b2-52d5d4ed44f4 of volume 3aff4088-7d2a-47cc-8fe7-abde995d4e54 {{(pid=93468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 29 03:31:39 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-00d3dc90-8026-4227-a220-1270b1aad376 tempest-VolumesSnapshotListTestJSON-285436761 None] snapshot_file for this snap is: volume-3aff4088-7d2a-47cc-8fe7-abde995d4e54.a93ac7ff-170c-4476-b3b2-52d5d4ed44f4 {{(pid=93468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 29 03:31:39 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[122afea3-efb0-4b5c-87d3-ac98d07f6aeb]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:31:39 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-00d3dc90-8026-4227-a220-1270b1aad376 tempest-VolumesSnapshotListTestJSON-285436761 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-3aff4088-7d2a-47cc-8fe7-abde995d4e54.a93ac7ff-170c-4476-b3b2-52d5d4ed44f4 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:31:39 devstack sudo[105117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-3aff4088-7d2a-47cc-8fe7-abde995d4e54.a93ac7ff-170c-4476-b3b2-52d5d4ed44f4 Jun 29 03:31:39 devstack sudo[105117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:31:39 devstack sudo[105115]: pam_unix(sudo:session): session closed for user root Jun 29 03:31:40 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-08a2530f-1914-4272-bb7d-7be435d7c08f tempest-TestInstancesWithCinderVolumes-816660254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-330e8f60-b546-42e1-b2b8-7296ced87a6d 1073741824" returned: 0 in 0.895s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:31:40 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-08a2530f-1914-4272-bb7d-7be435d7c08f tempest-TestInstancesWithCinderVolumes-816660254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-330e8f60-b546-42e1-b2b8-7296ced87a6d {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:31:40 devstack sudo[105122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-330e8f60-b546-42e1-b2b8-7296ced87a6d Jun 29 03:31:40 devstack sudo[105122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:31:40 devstack sudo[105117]: pam_unix(sudo:session): session closed for user root Jun 29 03:31:40 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-00d3dc90-8026-4227-a220-1270b1aad376 tempest-VolumesSnapshotListTestJSON-285436761 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-3aff4088-7d2a-47cc-8fe7-abde995d4e54.a93ac7ff-170c-4476-b3b2-52d5d4ed44f4" returned: 0 in 0.926s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:31:40 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-00d3dc90-8026-4227-a220-1270b1aad376 tempest-VolumesSnapshotListTestJSON-285436761 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3aff4088-7d2a-47cc-8fe7-abde995d4e54(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93468) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 29 03:31:40 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[658ebd43-7093-4168-9519-f10411700dcb]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:31:40 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-00d3dc90-8026-4227-a220-1270b1aad376 tempest-VolumesSnapshotListTestJSON-285436761 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-3aff4088-7d2a-47cc-8fe7-abde995d4e54 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:31:40 devstack sudo[105139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-3aff4088-7d2a-47cc-8fe7-abde995d4e54 Jun 29 03:31:40 devstack sudo[105139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:31:40 devstack sudo[105122]: pam_unix(sudo:session): session closed for user root Jun 29 03:31:40 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-08a2530f-1914-4272-bb7d-7be435d7c08f tempest-TestInstancesWithCinderVolumes-816660254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-330e8f60-b546-42e1-b2b8-7296ced87a6d" returned: 0 in 0.846s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:31:40 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-08a2530f-1914-4272-bb7d-7be435d7c08f tempest-TestInstancesWithCinderVolumes-816660254 None] <== create_volume: return (1799ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:31:40 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-08a2530f-1914-4272-bb7d-7be435d7c08f tempest-TestInstancesWithCinderVolumes-816660254 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.803s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:31:40 devstack cinder-volume[93468]: DEBUG cinder.volume.volume_utils [None req-08a2530f-1914-4272-bb7d-7be435d7c08f tempest-TestInstancesWithCinderVolumes-816660254 None] Attempting download of c11e85d7-c260-455f-9d23-7850da7aaf17 ((None, [{'url': 'file:///opt/stack/data/glance/images/c11e85d7-c260-455f-9d23-7850da7aaf17', 'metadata': {}}])) to volume 330e8f60-b546-42e1-b2b8-7296ced87a6d. {{(pid=93468) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 29 03:31:40 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[53146195-3b1b-4842-846a-1e6f1eba3932]: (4, 'raw') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:31:40 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-08a2530f-1914-4272-bb7d-7be435d7c08f tempest-TestInstancesWithCinderVolumes-816660254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c11e85d7-c260-455f-9d23-7850da7aaf17_tdrxecgp {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:31:41 devstack sudo[105166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c11e85d7-c260-455f-9d23-7850da7aaf17_tdrxecgp Jun 29 03:31:41 devstack sudo[105166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:31:41 devstack sudo[105139]: pam_unix(sudo:session): session closed for user root Jun 29 03:31:41 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-00d3dc90-8026-4227-a220-1270b1aad376 tempest-VolumesSnapshotListTestJSON-285436761 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-3aff4088-7d2a-47cc-8fe7-abde995d4e54" returned: 0 in 0.830s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:31:41 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-00d3dc90-8026-4227-a220-1270b1aad376 tempest-VolumesSnapshotListTestJSON-285436761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-3aff4088-7d2a-47cc-8fe7-abde995d4e54.a93ac7ff-170c-4476-b3b2-52d5d4ed44f4 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:31:41 devstack sudo[105172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-3aff4088-7d2a-47cc-8fe7-abde995d4e54.a93ac7ff-170c-4476-b3b2-52d5d4ed44f4 Jun 29 03:31:41 devstack sudo[105172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:31:41 devstack sudo[105166]: pam_unix(sudo:session): session closed for user root Jun 29 03:31:41 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-08a2530f-1914-4272-bb7d-7be435d7c08f tempest-TestInstancesWithCinderVolumes-816660254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c11e85d7-c260-455f-9d23-7850da7aaf17_tdrxecgp" returned: 0 in 0.737s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:31:41 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-08a2530f-1914-4272-bb7d-7be435d7c08f tempest-TestInstancesWithCinderVolumes-816660254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c11e85d7-c260-455f-9d23-7850da7aaf17_tdrxecgp {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:31:41 devstack sudo[105176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c11e85d7-c260-455f-9d23-7850da7aaf17_tdrxecgp Jun 29 03:31:41 devstack sudo[105176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:31:42 devstack sudo[105172]: pam_unix(sudo:session): session closed for user root Jun 29 03:31:42 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-00d3dc90-8026-4227-a220-1270b1aad376 tempest-VolumesSnapshotListTestJSON-285436761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-3aff4088-7d2a-47cc-8fe7-abde995d4e54.a93ac7ff-170c-4476-b3b2-52d5d4ed44f4" returned: 0 in 0.809s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:31:42 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-00d3dc90-8026-4227-a220-1270b1aad376 tempest-VolumesSnapshotListTestJSON-285436761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-3aff4088-7d2a-47cc-8fe7-abde995d4e54.a93ac7ff-170c-4476-b3b2-52d5d4ed44f4 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:31:42 devstack sudo[105181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-3aff4088-7d2a-47cc-8fe7-abde995d4e54.a93ac7ff-170c-4476-b3b2-52d5d4ed44f4 Jun 29 03:31:42 devstack sudo[105181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:31:42 devstack sudo[105176]: pam_unix(sudo:session): session closed for user root Jun 29 03:31:42 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-08a2530f-1914-4272-bb7d-7be435d7c08f tempest-TestInstancesWithCinderVolumes-816660254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c11e85d7-c260-455f-9d23-7850da7aaf17_tdrxecgp" returned: 1 in 0.793s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:31:42 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-08a2530f-1914-4272-bb7d-7be435d7c08f tempest-TestInstancesWithCinderVolumes-816660254 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c11e85d7-c260-455f-9d23-7850da7aaf17_tdrxecgp' failed. Not Retrying. {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 29 03:31:42 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dbea2b5-12c1-4398-b886-beb7d3498c45]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:31:42 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-08a2530f-1914-4272-bb7d-7be435d7c08f tempest-TestInstancesWithCinderVolumes-816660254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c11e85d7-c260-455f-9d23-7850da7aaf17_d3921gamdevstack@QuobyteHD {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:31:42 devstack sudo[105185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c11e85d7-c260-455f-9d23-7850da7aaf17_d3921gamdevstack@QuobyteHD Jun 29 03:31:42 devstack sudo[105185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:31:42 devstack sudo[105181]: pam_unix(sudo:session): session closed for user root Jun 29 03:31:42 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-00d3dc90-8026-4227-a220-1270b1aad376 tempest-VolumesSnapshotListTestJSON-285436761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-3aff4088-7d2a-47cc-8fe7-abde995d4e54.a93ac7ff-170c-4476-b3b2-52d5d4ed44f4" returned: 0 in 0.833s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:31:42 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-00d3dc90-8026-4227-a220-1270b1aad376 tempest-VolumesSnapshotListTestJSON-285436761 None] Lock "cinder-quobyte-a93ac7ff-170c-4476-b3b2-52d5d4ed44f4" released by "_delete_snapshot" :: held 3.541s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:31:42 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-00d3dc90-8026-4227-a220-1270b1aad376 tempest-VolumesSnapshotListTestJSON-285436761 None] Lock "cinder-quobyte-3aff4088-7d2a-47cc-8fe7-abde995d4e54" released by "delete_snapshot" :: held 3.572s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:31:43 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-00d3dc90-8026-4227-a220-1270b1aad376 tempest-VolumesSnapshotListTestJSON-285436761 None] Created reservations ['228a0ff2-186f-414b-8d61-b3474fb5b889', 'aad79f69-e679-43d3-9bba-80ddcd126570', '0ed8c5d1-9860-4528-ba01-9ab85806b666', 'dd09c715-bccc-4d33-9adf-8292b2fc4508'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:31:43 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-00d3dc90-8026-4227-a220-1270b1aad376 tempest-VolumesSnapshotListTestJSON-285436761 None] Delete snapshot completed successfully. Jun 29 03:31:43 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-00d3dc90-8026-4227-a220-1270b1aad376 tempest-VolumesSnapshotListTestJSON-285436761 None] Lock "cinder-a93ac7ff-170c-4476-b3b2-52d5d4ed44f4-delete_snapshot" released by "delete_snapshot" :: held 3.721s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:31:43 devstack sudo[105185]: pam_unix(sudo:session): session closed for user root Jun 29 03:31:43 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-08a2530f-1914-4272-bb7d-7be435d7c08f tempest-TestInstancesWithCinderVolumes-816660254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c11e85d7-c260-455f-9d23-7850da7aaf17_d3921gamdevstack@QuobyteHD" returned: 0 in 0.868s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:31:43 devstack cinder-volume[93468]: DEBUG cinder.image.image_utils [None req-08a2530f-1914-4272-bb7d-7be435d7c08f tempest-TestInstancesWithCinderVolumes-816660254 None] c11e85d7-c260-455f-9d23-7850da7aaf17 was qcow2, converting to raw {{(pid=93468) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 29 03:31:43 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-08a2530f-1914-4272-bb7d-7be435d7c08f tempest-TestInstancesWithCinderVolumes-816660254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c11e85d7-c260-455f-9d23-7850da7aaf17_d3921gamdevstack@QuobyteHD /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-330e8f60-b546-42e1-b2b8-7296ced87a6d {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:31:43 devstack sudo[105192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c11e85d7-c260-455f-9d23-7850da7aaf17_d3921gamdevstack@QuobyteHD /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-330e8f60-b546-42e1-b2b8-7296ced87a6d Jun 29 03:31:43 devstack sudo[105192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:31:43 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-aba8a18e-9273-4d32-978e-51ffc4318be6 tempest-VolumesSnapshotListTestJSON-285436761 None] Acquiring lock "cinder-3aff4088-7d2a-47cc-8fe7-abde995d4e54-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:31:43 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-aba8a18e-9273-4d32-978e-51ffc4318be6 tempest-VolumesSnapshotListTestJSON-285436761 None] Lock "cinder-3aff4088-7d2a-47cc-8fe7-abde995d4e54-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:31:43 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-aba8a18e-9273-4d32-978e-51ffc4318be6 tempest-VolumesSnapshotListTestJSON-285436761 None] Acquiring lock "cinder-quobyte-3aff4088-7d2a-47cc-8fe7-abde995d4e54" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:31:43 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-aba8a18e-9273-4d32-978e-51ffc4318be6 tempest-VolumesSnapshotListTestJSON-285436761 None] Lock "cinder-quobyte-3aff4088-7d2a-47cc-8fe7-abde995d4e54" acquired by "delete_volume" :: waited 0.039s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:31:43 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aa5fded-c2ed-48a6-bdbc-16680153200e]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:31:43 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-aba8a18e-9273-4d32-978e-51ffc4318be6 tempest-VolumesSnapshotListTestJSON-285436761 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-3aff4088-7d2a-47cc-8fe7-abde995d4e54 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:31:44 devstack sudo[105196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-3aff4088-7d2a-47cc-8fe7-abde995d4e54 Jun 29 03:31:44 devstack sudo[105196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:31:44 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-c02035a1-6f7b-4857-8799-a042920e51ab tempest-AttachVolumeTestJSON-872616700 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:31:44 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-c02035a1-6f7b-4857-8799-a042920e51ab tempest-AttachVolumeTestJSON-872616700 None] Flow 'volume_create_manager' (081e4555-f12a-4e1e-90f6-c1ebf98cbf38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:31:44 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-c02035a1-6f7b-4857-8799-a042920e51ab tempest-AttachVolumeTestJSON-872616700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7219afa2-ff10-4199-9c40-2fe29bb63732) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:31:44 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-c02035a1-6f7b-4857-8799-a042920e51ab tempest-AttachVolumeTestJSON-872616700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7219afa2-ff10-4199-9c40-2fe29bb63732) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:31:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-721379226',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33717436-5fe0-4ada-a731-379bb543792c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6bf1b94df6c4485d87b2b2758c1476cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:31:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:31:45Z,use_quota=True,user_id='6fcdf128706544418b67f38090f52540',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:31:44 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-c02035a1-6f7b-4857-8799-a042920e51ab tempest-AttachVolumeTestJSON-872616700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5b42393-4c2b-4dc2-978e-917782b94bd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:31:44 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-c02035a1-6f7b-4857-8799-a042920e51ab tempest-AttachVolumeTestJSON-872616700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5b42393-4c2b-4dc2-978e-917782b94bd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:31:44 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-c02035a1-6f7b-4857-8799-a042920e51ab tempest-AttachVolumeTestJSON-872616700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0685838c-7b6e-4734-9763-e52c29e1fa5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:31:44 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-c02035a1-6f7b-4857-8799-a042920e51ab tempest-AttachVolumeTestJSON-872616700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0685838c-7b6e-4734-9763-e52c29e1fa5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '33717436-5fe0-4ada-a731-379bb543792c', 'volume_name': 'volume-33717436-5fe0-4ada-a731-379bb543792c', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:31:44 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-c02035a1-6f7b-4857-8799-a042920e51ab tempest-AttachVolumeTestJSON-872616700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (438ce64f-b064-4504-bb99-811a77608e19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:31:44 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-c02035a1-6f7b-4857-8799-a042920e51ab tempest-AttachVolumeTestJSON-872616700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (438ce64f-b064-4504-bb99-811a77608e19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:31:44 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-c02035a1-6f7b-4857-8799-a042920e51ab tempest-AttachVolumeTestJSON-872616700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (339ed39b-ef16-4beb-9cb4-9faba6c3a064) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:31:44 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-c02035a1-6f7b-4857-8799-a042920e51ab tempest-AttachVolumeTestJSON-872616700 None] Volume 33717436-5fe0-4ada-a731-379bb543792c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-33717436-5fe0-4ada-a731-379bb543792c', 'volume_size': 1} Jun 29 03:31:44 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-c02035a1-6f7b-4857-8799-a042920e51ab tempest-AttachVolumeTestJSON-872616700 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:31:44 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-c02035a1-6f7b-4857-8799-a042920e51ab tempest-AttachVolumeTestJSON-872616700 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:31:44 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-c02035a1-6f7b-4857-8799-a042920e51ab tempest-AttachVolumeTestJSON-872616700 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:31:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-721379226',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33717436-5fe0-4ada-a731-379bb543792c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6bf1b94df6c4485d87b2b2758c1476cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:31:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:31:45Z,use_quota=True,user_id='6fcdf128706544418b67f38090f52540',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:31:44 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-c02035a1-6f7b-4857-8799-a042920e51ab tempest-AttachVolumeTestJSON-872616700 None] Creating volume 33717436-5fe0-4ada-a731-379bb543792c {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:31:44 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-c02035a1-6f7b-4857-8799-a042920e51ab tempest-AttachVolumeTestJSON-872616700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:31:44 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-c02035a1-6f7b-4857-8799-a042920e51ab tempest-AttachVolumeTestJSON-872616700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:31:44 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-c02035a1-6f7b-4857-8799-a042920e51ab tempest-AttachVolumeTestJSON-872616700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:31:45 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-c02035a1-6f7b-4857-8799-a042920e51ab tempest-AttachVolumeTestJSON-872616700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:31:45 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-c02035a1-6f7b-4857-8799-a042920e51ab tempest-AttachVolumeTestJSON-872616700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:31:45 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-c02035a1-6f7b-4857-8799-a042920e51ab tempest-AttachVolumeTestJSON-872616700 None] Selected osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:31:45 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-c02035a1-6f7b-4857-8799-a042920e51ab tempest-AttachVolumeTestJSON-872616700 None] casted to osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f Jun 29 03:31:45 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c02035a1-6f7b-4857-8799-a042920e51ab tempest-AttachVolumeTestJSON-872616700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-33717436-5fe0-4ada-a731-379bb543792c 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:31:45 devstack sudo[105224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-33717436-5fe0-4ada-a731-379bb543792c 1073741824 Jun 29 03:31:45 devstack sudo[105224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:31:45 devstack sudo[105196]: pam_unix(sudo:session): session closed for user root Jun 29 03:31:45 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-aba8a18e-9273-4d32-978e-51ffc4318be6 tempest-VolumesSnapshotListTestJSON-285436761 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-3aff4088-7d2a-47cc-8fe7-abde995d4e54" returned: 0 in 1.452s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:31:45 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-aba8a18e-9273-4d32-978e-51ffc4318be6 tempest-VolumesSnapshotListTestJSON-285436761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-3aff4088-7d2a-47cc-8fe7-abde995d4e54 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:31:45 devstack sudo[105229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-3aff4088-7d2a-47cc-8fe7-abde995d4e54 Jun 29 03:31:45 devstack sudo[105229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:31:45 devstack sudo[105192]: pam_unix(sudo:session): session closed for user root Jun 29 03:31:45 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-08a2530f-1914-4272-bb7d-7be435d7c08f tempest-TestInstancesWithCinderVolumes-816660254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c11e85d7-c260-455f-9d23-7850da7aaf17_d3921gamdevstack@QuobyteHD /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-330e8f60-b546-42e1-b2b8-7296ced87a6d" returned: 0 in 2.475s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:31:45 devstack cinder-volume[93468]: DEBUG cinder.image.image_utils [None req-08a2530f-1914-4272-bb7d-7be435d7c08f tempest-TestInstancesWithCinderVolumes-816660254 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c11e85d7-c260-455f-9d23-7850da7aaf17_d3921gamdevstack@QuobyteHD, size 112.00 MB, duration 2.48 sec, destination /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-330e8f60-b546-42e1-b2b8-7296ced87a6d {{(pid=93468) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 29 03:31:45 devstack cinder-volume[93468]: INFO cinder.image.image_utils [None req-08a2530f-1914-4272-bb7d-7be435d7c08f tempest-TestInstancesWithCinderVolumes-816660254 None] Converted 112.00 MB image at 45.23 MB/s Jun 29 03:31:45 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-08a2530f-1914-4272-bb7d-7be435d7c08f tempest-TestInstancesWithCinderVolumes-816660254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-330e8f60-b546-42e1-b2b8-7296ced87a6d 1G {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:31:45 devstack sudo[105235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-330e8f60-b546-42e1-b2b8-7296ced87a6d 1G Jun 29 03:31:45 devstack sudo[105235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:31:45 devstack sudo[105224]: pam_unix(sudo:session): session closed for user root Jun 29 03:31:45 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c02035a1-6f7b-4857-8799-a042920e51ab tempest-AttachVolumeTestJSON-872616700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-33717436-5fe0-4ada-a731-379bb543792c 1073741824" returned: 0 in 0.988s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:31:46 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c02035a1-6f7b-4857-8799-a042920e51ab tempest-AttachVolumeTestJSON-872616700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-33717436-5fe0-4ada-a731-379bb543792c {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:31:46 devstack sudo[105238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-33717436-5fe0-4ada-a731-379bb543792c Jun 29 03:31:46 devstack sudo[105238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:31:46 devstack sudo[105229]: pam_unix(sudo:session): session closed for user root Jun 29 03:31:46 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-aba8a18e-9273-4d32-978e-51ffc4318be6 tempest-VolumesSnapshotListTestJSON-285436761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-3aff4088-7d2a-47cc-8fe7-abde995d4e54" returned: 0 in 0.744s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:31:46 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-aba8a18e-9273-4d32-978e-51ffc4318be6 tempest-VolumesSnapshotListTestJSON-285436761 None] Lock "cinder-quobyte-3aff4088-7d2a-47cc-8fe7-abde995d4e54" released by "delete_volume" :: held 2.312s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:31:46 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-aba8a18e-9273-4d32-978e-51ffc4318be6 tempest-VolumesSnapshotListTestJSON-285436761 None] Created reservations ['a3bc286c-b3a4-461c-9565-bbb98a1c4375', '4dac2f76-0bbf-4324-968b-2479d4f74879', 'e21ce550-6a3d-4baa-8f02-caed096646c9', 'a492ee11-3c08-452f-acc2-91a8619421a0'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:31:46 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-aba8a18e-9273-4d32-978e-51ffc4318be6 tempest-VolumesSnapshotListTestJSON-285436761 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:31:46 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-aba8a18e-9273-4d32-978e-51ffc4318be6 tempest-VolumesSnapshotListTestJSON-285436761 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:31:46 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-aba8a18e-9273-4d32-978e-51ffc4318be6 tempest-VolumesSnapshotListTestJSON-285436761 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:31:46 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-aba8a18e-9273-4d32-978e-51ffc4318be6 tempest-VolumesSnapshotListTestJSON-285436761 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:31:46 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-aba8a18e-9273-4d32-978e-51ffc4318be6 tempest-VolumesSnapshotListTestJSON-285436761 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:31:46 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-aba8a18e-9273-4d32-978e-51ffc4318be6 tempest-VolumesSnapshotListTestJSON-285436761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:31:46 devstack sudo[105240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf Jun 29 03:31:46 devstack sudo[105240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:31:46 devstack sudo[105235]: pam_unix(sudo:session): session closed for user root Jun 29 03:31:46 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-08a2530f-1914-4272-bb7d-7be435d7c08f tempest-TestInstancesWithCinderVolumes-816660254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-330e8f60-b546-42e1-b2b8-7296ced87a6d 1G" returned: 0 in 0.773s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:31:46 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[aadf99ec-403c-4c5f-81dc-a1b23942eb5f]: (4, 'raw') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:31:46 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-08a2530f-1914-4272-bb7d-7be435d7c08f tempest-TestInstancesWithCinderVolumes-816660254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-330e8f60-b546-42e1-b2b8-7296ced87a6d {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:31:46 devstack sudo[105238]: pam_unix(sudo:session): session closed for user root Jun 29 03:31:46 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c02035a1-6f7b-4857-8799-a042920e51ab tempest-AttachVolumeTestJSON-872616700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-33717436-5fe0-4ada-a731-379bb543792c" returned: 0 in 0.761s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:31:46 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-c02035a1-6f7b-4857-8799-a042920e51ab tempest-AttachVolumeTestJSON-872616700 None] <== create_volume: return (1807ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:31:46 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-c02035a1-6f7b-4857-8799-a042920e51ab tempest-AttachVolumeTestJSON-872616700 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.813s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:31:46 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-c02035a1-6f7b-4857-8799-a042920e51ab tempest-AttachVolumeTestJSON-872616700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (339ed39b-ef16-4beb-9cb4-9faba6c3a064) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-33717436-5fe0-4ada-a731-379bb543792c', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:31:46 devstack sudo[105246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-330e8f60-b546-42e1-b2b8-7296ced87a6d Jun 29 03:31:46 devstack sudo[105246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:31:46 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-c02035a1-6f7b-4857-8799-a042920e51ab tempest-AttachVolumeTestJSON-872616700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (490be748-039d-41b7-882f-dbd912dd039f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:31:46 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-c02035a1-6f7b-4857-8799-a042920e51ab tempest-AttachVolumeTestJSON-872616700 None] Volume volume-33717436-5fe0-4ada-a731-379bb543792c (33717436-5fe0-4ada-a731-379bb543792c): created successfully Jun 29 03:31:46 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-c02035a1-6f7b-4857-8799-a042920e51ab tempest-AttachVolumeTestJSON-872616700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (490be748-039d-41b7-882f-dbd912dd039f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:31:46 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-c02035a1-6f7b-4857-8799-a042920e51ab tempest-AttachVolumeTestJSON-872616700 None] Flow 'volume_create_manager' (081e4555-f12a-4e1e-90f6-c1ebf98cbf38) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:31:46 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-c02035a1-6f7b-4857-8799-a042920e51ab tempest-AttachVolumeTestJSON-872616700 None] Created volume successfully. Jun 29 03:31:47 devstack sudo[105240]: pam_unix(sudo:session): session closed for user root Jun 29 03:31:47 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-aba8a18e-9273-4d32-978e-51ffc4318be6 tempest-VolumesSnapshotListTestJSON-285436761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf" returned: 0 in 0.805s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:31:47 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-aba8a18e-9273-4d32-978e-51ffc4318be6 tempest-VolumesSnapshotListTestJSON-285436761 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:31:47 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-aba8a18e-9273-4d32-978e-51ffc4318be6 tempest-VolumesSnapshotListTestJSON-285436761 None] Deleted volume successfully. Jun 29 03:31:47 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-aba8a18e-9273-4d32-978e-51ffc4318be6 tempest-VolumesSnapshotListTestJSON-285436761 None] Lock "cinder-3aff4088-7d2a-47cc-8fe7-abde995d4e54-delete_volume" released by "delete_volume" :: held 3.396s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:31:47 devstack sudo[105246]: pam_unix(sudo:session): session closed for user root Jun 29 03:31:47 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-08a2530f-1914-4272-bb7d-7be435d7c08f tempest-TestInstancesWithCinderVolumes-816660254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-330e8f60-b546-42e1-b2b8-7296ced87a6d" returned: 0 in 0.826s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:31:47 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-08a2530f-1914-4272-bb7d-7be435d7c08f tempest-TestInstancesWithCinderVolumes-816660254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-330e8f60-b546-42e1-b2b8-7296ced87a6d {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:31:47 devstack sudo[105251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-330e8f60-b546-42e1-b2b8-7296ced87a6d Jun 29 03:31:47 devstack sudo[105251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:31:48 devstack sudo[105251]: pam_unix(sudo:session): session closed for user root Jun 29 03:31:48 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-08a2530f-1914-4272-bb7d-7be435d7c08f tempest-TestInstancesWithCinderVolumes-816660254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-330e8f60-b546-42e1-b2b8-7296ced87a6d" returned: 1 in 0.939s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:31:48 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-08a2530f-1914-4272-bb7d-7be435d7c08f tempest-TestInstancesWithCinderVolumes-816660254 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-330e8f60-b546-42e1-b2b8-7296ced87a6d' failed. Not Retrying. {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 29 03:31:48 devstack cinder-volume[93468]: DEBUG cinder.volume.volume_utils [None req-08a2530f-1914-4272-bb7d-7be435d7c08f tempest-TestInstancesWithCinderVolumes-816660254 None] Downloaded image c11e85d7-c260-455f-9d23-7850da7aaf17 ((None, [{'url': 'file:///opt/stack/data/glance/images/c11e85d7-c260-455f-9d23-7850da7aaf17', 'metadata': {}}])) to volume 330e8f60-b546-42e1-b2b8-7296ced87a6d successfully. {{(pid=93468) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 29 03:31:48 devstack cinder-volume[93468]: DEBUG cinder.image.image_utils [None req-08a2530f-1914-4272-bb7d-7be435d7c08f tempest-TestInstancesWithCinderVolumes-816660254 None] Temporary image c11e85d7-c260-455f-9d23-7850da7aaf17 for user 6ddd6e7d294f40458afa9cce668be12d is deleted. {{(pid=93468) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 29 03:31:48 devstack cinder-volume[93468]: DEBUG cinder.volume.volume_utils [None req-08a2530f-1914-4272-bb7d-7be435d7c08f tempest-TestInstancesWithCinderVolumes-816660254 None] Marking volume 330e8f60-b546-42e1-b2b8-7296ced87a6d as bootable. {{(pid=93468) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 29 03:31:48 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-08a2530f-1914-4272-bb7d-7be435d7c08f tempest-TestInstancesWithCinderVolumes-816660254 None] Copying metadata from image c11e85d7-c260-455f-9d23-7850da7aaf17 to 330e8f60-b546-42e1-b2b8-7296ced87a6d. {{(pid=93468) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 29 03:31:48 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-08a2530f-1914-4272-bb7d-7be435d7c08f tempest-TestInstancesWithCinderVolumes-816660254 None] Creating volume glance metadata for volume 330e8f60-b546-42e1-b2b8-7296ced87a6d backed by image c11e85d7-c260-455f-9d23-7850da7aaf17 with: {'image_id': 'c11e85d7-c260-455f-9d23-7850da7aaf17', 'image_name': 'tempest-scenario-img--2093908642', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=93468) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 29 03:31:48 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-08a2530f-1914-4272-bb7d-7be435d7c08f tempest-TestInstancesWithCinderVolumes-816660254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (034e8e9f-2519-4b5c-86bc-6ee3bca2503f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-330e8f60-b546-42e1-b2b8-7296ced87a6d', 'volume_size': 1, 'image_id': 'c11e85d7-c260-455f-9d23-7850da7aaf17', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c11e85d7-c260-455f-9d23-7850da7aaf17', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--2093908642', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '78257196e3dd42fc8b9f17f5008f135f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c11e85d7-c260-455f-9d23-7850da7aaf17', 'created_at': datetime.datetime(2026, 6, 29, 1, 31, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 29, 1, 31, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c11e85d7-c260-455f-9d23-7850da7aaf17/file', 'properties': {}}, 'image_service': }' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:31:48 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-08a2530f-1914-4272-bb7d-7be435d7c08f tempest-TestInstancesWithCinderVolumes-816660254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (334897e9-0b65-415d-9631-fbd4565128cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:31:48 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-08a2530f-1914-4272-bb7d-7be435d7c08f tempest-TestInstancesWithCinderVolumes-816660254 None] Volume volume-330e8f60-b546-42e1-b2b8-7296ced87a6d (330e8f60-b546-42e1-b2b8-7296ced87a6d): created successfully Jun 29 03:31:48 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-08a2530f-1914-4272-bb7d-7be435d7c08f tempest-TestInstancesWithCinderVolumes-816660254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (334897e9-0b65-415d-9631-fbd4565128cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:31:48 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-08a2530f-1914-4272-bb7d-7be435d7c08f tempest-TestInstancesWithCinderVolumes-816660254 None] Flow 'volume_create_manager' (6f42ac87-065d-4649-bc14-8fab2c93ad9d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:31:48 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-08a2530f-1914-4272-bb7d-7be435d7c08f tempest-TestInstancesWithCinderVolumes-816660254 None] Created volume successfully. Jun 29 03:31:51 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [req-548d56c3-f6f1-4c75-836f-bcfa4ef07bd9 req-550333c4-4c85-4124-95e1-b5c4c22ab79e tempest-AttachVolumeTestJSON-872616700 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:31:51 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [req-548d56c3-f6f1-4c75-836f-bcfa4ef07bd9 req-550333c4-4c85-4124-95e1-b5c4c22ab79e tempest-AttachVolumeTestJSON-872616700 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:31:51 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fb9eb7e-066b-41a4-bd1c-d526f7d6d8e6]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:31:51 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [req-548d56c3-f6f1-4c75-836f-bcfa4ef07bd9 req-550333c4-4c85-4124-95e1-b5c4c22ab79e tempest-AttachVolumeTestJSON-872616700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-33717436-5fe0-4ada-a731-379bb543792c {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:31:52 devstack sudo[105358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-33717436-5fe0-4ada-a731-379bb543792c Jun 29 03:31:52 devstack sudo[105358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:31:53 devstack sudo[105358]: pam_unix(sudo:session): session closed for user root Jun 29 03:31:53 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [req-548d56c3-f6f1-4c75-836f-bcfa4ef07bd9 req-550333c4-4c85-4124-95e1-b5c4c22ab79e tempest-AttachVolumeTestJSON-872616700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-33717436-5fe0-4ada-a731-379bb543792c" returned: 0 in 1.793s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:31:53 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [req-548d56c3-f6f1-4c75-836f-bcfa4ef07bd9 req-550333c4-4c85-4124-95e1-b5c4c22ab79e tempest-AttachVolumeTestJSON-872616700 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.848s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:31:53 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [req-548d56c3-f6f1-4c75-836f-bcfa4ef07bd9 req-550333c4-4c85-4124-95e1-b5c4c22ab79e tempest-AttachVolumeTestJSON-872616700 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f', 'name': 'volume-33717436-5fe0-4ada-a731-379bb543792c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '132483e8-f28d-486a-8431-36654b7e479e', 'enforce_multipath': True} {{(pid=93468) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 29 03:31:53 devstack cinder-volume[93468]: INFO cinder.volume.manager [req-548d56c3-f6f1-4c75-836f-bcfa4ef07bd9 req-550333c4-4c85-4124-95e1-b5c4c22ab79e tempest-AttachVolumeTestJSON-872616700 None] attachment_update completed successfully. Jun 29 03:31:55 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-a69edf32-1394-4b24-ab45-bf44b92f1da0 tempest-VolumesActionsTest-882954247 None] Acquiring lock "cinder-9ab012d6-eec7-4252-8797-e69a378d83ae" by "attach_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:31:55 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-a69edf32-1394-4b24-ab45-bf44b92f1da0 tempest-VolumesActionsTest-882954247 None] Lock "cinder-9ab012d6-eec7-4252-8797-e69a378d83ae" acquired by "attach_volume" :: waited 0.024s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:31:55 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-a69edf32-1394-4b24-ab45-bf44b92f1da0 tempest-VolumesActionsTest-882954247 None] Attaching volume 9ab012d6-eec7-4252-8797-e69a378d83ae to instance 3db34a68-587a-4cdb-a478-4a38f0c3cc3e at mountpoint /dev/vdb on host None. Jun 29 03:31:55 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-a69edf32-1394-4b24-ab45-bf44b92f1da0 tempest-VolumesActionsTest-882954247 None] Attach volume completed successfully. Jun 29 03:31:55 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-a69edf32-1394-4b24-ab45-bf44b92f1da0 tempest-VolumesActionsTest-882954247 None] Lock "cinder-9ab012d6-eec7-4252-8797-e69a378d83ae" released by "attach_volume" :: held 0.102s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:31:55 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-97b875d3-3904-4fb7-9cc2-c4a41c81a8cd tempest-VolumesActionsTest-882954247 None] Acquiring lock "cinder-9ab012d6-eec7-4252-8797-e69a378d83ae-detach_volume" by "detach_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:31:55 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-97b875d3-3904-4fb7-9cc2-c4a41c81a8cd tempest-VolumesActionsTest-882954247 None] Lock "cinder-9ab012d6-eec7-4252-8797-e69a378d83ae-detach_volume" acquired by "detach_volume" :: waited 0.024s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:31:55 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-97b875d3-3904-4fb7-9cc2-c4a41c81a8cd tempest-VolumesActionsTest-882954247 None] Detaching volume 9ab012d6-eec7-4252-8797-e69a378d83ae from instance 3db34a68-587a-4cdb-a478-4a38f0c3cc3e. Jun 29 03:31:56 devstack cinder-volume[93468]: DEBUG dbcounter [-] [93468] Writing DB stats cinder:UPDATE=66,cinder:DELETE=7,cinder:SELECT=68,cinder:INSERT=19 {{(pid=93468) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 29 03:31:56 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-97b875d3-3904-4fb7-9cc2-c4a41c81a8cd tempest-VolumesActionsTest-882954247 None] Detach volume completed successfully. Jun 29 03:31:56 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-97b875d3-3904-4fb7-9cc2-c4a41c81a8cd tempest-VolumesActionsTest-882954247 None] Lock "cinder-9ab012d6-eec7-4252-8797-e69a378d83ae-detach_volume" released by "detach_volume" :: held 0.100s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:31:58 devstack cinder-volume[93468]: DEBUG dbcounter [-] [93468] Writing DB stats cinder:SELECT=77,cinder:INSERT=24,cinder:UPDATE=68,cinder:DELETE=4 {{(pid=93468) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 29 03:31:58 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [req-d0b8748e-cd01-4445-905a-bd88e44c5c8b req-d89385ed-0d2f-4445-9826-a1e4d2436869 tempest-TestInstancesWithCinderVolumes-816660254 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:31:58 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [req-d0b8748e-cd01-4445-905a-bd88e44c5c8b req-d89385ed-0d2f-4445-9826-a1e4d2436869 tempest-TestInstancesWithCinderVolumes-816660254 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:31:58 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea962b91-88ae-45df-b616-663e444de001]: (4, 'raw') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:31:58 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [req-d0b8748e-cd01-4445-905a-bd88e44c5c8b req-d89385ed-0d2f-4445-9826-a1e4d2436869 tempest-TestInstancesWithCinderVolumes-816660254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-330e8f60-b546-42e1-b2b8-7296ced87a6d {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:31:58 devstack sudo[105801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-330e8f60-b546-42e1-b2b8-7296ced87a6d Jun 29 03:31:58 devstack sudo[105801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:31:59 devstack sudo[105801]: pam_unix(sudo:session): session closed for user root Jun 29 03:31:59 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [req-d0b8748e-cd01-4445-905a-bd88e44c5c8b req-d89385ed-0d2f-4445-9826-a1e4d2436869 tempest-TestInstancesWithCinderVolumes-816660254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-330e8f60-b546-42e1-b2b8-7296ced87a6d" returned: 0 in 0.961s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:31:59 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [req-d0b8748e-cd01-4445-905a-bd88e44c5c8b req-d89385ed-0d2f-4445-9826-a1e4d2436869 tempest-TestInstancesWithCinderVolumes-816660254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-330e8f60-b546-42e1-b2b8-7296ced87a6d {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:31:59 devstack sudo[105806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-330e8f60-b546-42e1-b2b8-7296ced87a6d Jun 29 03:31:59 devstack sudo[105806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:32:00 devstack sudo[105806]: pam_unix(sudo:session): session closed for user root Jun 29 03:32:00 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [req-d0b8748e-cd01-4445-905a-bd88e44c5c8b req-d89385ed-0d2f-4445-9826-a1e4d2436869 tempest-TestInstancesWithCinderVolumes-816660254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-330e8f60-b546-42e1-b2b8-7296ced87a6d" returned: 1 in 0.861s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:32:00 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [req-d0b8748e-cd01-4445-905a-bd88e44c5c8b req-d89385ed-0d2f-4445-9826-a1e4d2436869 tempest-TestInstancesWithCinderVolumes-816660254 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-330e8f60-b546-42e1-b2b8-7296ced87a6d' failed. Not Retrying. {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 29 03:32:00 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [req-d0b8748e-cd01-4445-905a-bd88e44c5c8b req-d89385ed-0d2f-4445-9826-a1e4d2436869 tempest-TestInstancesWithCinderVolumes-816660254 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.873s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:32:00 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [req-d0b8748e-cd01-4445-905a-bd88e44c5c8b req-d89385ed-0d2f-4445-9826-a1e4d2436869 tempest-TestInstancesWithCinderVolumes-816660254 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f', 'name': 'volume-330e8f60-b546-42e1-b2b8-7296ced87a6d', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6ec4d76b-6713-44a9-b00f-3ebf55e3ae6a', 'enforce_multipath': True} {{(pid=93468) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 29 03:32:00 devstack cinder-volume[93468]: INFO cinder.volume.manager [req-d0b8748e-cd01-4445-905a-bd88e44c5c8b req-d89385ed-0d2f-4445-9826-a1e4d2436869 tempest-TestInstancesWithCinderVolumes-816660254 None] attachment_update completed successfully. Jun 29 03:32:02 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-0eee78b2-dbd1-48f9-b681-b1d3cadd7e4f tempest-AttachVolumeTestJSON-872616700 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:32:02 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-0eee78b2-dbd1-48f9-b681-b1d3cadd7e4f tempest-AttachVolumeTestJSON-872616700 None] Flow 'volume_create_manager' (c437caee-4001-4051-a9f0-dd2604441b01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:32:02 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-0eee78b2-dbd1-48f9-b681-b1d3cadd7e4f tempest-AttachVolumeTestJSON-872616700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b225f4a8-d16b-433c-99fc-e751334ad3b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:32:02 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-0eee78b2-dbd1-48f9-b681-b1d3cadd7e4f tempest-AttachVolumeTestJSON-872616700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b225f4a8-d16b-433c-99fc-e751334ad3b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:32:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-816577718',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f930343d-56d1-4c7c-92ce-4a3d26559090,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6bf1b94df6c4485d87b2b2758c1476cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:32:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:32:02Z,use_quota=True,user_id='6fcdf128706544418b67f38090f52540',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:32:02 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-0eee78b2-dbd1-48f9-b681-b1d3cadd7e4f tempest-AttachVolumeTestJSON-872616700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bfc2cdb-abbe-4d8b-a7b3-0bbfea3f1933) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:32:02 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-0eee78b2-dbd1-48f9-b681-b1d3cadd7e4f tempest-AttachVolumeTestJSON-872616700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bfc2cdb-abbe-4d8b-a7b3-0bbfea3f1933) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:32:02 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-0eee78b2-dbd1-48f9-b681-b1d3cadd7e4f tempest-AttachVolumeTestJSON-872616700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9953972d-8ce0-422d-9bb2-cc5befc481fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:32:02 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-0eee78b2-dbd1-48f9-b681-b1d3cadd7e4f tempest-AttachVolumeTestJSON-872616700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9953972d-8ce0-422d-9bb2-cc5befc481fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f930343d-56d1-4c7c-92ce-4a3d26559090', 'volume_name': 'volume-f930343d-56d1-4c7c-92ce-4a3d26559090', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:32:02 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-0eee78b2-dbd1-48f9-b681-b1d3cadd7e4f tempest-AttachVolumeTestJSON-872616700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f99f14b4-f11d-4dd1-9fc7-8cb89cdf707a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:32:02 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-0eee78b2-dbd1-48f9-b681-b1d3cadd7e4f tempest-AttachVolumeTestJSON-872616700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f99f14b4-f11d-4dd1-9fc7-8cb89cdf707a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:32:02 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-0eee78b2-dbd1-48f9-b681-b1d3cadd7e4f tempest-AttachVolumeTestJSON-872616700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb3ea661-ece2-4140-9afb-ccd121364253) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:32:02 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-0eee78b2-dbd1-48f9-b681-b1d3cadd7e4f tempest-AttachVolumeTestJSON-872616700 None] Volume f930343d-56d1-4c7c-92ce-4a3d26559090: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f930343d-56d1-4c7c-92ce-4a3d26559090', 'volume_size': 1} Jun 29 03:32:02 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-0eee78b2-dbd1-48f9-b681-b1d3cadd7e4f tempest-AttachVolumeTestJSON-872616700 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:32:02 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-0eee78b2-dbd1-48f9-b681-b1d3cadd7e4f tempest-AttachVolumeTestJSON-872616700 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:32:02 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-0eee78b2-dbd1-48f9-b681-b1d3cadd7e4f tempest-AttachVolumeTestJSON-872616700 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:32:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-816577718',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f930343d-56d1-4c7c-92ce-4a3d26559090,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6bf1b94df6c4485d87b2b2758c1476cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:32:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:32:02Z,use_quota=True,user_id='6fcdf128706544418b67f38090f52540',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:32:02 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-0eee78b2-dbd1-48f9-b681-b1d3cadd7e4f tempest-AttachVolumeTestJSON-872616700 None] Creating volume f930343d-56d1-4c7c-92ce-4a3d26559090 {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:32:02 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-0eee78b2-dbd1-48f9-b681-b1d3cadd7e4f tempest-AttachVolumeTestJSON-872616700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:32:02 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-0eee78b2-dbd1-48f9-b681-b1d3cadd7e4f tempest-AttachVolumeTestJSON-872616700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:32:02 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-0eee78b2-dbd1-48f9-b681-b1d3cadd7e4f tempest-AttachVolumeTestJSON-872616700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:32:02 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-0eee78b2-dbd1-48f9-b681-b1d3cadd7e4f tempest-AttachVolumeTestJSON-872616700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:32:02 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-0eee78b2-dbd1-48f9-b681-b1d3cadd7e4f tempest-AttachVolumeTestJSON-872616700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:32:02 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-0eee78b2-dbd1-48f9-b681-b1d3cadd7e4f tempest-AttachVolumeTestJSON-872616700 None] Selected osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:32:02 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-0eee78b2-dbd1-48f9-b681-b1d3cadd7e4f tempest-AttachVolumeTestJSON-872616700 None] casted to osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f Jun 29 03:32:02 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-0eee78b2-dbd1-48f9-b681-b1d3cadd7e4f tempest-AttachVolumeTestJSON-872616700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-f930343d-56d1-4c7c-92ce-4a3d26559090 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:32:02 devstack sudo[105815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-f930343d-56d1-4c7c-92ce-4a3d26559090 1073741824 Jun 29 03:32:02 devstack sudo[105815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:32:03 devstack sudo[105815]: pam_unix(sudo:session): session closed for user root Jun 29 03:32:03 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-0eee78b2-dbd1-48f9-b681-b1d3cadd7e4f tempest-AttachVolumeTestJSON-872616700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-f930343d-56d1-4c7c-92ce-4a3d26559090 1073741824" returned: 0 in 1.203s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:32:03 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-0eee78b2-dbd1-48f9-b681-b1d3cadd7e4f tempest-AttachVolumeTestJSON-872616700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-f930343d-56d1-4c7c-92ce-4a3d26559090 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:32:03 devstack sudo[105822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-f930343d-56d1-4c7c-92ce-4a3d26559090 Jun 29 03:32:03 devstack sudo[105822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:32:04 devstack sudo[105822]: pam_unix(sudo:session): session closed for user root Jun 29 03:32:04 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-0eee78b2-dbd1-48f9-b681-b1d3cadd7e4f tempest-AttachVolumeTestJSON-872616700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-f930343d-56d1-4c7c-92ce-4a3d26559090" returned: 0 in 0.947s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:32:04 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-0eee78b2-dbd1-48f9-b681-b1d3cadd7e4f tempest-AttachVolumeTestJSON-872616700 None] <== create_volume: return (2223ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:32:04 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-0eee78b2-dbd1-48f9-b681-b1d3cadd7e4f tempest-AttachVolumeTestJSON-872616700 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.227s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:32:04 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-0eee78b2-dbd1-48f9-b681-b1d3cadd7e4f tempest-AttachVolumeTestJSON-872616700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb3ea661-ece2-4140-9afb-ccd121364253) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f930343d-56d1-4c7c-92ce-4a3d26559090', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:32:04 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-0eee78b2-dbd1-48f9-b681-b1d3cadd7e4f tempest-AttachVolumeTestJSON-872616700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eed2c3ab-5a8a-4089-bead-5daa93168481) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:32:04 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-0eee78b2-dbd1-48f9-b681-b1d3cadd7e4f tempest-AttachVolumeTestJSON-872616700 None] Volume volume-f930343d-56d1-4c7c-92ce-4a3d26559090 (f930343d-56d1-4c7c-92ce-4a3d26559090): created successfully Jun 29 03:32:04 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-0eee78b2-dbd1-48f9-b681-b1d3cadd7e4f tempest-AttachVolumeTestJSON-872616700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eed2c3ab-5a8a-4089-bead-5daa93168481) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:32:04 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-0eee78b2-dbd1-48f9-b681-b1d3cadd7e4f tempest-AttachVolumeTestJSON-872616700 None] Flow 'volume_create_manager' (c437caee-4001-4051-a9f0-dd2604441b01) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:32:04 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-0eee78b2-dbd1-48f9-b681-b1d3cadd7e4f tempest-AttachVolumeTestJSON-872616700 None] Created volume successfully. Jun 29 03:32:08 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-54a9f7ed-ad05-4bf4-a32a-aa4ceaca5c0e tempest-VolumesActionsTest-882954247 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:32:08 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-54a9f7ed-ad05-4bf4-a32a-aa4ceaca5c0e tempest-VolumesActionsTest-882954247 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.003s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:32:08 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f0230e8-2150-4c5d-8240-a4a795cd7eea]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:32:08 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-54a9f7ed-ad05-4bf4-a32a-aa4ceaca5c0e tempest-VolumesActionsTest-882954247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9ab012d6-eec7-4252-8797-e69a378d83ae {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:32:08 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [req-48c1c0f1-40f4-4ae3-87b8-5053249b84a1 req-ce53fb01-f6f7-4b65-b6e1-0c04519ded2c tempest-AttachVolumeTestJSON-872616700 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:32:08 devstack sudo[105853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9ab012d6-eec7-4252-8797-e69a378d83ae Jun 29 03:32:08 devstack sudo[105853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:32:09 devstack sudo[105853]: pam_unix(sudo:session): session closed for user root Jun 29 03:32:09 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-54a9f7ed-ad05-4bf4-a32a-aa4ceaca5c0e tempest-VolumesActionsTest-882954247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9ab012d6-eec7-4252-8797-e69a378d83ae" returned: 0 in 1.155s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:32:09 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[d247842b-38d2-4a81-8116-c093fc1926ea]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:32:09 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-54a9f7ed-ad05-4bf4-a32a-aa4ceaca5c0e tempest-VolumesActionsTest-882954247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9ab012d6-eec7-4252-8797-e69a378d83ae {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:32:09 devstack sudo[105918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9ab012d6-eec7-4252-8797-e69a378d83ae Jun 29 03:32:09 devstack sudo[105918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:32:10 devstack sudo[105918]: pam_unix(sudo:session): session closed for user root Jun 29 03:32:10 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-54a9f7ed-ad05-4bf4-a32a-aa4ceaca5c0e tempest-VolumesActionsTest-882954247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9ab012d6-eec7-4252-8797-e69a378d83ae" returned: 0 in 0.968s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:32:10 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-54a9f7ed-ad05-4bf4-a32a-aa4ceaca5c0e tempest-VolumesActionsTest-882954247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9ab012d6-eec7-4252-8797-e69a378d83ae /opt/stack/data/cinder/conversion/9ab012d6-eec7-4252-8797-e69a378d83ae.temp_image.c48236f8-a511-4a67-8b21-88ce19427b76d_ndifg1.img {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:32:10 devstack sudo[105933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9ab012d6-eec7-4252-8797-e69a378d83ae /opt/stack/data/cinder/conversion/9ab012d6-eec7-4252-8797-e69a378d83ae.temp_image.c48236f8-a511-4a67-8b21-88ce19427b76d_ndifg1.img Jun 29 03:32:10 devstack sudo[105933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:32:11 devstack cinder-volume[93468]: DEBUG oslo_service.periodic_task [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93468) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 29 03:32:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:32:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:32:11 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:32:11 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:32:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:32:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:32:12 devstack sudo[105949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf Jun 29 03:32:12 devstack sudo[105949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:32:13 devstack sudo[105949]: pam_unix(sudo:session): session closed for user root Jun 29 03:32:13 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf" returned: 0 in 2.074s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:32:13 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:32:13 devstack cinder-volume[93468]: DEBUG oslo_service.periodic_task [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Running periodic task VolumeManager._thread_info {{(pid=93468) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 29 03:32:13 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] thread count: 28 {{(pid=93468) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 29 03:32:13 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] thread info: [<_MainThread(MainThread, started 132331377287296)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93468) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 29 03:32:18 devstack cinder-volume[93468]: DEBUG dbcounter [-] [93468] Writing DB stats cinder:SELECT=10,cinder:UPDATE=5,cinder:DELETE=1 {{(pid=93468) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 29 03:32:18 devstack cinder-volume[93468]: DEBUG dbcounter [-] [93468] Writing DB stats cinder:SELECT=9,cinder:UPDATE=4,cinder:INSERT=1 {{(pid=93468) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 29 03:32:19 devstack sudo[105933]: pam_unix(sudo:session): session closed for user root Jun 29 03:32:19 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-54a9f7ed-ad05-4bf4-a32a-aa4ceaca5c0e tempest-VolumesActionsTest-882954247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9ab012d6-eec7-4252-8797-e69a378d83ae /opt/stack/data/cinder/conversion/9ab012d6-eec7-4252-8797-e69a378d83ae.temp_image.c48236f8-a511-4a67-8b21-88ce19427b76d_ndifg1.img" returned: 0 in 9.037s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:32:19 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[65ae5d9d-6c36-4abb-8606-c14893ccda64]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:32:19 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-54a9f7ed-ad05-4bf4-a32a-aa4ceaca5c0e tempest-VolumesActionsTest-882954247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9ab012d6-eec7-4252-8797-e69a378d83ae {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:32:19 devstack sudo[105981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9ab012d6-eec7-4252-8797-e69a378d83ae Jun 29 03:32:19 devstack sudo[105981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:32:21 devstack sudo[105981]: pam_unix(sudo:session): session closed for user root Jun 29 03:32:21 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-54a9f7ed-ad05-4bf4-a32a-aa4ceaca5c0e tempest-VolumesActionsTest-882954247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9ab012d6-eec7-4252-8797-e69a378d83ae" returned: 0 in 1.369s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:32:21 devstack cinder-volume[93468]: DEBUG cinder.image.image_utils [None req-54a9f7ed-ad05-4bf4-a32a-aa4ceaca5c0e tempest-VolumesActionsTest-882954247 None] Image conversion details: src /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9ab012d6-eec7-4252-8797-e69a378d83ae, size 1024.00 MB, duration 9.04 sec, destination /opt/stack/data/cinder/conversion/9ab012d6-eec7-4252-8797-e69a378d83ae.temp_image.c48236f8-a511-4a67-8b21-88ce19427b76d_ndifg1.img {{(pid=93468) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 29 03:32:21 devstack cinder-volume[93468]: INFO cinder.image.image_utils [None req-54a9f7ed-ad05-4bf4-a32a-aa4ceaca5c0e tempest-VolumesActionsTest-882954247 None] Converted 1024.00 MB image at 113.29 MB/s Jun 29 03:32:21 devstack cinder-volume[93468]: DEBUG cinder.image.image_utils [None req-54a9f7ed-ad05-4bf4-a32a-aa4ceaca5c0e tempest-VolumesActionsTest-882954247 None] c48236f8-a511-4a67-8b21-88ce19427b76 was raw, no need to convert to raw {{(pid=93468) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Jun 29 03:32:31 devstack cinder-volume[93468]: DEBUG dbcounter [-] [93468] Writing DB stats cinder:SELECT=1 {{(pid=93468) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 29 03:32:31 devstack cinder-volume[93468]: DEBUG dbcounter [-] [93468] Writing DB stats cinder:SELECT=1 {{(pid=93468) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 29 03:32:44 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [req-066db71c-2667-43e5-801c-085d781d4fee req-a7d06bc2-9358-4cb9-abdb-72de60af2626 tempest-TestInstancesWithCinderVolumes-816660254 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:32:47 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-54a9f7ed-ad05-4bf4-a32a-aa4ceaca5c0e tempest-VolumesActionsTest-882954247 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 39.182s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:32:47 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-54a9f7ed-ad05-4bf4-a32a-aa4ceaca5c0e tempest-VolumesActionsTest-882954247 None] Uploaded volume to glance image-id: c48236f8-a511-4a67-8b21-88ce19427b76. {{(pid=93468) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jun 29 03:32:47 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [req-48c1c0f1-40f4-4ae3-87b8-5053249b84a1 req-ce53fb01-f6f7-4b65-b6e1-0c04519ded2c tempest-AttachVolumeTestJSON-872616700 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 39.124s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:32:47 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-54a9f7ed-ad05-4bf4-a32a-aa4ceaca5c0e tempest-VolumesActionsTest-882954247 None] Copy volume to image completed successfully. Jun 29 03:32:47 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[7637cc34-e133-4413-9fb8-707af31478b6]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:32:47 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [req-48c1c0f1-40f4-4ae3-87b8-5053249b84a1 req-ce53fb01-f6f7-4b65-b6e1-0c04519ded2c tempest-AttachVolumeTestJSON-872616700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-f930343d-56d1-4c7c-92ce-4a3d26559090 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:32:47 devstack sudo[106256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-f930343d-56d1-4c7c-92ce-4a3d26559090 Jun 29 03:32:47 devstack sudo[106256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:32:48 devstack sudo[106256]: pam_unix(sudo:session): session closed for user root Jun 29 03:32:48 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [req-48c1c0f1-40f4-4ae3-87b8-5053249b84a1 req-ce53fb01-f6f7-4b65-b6e1-0c04519ded2c tempest-AttachVolumeTestJSON-872616700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-f930343d-56d1-4c7c-92ce-4a3d26559090" returned: 0 in 0.944s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:32:48 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [req-48c1c0f1-40f4-4ae3-87b8-5053249b84a1 req-ce53fb01-f6f7-4b65-b6e1-0c04519ded2c tempest-AttachVolumeTestJSON-872616700 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.977s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:32:48 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [req-066db71c-2667-43e5-801c-085d781d4fee req-a7d06bc2-9358-4cb9-abdb-72de60af2626 tempest-TestInstancesWithCinderVolumes-816660254 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 4.553s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:32:48 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[98df05f8-e2b4-4247-924d-14560416fef6]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:32:48 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [req-066db71c-2667-43e5-801c-085d781d4fee req-a7d06bc2-9358-4cb9-abdb-72de60af2626 tempest-TestInstancesWithCinderVolumes-816660254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-47a2a0b2-eddf-4fbb-a753-0e856fc86fe8 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:32:48 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [req-48c1c0f1-40f4-4ae3-87b8-5053249b84a1 req-ce53fb01-f6f7-4b65-b6e1-0c04519ded2c tempest-AttachVolumeTestJSON-872616700 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f', 'name': 'volume-f930343d-56d1-4c7c-92ce-4a3d26559090', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b35ada0f-c2e0-4cde-a8f9-c377bce71a7d', 'enforce_multipath': True} {{(pid=93468) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 29 03:32:48 devstack cinder-volume[93468]: INFO cinder.volume.manager [req-48c1c0f1-40f4-4ae3-87b8-5053249b84a1 req-ce53fb01-f6f7-4b65-b6e1-0c04519ded2c tempest-AttachVolumeTestJSON-872616700 None] attachment_update completed successfully. Jun 29 03:32:48 devstack sudo[106261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-47a2a0b2-eddf-4fbb-a753-0e856fc86fe8 Jun 29 03:32:48 devstack sudo[106261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:32:49 devstack sudo[106261]: pam_unix(sudo:session): session closed for user root Jun 29 03:32:49 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [req-066db71c-2667-43e5-801c-085d781d4fee req-a7d06bc2-9358-4cb9-abdb-72de60af2626 tempest-TestInstancesWithCinderVolumes-816660254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-47a2a0b2-eddf-4fbb-a753-0e856fc86fe8" returned: 0 in 0.780s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:32:49 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [req-066db71c-2667-43e5-801c-085d781d4fee req-a7d06bc2-9358-4cb9-abdb-72de60af2626 tempest-TestInstancesWithCinderVolumes-816660254 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.814s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:32:49 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [req-066db71c-2667-43e5-801c-085d781d4fee req-a7d06bc2-9358-4cb9-abdb-72de60af2626 tempest-TestInstancesWithCinderVolumes-816660254 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f', 'name': 'volume-47a2a0b2-eddf-4fbb-a753-0e856fc86fe8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'cd9d9eb7-74ee-41bc-bd3a-341f58cea90f', 'enforce_multipath': True} {{(pid=93468) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 29 03:32:49 devstack cinder-volume[93468]: INFO cinder.volume.manager [req-066db71c-2667-43e5-801c-085d781d4fee req-a7d06bc2-9358-4cb9-abdb-72de60af2626 tempest-TestInstancesWithCinderVolumes-816660254 None] attachment_update completed successfully. Jun 29 03:32:50 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a3810cd-5620-4b4e-b593-b11a9dfee3fa tempest-TestMinimumBasicScenario-1317041294 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:32:50 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-1a3810cd-5620-4b4e-b593-b11a9dfee3fa tempest-TestMinimumBasicScenario-1317041294 None] Flow 'volume_create_manager' (1d0c6f55-b550-472b-8984-5d92e8dea705) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:32:50 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-1a3810cd-5620-4b4e-b593-b11a9dfee3fa tempest-TestMinimumBasicScenario-1317041294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a81b2db6-2bce-4c40-9f14-b00448823b72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:32:50 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-1a3810cd-5620-4b4e-b593-b11a9dfee3fa tempest-TestMinimumBasicScenario-1317041294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a81b2db6-2bce-4c40-9f14-b00448823b72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:32:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-760981326',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c65cd75-f256-41bb-90a8-b4cb2b8d4d07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9161e7fe8944ae1864333e72a3807fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:32:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:32:50Z,use_quota=True,user_id='5f83fe457abb496fbfc275e7dcacea49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:32:50 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-1a3810cd-5620-4b4e-b593-b11a9dfee3fa tempest-TestMinimumBasicScenario-1317041294 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a4a016a-1057-443a-a85a-23f3b153a34d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:32:50 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-1a3810cd-5620-4b4e-b593-b11a9dfee3fa tempest-TestMinimumBasicScenario-1317041294 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a4a016a-1057-443a-a85a-23f3b153a34d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:32:50 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-1a3810cd-5620-4b4e-b593-b11a9dfee3fa tempest-TestMinimumBasicScenario-1317041294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86f39a68-d680-4f32-85df-ef99c26c88d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:32:50 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-1a3810cd-5620-4b4e-b593-b11a9dfee3fa tempest-TestMinimumBasicScenario-1317041294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86f39a68-d680-4f32-85df-ef99c26c88d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c65cd75-f256-41bb-90a8-b4cb2b8d4d07', 'volume_name': 'volume-6c65cd75-f256-41bb-90a8-b4cb2b8d4d07', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:32:50 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-1a3810cd-5620-4b4e-b593-b11a9dfee3fa tempest-TestMinimumBasicScenario-1317041294 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91875b68-15ed-4094-ae7c-fd70ef737bc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:32:50 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-1a3810cd-5620-4b4e-b593-b11a9dfee3fa tempest-TestMinimumBasicScenario-1317041294 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91875b68-15ed-4094-ae7c-fd70ef737bc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:32:50 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-1a3810cd-5620-4b4e-b593-b11a9dfee3fa tempest-TestMinimumBasicScenario-1317041294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e8a8cbe-cb3a-4910-91b3-5cd2504bd203) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:32:50 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-1a3810cd-5620-4b4e-b593-b11a9dfee3fa tempest-TestMinimumBasicScenario-1317041294 None] Volume 6c65cd75-f256-41bb-90a8-b4cb2b8d4d07: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c65cd75-f256-41bb-90a8-b4cb2b8d4d07', 'volume_size': 1} Jun 29 03:32:50 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-1a3810cd-5620-4b4e-b593-b11a9dfee3fa tempest-TestMinimumBasicScenario-1317041294 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:32:50 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-1a3810cd-5620-4b4e-b593-b11a9dfee3fa tempest-TestMinimumBasicScenario-1317041294 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:32:50 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-1a3810cd-5620-4b4e-b593-b11a9dfee3fa tempest-TestMinimumBasicScenario-1317041294 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:32:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-760981326',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c65cd75-f256-41bb-90a8-b4cb2b8d4d07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9161e7fe8944ae1864333e72a3807fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:32:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:32:50Z,use_quota=True,user_id='5f83fe457abb496fbfc275e7dcacea49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:32:50 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-1a3810cd-5620-4b4e-b593-b11a9dfee3fa tempest-TestMinimumBasicScenario-1317041294 None] Creating volume 6c65cd75-f256-41bb-90a8-b4cb2b8d4d07 {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:32:50 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-1a3810cd-5620-4b4e-b593-b11a9dfee3fa tempest-TestMinimumBasicScenario-1317041294 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:32:50 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-1a3810cd-5620-4b4e-b593-b11a9dfee3fa tempest-TestMinimumBasicScenario-1317041294 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:32:50 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-1a3810cd-5620-4b4e-b593-b11a9dfee3fa tempest-TestMinimumBasicScenario-1317041294 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:32:50 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-1a3810cd-5620-4b4e-b593-b11a9dfee3fa tempest-TestMinimumBasicScenario-1317041294 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:32:50 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-1a3810cd-5620-4b4e-b593-b11a9dfee3fa tempest-TestMinimumBasicScenario-1317041294 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:32:50 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-1a3810cd-5620-4b4e-b593-b11a9dfee3fa tempest-TestMinimumBasicScenario-1317041294 None] Selected osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:32:50 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-1a3810cd-5620-4b4e-b593-b11a9dfee3fa tempest-TestMinimumBasicScenario-1317041294 None] casted to osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f Jun 29 03:32:50 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-1a3810cd-5620-4b4e-b593-b11a9dfee3fa tempest-TestMinimumBasicScenario-1317041294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-6c65cd75-f256-41bb-90a8-b4cb2b8d4d07 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:32:50 devstack sudo[106272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-6c65cd75-f256-41bb-90a8-b4cb2b8d4d07 1073741824 Jun 29 03:32:50 devstack sudo[106272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:32:50 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-a7c53d51-d86b-4133-9512-81cbd3a73520 tempest-VolumesActionsTest-882954247 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:32:51 devstack sudo[106272]: pam_unix(sudo:session): session closed for user root Jun 29 03:32:51 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-1a3810cd-5620-4b4e-b593-b11a9dfee3fa tempest-TestMinimumBasicScenario-1317041294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-6c65cd75-f256-41bb-90a8-b4cb2b8d4d07 1073741824" returned: 0 in 1.017s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:32:51 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-1a3810cd-5620-4b4e-b593-b11a9dfee3fa tempest-TestMinimumBasicScenario-1317041294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-6c65cd75-f256-41bb-90a8-b4cb2b8d4d07 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:32:51 devstack sudo[106283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-6c65cd75-f256-41bb-90a8-b4cb2b8d4d07 Jun 29 03:32:51 devstack sudo[106283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:32:51 devstack sudo[106283]: pam_unix(sudo:session): session closed for user root Jun 29 03:32:51 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-1a3810cd-5620-4b4e-b593-b11a9dfee3fa tempest-TestMinimumBasicScenario-1317041294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-6c65cd75-f256-41bb-90a8-b4cb2b8d4d07" returned: 0 in 0.733s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:32:51 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-1a3810cd-5620-4b4e-b593-b11a9dfee3fa tempest-TestMinimumBasicScenario-1317041294 None] <== create_volume: return (1826ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:32:51 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-1a3810cd-5620-4b4e-b593-b11a9dfee3fa tempest-TestMinimumBasicScenario-1317041294 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.831s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:32:52 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-a7c53d51-d86b-4133-9512-81cbd3a73520 tempest-VolumesActionsTest-882954247 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 1.175s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:32:52 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-1a3810cd-5620-4b4e-b593-b11a9dfee3fa tempest-TestMinimumBasicScenario-1317041294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e8a8cbe-cb3a-4910-91b3-5cd2504bd203) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c65cd75-f256-41bb-90a8-b4cb2b8d4d07', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:32:52 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-1a3810cd-5620-4b4e-b593-b11a9dfee3fa tempest-TestMinimumBasicScenario-1317041294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08a42bbb-088f-46f8-98b9-d10a443eaa3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:32:52 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[b110d9e3-dbdd-4d74-b910-250f63c4fe15]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:32:52 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a7c53d51-d86b-4133-9512-81cbd3a73520 tempest-VolumesActionsTest-882954247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9ab012d6-eec7-4252-8797-e69a378d83ae {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:32:52 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-1a3810cd-5620-4b4e-b593-b11a9dfee3fa tempest-TestMinimumBasicScenario-1317041294 None] Volume volume-6c65cd75-f256-41bb-90a8-b4cb2b8d4d07 (6c65cd75-f256-41bb-90a8-b4cb2b8d4d07): created successfully Jun 29 03:32:52 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-1a3810cd-5620-4b4e-b593-b11a9dfee3fa tempest-TestMinimumBasicScenario-1317041294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08a42bbb-088f-46f8-98b9-d10a443eaa3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:32:52 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-1a3810cd-5620-4b4e-b593-b11a9dfee3fa tempest-TestMinimumBasicScenario-1317041294 None] Flow 'volume_create_manager' (1d0c6f55-b550-472b-8984-5d92e8dea705) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:32:52 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-1a3810cd-5620-4b4e-b593-b11a9dfee3fa tempest-TestMinimumBasicScenario-1317041294 None] Created volume successfully. Jun 29 03:32:52 devstack sudo[106287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9ab012d6-eec7-4252-8797-e69a378d83ae Jun 29 03:32:52 devstack sudo[106287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:32:52 devstack sudo[106287]: pam_unix(sudo:session): session closed for user root Jun 29 03:32:52 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a7c53d51-d86b-4133-9512-81cbd3a73520 tempest-VolumesActionsTest-882954247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9ab012d6-eec7-4252-8797-e69a378d83ae" returned: 0 in 0.837s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:32:52 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6186985-3a12-4c62-87f9-8b1c8579ab6a]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:32:52 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a7c53d51-d86b-4133-9512-81cbd3a73520 tempest-VolumesActionsTest-882954247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9ab012d6-eec7-4252-8797-e69a378d83ae {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:32:53 devstack sudo[106295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9ab012d6-eec7-4252-8797-e69a378d83ae Jun 29 03:32:53 devstack sudo[106295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:32:53 devstack sudo[106295]: pam_unix(sudo:session): session closed for user root Jun 29 03:32:53 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a7c53d51-d86b-4133-9512-81cbd3a73520 tempest-VolumesActionsTest-882954247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9ab012d6-eec7-4252-8797-e69a378d83ae" returned: 0 in 0.823s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:32:53 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a7c53d51-d86b-4133-9512-81cbd3a73520 tempest-VolumesActionsTest-882954247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9ab012d6-eec7-4252-8797-e69a378d83ae /opt/stack/data/cinder/conversion/9ab012d6-eec7-4252-8797-e69a378d83ae.temp_image.8e82a25b-44ca-4aba-8276-5edc3b7ac0f5djwx34tc.img {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:32:53 devstack sudo[106300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9ab012d6-eec7-4252-8797-e69a378d83ae /opt/stack/data/cinder/conversion/9ab012d6-eec7-4252-8797-e69a378d83ae.temp_image.8e82a25b-44ca-4aba-8276-5edc3b7ac0f5djwx34tc.img Jun 29 03:32:53 devstack sudo[106300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:32:57 devstack cinder-volume[93468]: INFO cinder.volume.manager [req-7c69486c-d4b7-467f-90e6-99101f3233f9 req-3558323b-ae1f-433c-9eef-1fd18cc68d34 tempest-AttachVolumeTestJSON-872616700 None] Terminate volume connection completed successfully. Jun 29 03:32:57 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [req-7c69486c-d4b7-467f-90e6-99101f3233f9 req-3558323b-ae1f-433c-9eef-1fd18cc68d34 tempest-AttachVolumeTestJSON-872616700 None] Deleting attachment 132483e8-f28d-486a-8431-36654b7e479e. {{(pid=93468) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 29 03:32:57 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [req-ccdae52c-74d4-4d9e-9a19-a456d602ee24 req-d90abc3a-2de1-4f47-a886-3a2d9b53bac8 tempest-TestMinimumBasicScenario-1317041294 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:33:00 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [req-7f6eb6be-d4bc-4c62-8321-2a03501186a1 req-f2be042d-b145-4480-8cc8-4f6b4ada98d3 tempest-TestInstancesWithCinderVolumes-816660254 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:33:00 devstack sudo[106300]: pam_unix(sudo:session): session closed for user root Jun 29 03:33:00 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a7c53d51-d86b-4133-9512-81cbd3a73520 tempest-VolumesActionsTest-882954247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9ab012d6-eec7-4252-8797-e69a378d83ae /opt/stack/data/cinder/conversion/9ab012d6-eec7-4252-8797-e69a378d83ae.temp_image.8e82a25b-44ca-4aba-8276-5edc3b7ac0f5djwx34tc.img" returned: 0 in 6.847s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:33:00 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[d80ecd9f-8cde-4fe6-98e8-98c2ac001bdd]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:33:00 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a7c53d51-d86b-4133-9512-81cbd3a73520 tempest-VolumesActionsTest-882954247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9ab012d6-eec7-4252-8797-e69a378d83ae {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:33:00 devstack sudo[106367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9ab012d6-eec7-4252-8797-e69a378d83ae Jun 29 03:33:00 devstack sudo[106367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:33:01 devstack sudo[106367]: pam_unix(sudo:session): session closed for user root Jun 29 03:33:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a7c53d51-d86b-4133-9512-81cbd3a73520 tempest-VolumesActionsTest-882954247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9ab012d6-eec7-4252-8797-e69a378d83ae" returned: 0 in 0.931s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:33:01 devstack cinder-volume[93468]: DEBUG cinder.image.image_utils [None req-a7c53d51-d86b-4133-9512-81cbd3a73520 tempest-VolumesActionsTest-882954247 None] Image conversion details: src /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9ab012d6-eec7-4252-8797-e69a378d83ae, size 1024.00 MB, duration 6.85 sec, destination /opt/stack/data/cinder/conversion/9ab012d6-eec7-4252-8797-e69a378d83ae.temp_image.8e82a25b-44ca-4aba-8276-5edc3b7ac0f5djwx34tc.img {{(pid=93468) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 29 03:33:01 devstack cinder-volume[93468]: INFO cinder.image.image_utils [None req-a7c53d51-d86b-4133-9512-81cbd3a73520 tempest-VolumesActionsTest-882954247 None] Converted 1024.00 MB image at 149.52 MB/s Jun 29 03:33:01 devstack cinder-volume[93468]: DEBUG cinder.image.image_utils [None req-a7c53d51-d86b-4133-9512-81cbd3a73520 tempest-VolumesActionsTest-882954247 None] 8e82a25b-44ca-4aba-8276-5edc3b7ac0f5 was raw, converting to qcow2 {{(pid=93468) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Jun 29 03:33:01 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[d274e409-56b5-4c4f-bbb6-4ebf02f4314b]: (4, 'raw') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:33:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a7c53d51-d86b-4133-9512-81cbd3a73520 tempest-VolumesActionsTest-882954247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/9ab012d6-eec7-4252-8797-e69a378d83ae.temp_image.8e82a25b-44ca-4aba-8276-5edc3b7ac0f5djwx34tc.img {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:33:01 devstack sudo[106373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/9ab012d6-eec7-4252-8797-e69a378d83ae.temp_image.8e82a25b-44ca-4aba-8276-5edc3b7ac0f5djwx34tc.img Jun 29 03:33:01 devstack sudo[106373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:33:02 devstack sudo[106373]: pam_unix(sudo:session): session closed for user root Jun 29 03:33:02 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a7c53d51-d86b-4133-9512-81cbd3a73520 tempest-VolumesActionsTest-882954247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/9ab012d6-eec7-4252-8797-e69a378d83ae.temp_image.8e82a25b-44ca-4aba-8276-5edc3b7ac0f5djwx34tc.img" returned: 0 in 0.719s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:33:02 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a7c53d51-d86b-4133-9512-81cbd3a73520 tempest-VolumesActionsTest-882954247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/9ab012d6-eec7-4252-8797-e69a378d83ae.temp_image.8e82a25b-44ca-4aba-8276-5edc3b7ac0f5djwx34tc.img {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:33:02 devstack sudo[106377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/9ab012d6-eec7-4252-8797-e69a378d83ae.temp_image.8e82a25b-44ca-4aba-8276-5edc3b7ac0f5djwx34tc.img Jun 29 03:33:02 devstack sudo[106377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:33:02 devstack sudo[106377]: pam_unix(sudo:session): session closed for user root Jun 29 03:33:02 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a7c53d51-d86b-4133-9512-81cbd3a73520 tempest-VolumesActionsTest-882954247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/9ab012d6-eec7-4252-8797-e69a378d83ae.temp_image.8e82a25b-44ca-4aba-8276-5edc3b7ac0f5djwx34tc.img" returned: 1 in 0.714s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:33:02 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a7c53d51-d86b-4133-9512-81cbd3a73520 tempest-VolumesActionsTest-882954247 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/9ab012d6-eec7-4252-8797-e69a378d83ae.temp_image.8e82a25b-44ca-4aba-8276-5edc3b7ac0f5djwx34tc.img' failed. Not Retrying. {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 29 03:33:02 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a7c53d51-d86b-4133-9512-81cbd3a73520 tempest-VolumesActionsTest-882954247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/9ab012d6-eec7-4252-8797-e69a378d83ae.temp_image.8e82a25b-44ca-4aba-8276-5edc3b7ac0f5djwx34tc.img /opt/stack/data/cinder/conversion/vol_upload_1gizh_xw {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:33:03 devstack sudo[106382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/9ab012d6-eec7-4252-8797-e69a378d83ae.temp_image.8e82a25b-44ca-4aba-8276-5edc3b7ac0f5djwx34tc.img /opt/stack/data/cinder/conversion/vol_upload_1gizh_xw Jun 29 03:33:03 devstack sudo[106382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:33:03 devstack sudo[106382]: pam_unix(sudo:session): session closed for user root Jun 29 03:33:03 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a7c53d51-d86b-4133-9512-81cbd3a73520 tempest-VolumesActionsTest-882954247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/9ab012d6-eec7-4252-8797-e69a378d83ae.temp_image.8e82a25b-44ca-4aba-8276-5edc3b7ac0f5djwx34tc.img /opt/stack/data/cinder/conversion/vol_upload_1gizh_xw" returned: 0 in 0.654s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:33:03 devstack cinder-volume[93468]: DEBUG cinder.image.image_utils [None req-a7c53d51-d86b-4133-9512-81cbd3a73520 tempest-VolumesActionsTest-882954247 None] Image conversion details: src /opt/stack/data/cinder/conversion/9ab012d6-eec7-4252-8797-e69a378d83ae.temp_image.8e82a25b-44ca-4aba-8276-5edc3b7ac0f5djwx34tc.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_1gizh_xw {{(pid=93468) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 29 03:33:03 devstack cinder-volume[93468]: INFO cinder.image.image_utils [None req-a7c53d51-d86b-4133-9512-81cbd3a73520 tempest-VolumesActionsTest-882954247 None] Converted 1024.00 MB image at 1024.00 MB/s Jun 29 03:33:03 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[92fc4bb0-3f26-4897-9059-e57d7ae08afa]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:33:03 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a7c53d51-d86b-4133-9512-81cbd3a73520 tempest-VolumesActionsTest-882954247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_1gizh_xw {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:33:03 devstack sudo[106389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_1gizh_xw Jun 29 03:33:03 devstack sudo[106389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:33:04 devstack sudo[106389]: pam_unix(sudo:session): session closed for user root Jun 29 03:33:04 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a7c53d51-d86b-4133-9512-81cbd3a73520 tempest-VolumesActionsTest-882954247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_1gizh_xw" returned: 0 in 0.724s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:33:05 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-a7c53d51-d86b-4133-9512-81cbd3a73520 tempest-VolumesActionsTest-882954247 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 13.622s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:33:05 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-a7c53d51-d86b-4133-9512-81cbd3a73520 tempest-VolumesActionsTest-882954247 None] Uploaded volume to glance image-id: 8e82a25b-44ca-4aba-8276-5edc3b7ac0f5. {{(pid=93468) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jun 29 03:33:05 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [req-ccdae52c-74d4-4d9e-9a19-a456d602ee24 req-d90abc3a-2de1-4f47-a886-3a2d9b53bac8 tempest-TestMinimumBasicScenario-1317041294 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 7.897s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:33:05 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-a7c53d51-d86b-4133-9512-81cbd3a73520 tempest-VolumesActionsTest-882954247 None] Copy volume to image completed successfully. Jun 29 03:33:05 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[89ae8cf0-d814-4379-a41a-30cfbd2a9669]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:33:05 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [req-ccdae52c-74d4-4d9e-9a19-a456d602ee24 req-d90abc3a-2de1-4f47-a886-3a2d9b53bac8 tempest-TestMinimumBasicScenario-1317041294 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-6c65cd75-f256-41bb-90a8-b4cb2b8d4d07 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:33:05 devstack sudo[106394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-6c65cd75-f256-41bb-90a8-b4cb2b8d4d07 Jun 29 03:33:05 devstack sudo[106394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:33:06 devstack sudo[106394]: pam_unix(sudo:session): session closed for user root Jun 29 03:33:06 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [req-ccdae52c-74d4-4d9e-9a19-a456d602ee24 req-d90abc3a-2de1-4f47-a886-3a2d9b53bac8 tempest-TestMinimumBasicScenario-1317041294 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-6c65cd75-f256-41bb-90a8-b4cb2b8d4d07" returned: 0 in 0.792s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:33:06 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [req-ccdae52c-74d4-4d9e-9a19-a456d602ee24 req-d90abc3a-2de1-4f47-a886-3a2d9b53bac8 tempest-TestMinimumBasicScenario-1317041294 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.822s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:33:06 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [req-7f6eb6be-d4bc-4c62-8321-2a03501186a1 req-f2be042d-b145-4480-8cc8-4f6b4ada98d3 tempest-TestInstancesWithCinderVolumes-816660254 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 6.190s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:33:06 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[3098a0fc-3f74-4aca-9580-bcd936d3b27e]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:33:06 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [req-7f6eb6be-d4bc-4c62-8321-2a03501186a1 req-f2be042d-b145-4480-8cc8-4f6b4ada98d3 tempest-TestInstancesWithCinderVolumes-816660254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-2f2e765d-fff0-4c4d-b402-3ec90d0d609c {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:33:06 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [req-ccdae52c-74d4-4d9e-9a19-a456d602ee24 req-d90abc3a-2de1-4f47-a886-3a2d9b53bac8 tempest-TestMinimumBasicScenario-1317041294 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f', 'name': 'volume-6c65cd75-f256-41bb-90a8-b4cb2b8d4d07', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9b68d3ec-c1ae-4e27-9ce9-aaf2c38c6ac5', 'enforce_multipath': True} {{(pid=93468) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 29 03:33:06 devstack cinder-volume[93468]: INFO cinder.volume.manager [req-ccdae52c-74d4-4d9e-9a19-a456d602ee24 req-d90abc3a-2de1-4f47-a886-3a2d9b53bac8 tempest-TestMinimumBasicScenario-1317041294 None] attachment_update completed successfully. Jun 29 03:33:06 devstack sudo[106399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-2f2e765d-fff0-4c4d-b402-3ec90d0d609c Jun 29 03:33:06 devstack sudo[106399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:33:07 devstack sudo[106399]: pam_unix(sudo:session): session closed for user root Jun 29 03:33:07 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [req-7f6eb6be-d4bc-4c62-8321-2a03501186a1 req-f2be042d-b145-4480-8cc8-4f6b4ada98d3 tempest-TestInstancesWithCinderVolumes-816660254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-2f2e765d-fff0-4c4d-b402-3ec90d0d609c" returned: 0 in 0.880s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:33:07 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [req-7f6eb6be-d4bc-4c62-8321-2a03501186a1 req-f2be042d-b145-4480-8cc8-4f6b4ada98d3 tempest-TestInstancesWithCinderVolumes-816660254 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.905s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:33:07 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [req-7f6eb6be-d4bc-4c62-8321-2a03501186a1 req-f2be042d-b145-4480-8cc8-4f6b4ada98d3 tempest-TestInstancesWithCinderVolumes-816660254 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f', 'name': 'volume-2f2e765d-fff0-4c4d-b402-3ec90d0d609c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6ce57e1b-4507-4688-8611-f2358ab7fd8d', 'enforce_multipath': True} {{(pid=93468) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 29 03:33:07 devstack cinder-volume[93468]: INFO cinder.volume.manager [req-7f6eb6be-d4bc-4c62-8321-2a03501186a1 req-f2be042d-b145-4480-8cc8-4f6b4ada98d3 tempest-TestInstancesWithCinderVolumes-816660254 None] attachment_update completed successfully. Jun 29 03:33:07 devstack cinder-volume[93468]: INFO cinder.volume.manager [req-6eed4309-a31c-41fd-af85-faca2b2fd017 req-df973577-b85e-453b-b1c5-0bca1412f521 tempest-AttachVolumeTestJSON-872616700 None] Terminate volume connection completed successfully. Jun 29 03:33:07 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [req-6eed4309-a31c-41fd-af85-faca2b2fd017 req-df973577-b85e-453b-b1c5-0bca1412f521 tempest-AttachVolumeTestJSON-872616700 None] Deleting attachment b35ada0f-c2e0-4cde-a8f9-c377bce71a7d. {{(pid=93468) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 29 03:33:07 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-6efe8297-ad45-4c33-ba40-150296e0beb3 tempest-VolumesActionsTest-882954247 None] Acquiring lock "cinder-9ab012d6-eec7-4252-8797-e69a378d83ae-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:33:08 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-6efe8297-ad45-4c33-ba40-150296e0beb3 tempest-VolumesActionsTest-882954247 None] Lock "cinder-9ab012d6-eec7-4252-8797-e69a378d83ae-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:33:08 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-6efe8297-ad45-4c33-ba40-150296e0beb3 tempest-VolumesActionsTest-882954247 None] Acquiring lock "cinder-quobyte-9ab012d6-eec7-4252-8797-e69a378d83ae" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:33:08 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-6efe8297-ad45-4c33-ba40-150296e0beb3 tempest-VolumesActionsTest-882954247 None] Lock "cinder-quobyte-9ab012d6-eec7-4252-8797-e69a378d83ae" acquired by "delete_volume" :: waited 0.022s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:33:08 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[641a2f55-f8c7-434e-ab27-07c1ae307d03]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:33:08 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-6efe8297-ad45-4c33-ba40-150296e0beb3 tempest-VolumesActionsTest-882954247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9ab012d6-eec7-4252-8797-e69a378d83ae {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:33:08 devstack sudo[106415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9ab012d6-eec7-4252-8797-e69a378d83ae Jun 29 03:33:08 devstack sudo[106415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:33:08 devstack sudo[106415]: pam_unix(sudo:session): session closed for user root Jun 29 03:33:08 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-6efe8297-ad45-4c33-ba40-150296e0beb3 tempest-VolumesActionsTest-882954247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9ab012d6-eec7-4252-8797-e69a378d83ae" returned: 0 in 0.900s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:33:08 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-6efe8297-ad45-4c33-ba40-150296e0beb3 tempest-VolumesActionsTest-882954247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9ab012d6-eec7-4252-8797-e69a378d83ae {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:33:09 devstack sudo[106429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9ab012d6-eec7-4252-8797-e69a378d83ae Jun 29 03:33:09 devstack sudo[106429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:33:09 devstack sudo[106429]: pam_unix(sudo:session): session closed for user root Jun 29 03:33:09 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-6efe8297-ad45-4c33-ba40-150296e0beb3 tempest-VolumesActionsTest-882954247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9ab012d6-eec7-4252-8797-e69a378d83ae" returned: 0 in 0.788s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:33:09 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-6efe8297-ad45-4c33-ba40-150296e0beb3 tempest-VolumesActionsTest-882954247 None] Lock "cinder-quobyte-9ab012d6-eec7-4252-8797-e69a378d83ae" released by "delete_volume" :: held 1.742s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:33:09 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-6efe8297-ad45-4c33-ba40-150296e0beb3 tempest-VolumesActionsTest-882954247 None] Created reservations ['f06bc044-d63c-4731-ad02-ae1b368e1d0b', '6992f520-085c-4d19-908e-9b633172ac5d', 'ef2ce757-0348-4c20-8152-b3393b9e35fb', '50e314a0-7728-474c-9cb9-017026ea4d09'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:33:10 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-6efe8297-ad45-4c33-ba40-150296e0beb3 tempest-VolumesActionsTest-882954247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:33:10 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-6efe8297-ad45-4c33-ba40-150296e0beb3 tempest-VolumesActionsTest-882954247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:33:10 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-6efe8297-ad45-4c33-ba40-150296e0beb3 tempest-VolumesActionsTest-882954247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:33:10 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-6efe8297-ad45-4c33-ba40-150296e0beb3 tempest-VolumesActionsTest-882954247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:33:10 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-6efe8297-ad45-4c33-ba40-150296e0beb3 tempest-VolumesActionsTest-882954247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:33:10 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-6efe8297-ad45-4c33-ba40-150296e0beb3 tempest-VolumesActionsTest-882954247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:33:10 devstack sudo[106444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf Jun 29 03:33:10 devstack sudo[106444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:33:10 devstack sudo[106444]: pam_unix(sudo:session): session closed for user root Jun 29 03:33:10 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-6efe8297-ad45-4c33-ba40-150296e0beb3 tempest-VolumesActionsTest-882954247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf" returned: 0 in 0.889s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:33:10 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-6efe8297-ad45-4c33-ba40-150296e0beb3 tempest-VolumesActionsTest-882954247 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:33:10 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-6efe8297-ad45-4c33-ba40-150296e0beb3 tempest-VolumesActionsTest-882954247 None] Deleted volume successfully. Jun 29 03:33:10 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-6efe8297-ad45-4c33-ba40-150296e0beb3 tempest-VolumesActionsTest-882954247 None] Lock "cinder-9ab012d6-eec7-4252-8797-e69a378d83ae-delete_volume" released by "delete_volume" :: held 2.960s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:33:11 devstack cinder-volume[93468]: DEBUG oslo_service.periodic_task [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93468) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 29 03:33:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:33:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:33:11 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:33:11 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:33:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:33:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:33:11 devstack sudo[106488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf Jun 29 03:33:11 devstack sudo[106488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:33:12 devstack sudo[106488]: pam_unix(sudo:session): session closed for user root Jun 29 03:33:12 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf" returned: 0 in 0.893s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:33:12 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:33:12 devstack cinder-volume[93468]: DEBUG oslo_service.periodic_task [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Running periodic task VolumeManager._thread_info {{(pid=93468) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 29 03:33:12 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] thread count: 28 {{(pid=93468) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 29 03:33:12 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] thread info: [<_MainThread(MainThread, started 132331377287296)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93468) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 29 03:33:18 devstack cinder-volume[93468]: INFO cinder.volume.manager [req-b4dcda78-0a7d-4d98-95ab-a0ba3d57453e req-4081f96c-1b73-401e-877a-fe04781c31aa tempest-TestInstancesWithCinderVolumes-816660254 None] Terminate volume connection completed successfully. Jun 29 03:33:18 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [req-b4dcda78-0a7d-4d98-95ab-a0ba3d57453e req-4081f96c-1b73-401e-877a-fe04781c31aa tempest-TestInstancesWithCinderVolumes-816660254 None] Deleting attachment cd9d9eb7-74ee-41bc-bd3a-341f58cea90f. {{(pid=93468) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 29 03:33:18 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-b25f19d8-f619-4f73-b89a-55c607c4bc45 tempest-AttachVolumeTestJSON-872616700 None] Acquiring lock "cinder-f930343d-56d1-4c7c-92ce-4a3d26559090-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:33:18 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-b25f19d8-f619-4f73-b89a-55c607c4bc45 tempest-AttachVolumeTestJSON-872616700 None] Lock "cinder-f930343d-56d1-4c7c-92ce-4a3d26559090-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:33:19 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-b25f19d8-f619-4f73-b89a-55c607c4bc45 tempest-AttachVolumeTestJSON-872616700 None] Acquiring lock "cinder-quobyte-f930343d-56d1-4c7c-92ce-4a3d26559090" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:33:19 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-b25f19d8-f619-4f73-b89a-55c607c4bc45 tempest-AttachVolumeTestJSON-872616700 None] Lock "cinder-quobyte-f930343d-56d1-4c7c-92ce-4a3d26559090" acquired by "delete_volume" :: waited 0.018s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:33:19 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[1354bf63-3640-4e9e-aab7-f52aeca4c05f]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:33:19 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b25f19d8-f619-4f73-b89a-55c607c4bc45 tempest-AttachVolumeTestJSON-872616700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-f930343d-56d1-4c7c-92ce-4a3d26559090 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:33:19 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-55c5a252-4fc1-42ab-bf7d-94860a7f04b4 tempest-VolumesCloneNegativeTest-2063110591 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:33:19 devstack sudo[106538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-f930343d-56d1-4c7c-92ce-4a3d26559090 Jun 29 03:33:19 devstack sudo[106538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:33:19 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-55c5a252-4fc1-42ab-bf7d-94860a7f04b4 tempest-VolumesCloneNegativeTest-2063110591 None] Flow 'volume_create_manager' (23e77cae-bcee-42e0-bda1-82e768920d1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:33:19 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-55c5a252-4fc1-42ab-bf7d-94860a7f04b4 tempest-VolumesCloneNegativeTest-2063110591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fe4e2f0-5a8f-46ed-9798-63be99f33dc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:33:19 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-55c5a252-4fc1-42ab-bf7d-94860a7f04b4 tempest-VolumesCloneNegativeTest-2063110591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fe4e2f0-5a8f-46ed-9798-63be99f33dc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:33:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-2038677029',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=354c92e9-6de6-471f-9fab-99a7d0ddf90b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='637784fa851a43f59397dabbd71b4609',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:33:19Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:33:19Z,use_quota=True,user_id='aeb26b2e65dc4abb9494be3245d7411c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:33:19 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-55c5a252-4fc1-42ab-bf7d-94860a7f04b4 tempest-VolumesCloneNegativeTest-2063110591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5aaa7a3d-dd96-4634-b902-f9e95a2394b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:33:19 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-55c5a252-4fc1-42ab-bf7d-94860a7f04b4 tempest-VolumesCloneNegativeTest-2063110591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5aaa7a3d-dd96-4634-b902-f9e95a2394b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:33:19 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-55c5a252-4fc1-42ab-bf7d-94860a7f04b4 tempest-VolumesCloneNegativeTest-2063110591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4580a766-d565-4a88-8fb3-c7885d72154c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:33:19 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-55c5a252-4fc1-42ab-bf7d-94860a7f04b4 tempest-VolumesCloneNegativeTest-2063110591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4580a766-d565-4a88-8fb3-c7885d72154c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '354c92e9-6de6-471f-9fab-99a7d0ddf90b', 'volume_name': 'volume-354c92e9-6de6-471f-9fab-99a7d0ddf90b', 'volume_size': 2}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:33:19 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-55c5a252-4fc1-42ab-bf7d-94860a7f04b4 tempest-VolumesCloneNegativeTest-2063110591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1fbce1f-7da0-49fa-892a-2322e08799a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:33:19 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-55c5a252-4fc1-42ab-bf7d-94860a7f04b4 tempest-VolumesCloneNegativeTest-2063110591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1fbce1f-7da0-49fa-892a-2322e08799a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:33:19 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-55c5a252-4fc1-42ab-bf7d-94860a7f04b4 tempest-VolumesCloneNegativeTest-2063110591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3df7248-a2d1-488b-8c98-82d1984f558d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:33:19 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-55c5a252-4fc1-42ab-bf7d-94860a7f04b4 tempest-VolumesCloneNegativeTest-2063110591 None] Volume 354c92e9-6de6-471f-9fab-99a7d0ddf90b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-354c92e9-6de6-471f-9fab-99a7d0ddf90b', 'volume_size': 2} Jun 29 03:33:19 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-55c5a252-4fc1-42ab-bf7d-94860a7f04b4 tempest-VolumesCloneNegativeTest-2063110591 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:33:19 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-55c5a252-4fc1-42ab-bf7d-94860a7f04b4 tempest-VolumesCloneNegativeTest-2063110591 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:33:19 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-55c5a252-4fc1-42ab-bf7d-94860a7f04b4 tempest-VolumesCloneNegativeTest-2063110591 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:33:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-2038677029',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=354c92e9-6de6-471f-9fab-99a7d0ddf90b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='637784fa851a43f59397dabbd71b4609',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:33:19Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:33:19Z,use_quota=True,user_id='aeb26b2e65dc4abb9494be3245d7411c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:33:19 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-55c5a252-4fc1-42ab-bf7d-94860a7f04b4 tempest-VolumesCloneNegativeTest-2063110591 None] Creating volume 354c92e9-6de6-471f-9fab-99a7d0ddf90b {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:33:19 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-55c5a252-4fc1-42ab-bf7d-94860a7f04b4 tempest-VolumesCloneNegativeTest-2063110591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:33:19 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-55c5a252-4fc1-42ab-bf7d-94860a7f04b4 tempest-VolumesCloneNegativeTest-2063110591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:33:19 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-55c5a252-4fc1-42ab-bf7d-94860a7f04b4 tempest-VolumesCloneNegativeTest-2063110591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:33:19 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-55c5a252-4fc1-42ab-bf7d-94860a7f04b4 tempest-VolumesCloneNegativeTest-2063110591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:33:19 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-55c5a252-4fc1-42ab-bf7d-94860a7f04b4 tempest-VolumesCloneNegativeTest-2063110591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:33:19 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-55c5a252-4fc1-42ab-bf7d-94860a7f04b4 tempest-VolumesCloneNegativeTest-2063110591 None] Selected osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:33:19 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-55c5a252-4fc1-42ab-bf7d-94860a7f04b4 tempest-VolumesCloneNegativeTest-2063110591 None] casted to osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f Jun 29 03:33:19 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-55c5a252-4fc1-42ab-bf7d-94860a7f04b4 tempest-VolumesCloneNegativeTest-2063110591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-354c92e9-6de6-471f-9fab-99a7d0ddf90b 2147483648 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:33:19 devstack sudo[106540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-354c92e9-6de6-471f-9fab-99a7d0ddf90b 2147483648 Jun 29 03:33:19 devstack sudo[106540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:33:19 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-a50359f2-dd99-4708-851a-402a96b55fdf tempest-TestInstancesWithCinderVolumes-816660254 None] Acquiring lock "cinder-47a2a0b2-eddf-4fbb-a753-0e856fc86fe8-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:33:19 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-a50359f2-dd99-4708-851a-402a96b55fdf tempest-TestInstancesWithCinderVolumes-816660254 None] Lock "cinder-47a2a0b2-eddf-4fbb-a753-0e856fc86fe8-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:33:19 devstack sudo[106538]: pam_unix(sudo:session): session closed for user root Jun 29 03:33:19 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b25f19d8-f619-4f73-b89a-55c607c4bc45 tempest-AttachVolumeTestJSON-872616700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-f930343d-56d1-4c7c-92ce-4a3d26559090" returned: 0 in 0.892s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:33:19 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b25f19d8-f619-4f73-b89a-55c607c4bc45 tempest-AttachVolumeTestJSON-872616700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-f930343d-56d1-4c7c-92ce-4a3d26559090 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:33:20 devstack sudo[106548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-f930343d-56d1-4c7c-92ce-4a3d26559090 Jun 29 03:33:20 devstack sudo[106548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:33:20 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-a50359f2-dd99-4708-851a-402a96b55fdf tempest-TestInstancesWithCinderVolumes-816660254 None] Acquiring lock "cinder-quobyte-47a2a0b2-eddf-4fbb-a753-0e856fc86fe8" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:33:20 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-a50359f2-dd99-4708-851a-402a96b55fdf tempest-TestInstancesWithCinderVolumes-816660254 None] Lock "cinder-quobyte-47a2a0b2-eddf-4fbb-a753-0e856fc86fe8" acquired by "delete_volume" :: waited 0.025s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:33:20 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5325945-ac53-4c8a-a511-17a80d45a985]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:33:20 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a50359f2-dd99-4708-851a-402a96b55fdf tempest-TestInstancesWithCinderVolumes-816660254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-47a2a0b2-eddf-4fbb-a753-0e856fc86fe8 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:33:20 devstack sudo[106555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-47a2a0b2-eddf-4fbb-a753-0e856fc86fe8 Jun 29 03:33:20 devstack sudo[106555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:33:20 devstack sudo[106540]: pam_unix(sudo:session): session closed for user root Jun 29 03:33:20 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-55c5a252-4fc1-42ab-bf7d-94860a7f04b4 tempest-VolumesCloneNegativeTest-2063110591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-354c92e9-6de6-471f-9fab-99a7d0ddf90b 2147483648" returned: 0 in 1.353s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:33:20 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-55c5a252-4fc1-42ab-bf7d-94860a7f04b4 tempest-VolumesCloneNegativeTest-2063110591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-354c92e9-6de6-471f-9fab-99a7d0ddf90b {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:33:20 devstack sudo[106561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-354c92e9-6de6-471f-9fab-99a7d0ddf90b Jun 29 03:33:20 devstack sudo[106561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:33:20 devstack sudo[106548]: pam_unix(sudo:session): session closed for user root Jun 29 03:33:20 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b25f19d8-f619-4f73-b89a-55c607c4bc45 tempest-AttachVolumeTestJSON-872616700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-f930343d-56d1-4c7c-92ce-4a3d26559090" returned: 0 in 0.997s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:33:21 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-b25f19d8-f619-4f73-b89a-55c607c4bc45 tempest-AttachVolumeTestJSON-872616700 None] Lock "cinder-quobyte-f930343d-56d1-4c7c-92ce-4a3d26559090" released by "delete_volume" :: held 1.951s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:33:21 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-b25f19d8-f619-4f73-b89a-55c607c4bc45 tempest-AttachVolumeTestJSON-872616700 None] Created reservations ['cbdca29c-7ee2-4281-94d1-144d06799e81', 'fda8a756-b0a0-4907-bc12-002663dff85f', 'fb9a940f-66df-4539-bc76-ac2bbdfa03d1', 'abcbcfea-8526-477d-9caa-0c1bb46e1cf6'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:33:21 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-b25f19d8-f619-4f73-b89a-55c607c4bc45 tempest-AttachVolumeTestJSON-872616700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:33:21 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-b25f19d8-f619-4f73-b89a-55c607c4bc45 tempest-AttachVolumeTestJSON-872616700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:33:21 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-b25f19d8-f619-4f73-b89a-55c607c4bc45 tempest-AttachVolumeTestJSON-872616700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:33:21 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-b25f19d8-f619-4f73-b89a-55c607c4bc45 tempest-AttachVolumeTestJSON-872616700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:33:21 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-b25f19d8-f619-4f73-b89a-55c607c4bc45 tempest-AttachVolumeTestJSON-872616700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:33:21 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b25f19d8-f619-4f73-b89a-55c607c4bc45 tempest-AttachVolumeTestJSON-872616700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:33:21 devstack sudo[106566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf Jun 29 03:33:21 devstack sudo[106566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:33:21 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-43aee95e-0622-4d51-aea7-3f19f18ac808 tempest-AttachVolumeTestJSON-872616700 None] Acquiring lock "cinder-33717436-5fe0-4ada-a731-379bb543792c-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:33:21 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-43aee95e-0622-4d51-aea7-3f19f18ac808 tempest-AttachVolumeTestJSON-872616700 None] Lock "cinder-33717436-5fe0-4ada-a731-379bb543792c-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:33:21 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-43aee95e-0622-4d51-aea7-3f19f18ac808 tempest-AttachVolumeTestJSON-872616700 None] Acquiring lock "cinder-quobyte-33717436-5fe0-4ada-a731-379bb543792c" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:33:21 devstack sudo[106555]: pam_unix(sudo:session): session closed for user root Jun 29 03:33:21 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-43aee95e-0622-4d51-aea7-3f19f18ac808 tempest-AttachVolumeTestJSON-872616700 None] Lock "cinder-quobyte-33717436-5fe0-4ada-a731-379bb543792c" acquired by "delete_volume" :: waited 0.025s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:33:21 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a50359f2-dd99-4708-851a-402a96b55fdf tempest-TestInstancesWithCinderVolumes-816660254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-47a2a0b2-eddf-4fbb-a753-0e856fc86fe8" returned: 0 in 1.426s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:33:21 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a50359f2-dd99-4708-851a-402a96b55fdf tempest-TestInstancesWithCinderVolumes-816660254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-47a2a0b2-eddf-4fbb-a753-0e856fc86fe8 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:33:21 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ed86dab-f77d-4b9d-affb-43751fa1c24d]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:33:21 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-43aee95e-0622-4d51-aea7-3f19f18ac808 tempest-AttachVolumeTestJSON-872616700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-33717436-5fe0-4ada-a731-379bb543792c {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:33:21 devstack sudo[106569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-47a2a0b2-eddf-4fbb-a753-0e856fc86fe8 Jun 29 03:33:21 devstack sudo[106569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:33:21 devstack sudo[106570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-33717436-5fe0-4ada-a731-379bb543792c Jun 29 03:33:21 devstack sudo[106570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:33:21 devstack sudo[106561]: pam_unix(sudo:session): session closed for user root Jun 29 03:33:21 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-55c5a252-4fc1-42ab-bf7d-94860a7f04b4 tempest-VolumesCloneNegativeTest-2063110591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-354c92e9-6de6-471f-9fab-99a7d0ddf90b" returned: 0 in 1.223s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:33:21 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-55c5a252-4fc1-42ab-bf7d-94860a7f04b4 tempest-VolumesCloneNegativeTest-2063110591 None] <== create_volume: return (2661ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:33:21 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-55c5a252-4fc1-42ab-bf7d-94860a7f04b4 tempest-VolumesCloneNegativeTest-2063110591 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.664s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:33:22 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-55c5a252-4fc1-42ab-bf7d-94860a7f04b4 tempest-VolumesCloneNegativeTest-2063110591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3df7248-a2d1-488b-8c98-82d1984f558d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-354c92e9-6de6-471f-9fab-99a7d0ddf90b', 'volume_size': 2}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:33:22 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-55c5a252-4fc1-42ab-bf7d-94860a7f04b4 tempest-VolumesCloneNegativeTest-2063110591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2865772-30e2-45c3-89e3-3335f9e93905) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:33:22 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-55c5a252-4fc1-42ab-bf7d-94860a7f04b4 tempest-VolumesCloneNegativeTest-2063110591 None] Volume volume-354c92e9-6de6-471f-9fab-99a7d0ddf90b (354c92e9-6de6-471f-9fab-99a7d0ddf90b): created successfully Jun 29 03:33:22 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-55c5a252-4fc1-42ab-bf7d-94860a7f04b4 tempest-VolumesCloneNegativeTest-2063110591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2865772-30e2-45c3-89e3-3335f9e93905) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:33:22 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-55c5a252-4fc1-42ab-bf7d-94860a7f04b4 tempest-VolumesCloneNegativeTest-2063110591 None] Flow 'volume_create_manager' (23e77cae-bcee-42e0-bda1-82e768920d1e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:33:22 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-55c5a252-4fc1-42ab-bf7d-94860a7f04b4 tempest-VolumesCloneNegativeTest-2063110591 None] Created volume successfully. Jun 29 03:33:22 devstack sudo[106566]: pam_unix(sudo:session): session closed for user root Jun 29 03:33:22 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b25f19d8-f619-4f73-b89a-55c607c4bc45 tempest-AttachVolumeTestJSON-872616700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf" returned: 0 in 0.985s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:33:22 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-b25f19d8-f619-4f73-b89a-55c607c4bc45 tempest-AttachVolumeTestJSON-872616700 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:33:22 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-b25f19d8-f619-4f73-b89a-55c607c4bc45 tempest-AttachVolumeTestJSON-872616700 None] Deleted volume successfully. Jun 29 03:33:22 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-b25f19d8-f619-4f73-b89a-55c607c4bc45 tempest-AttachVolumeTestJSON-872616700 None] Lock "cinder-f930343d-56d1-4c7c-92ce-4a3d26559090-delete_volume" released by "delete_volume" :: held 3.346s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:33:22 devstack sudo[106569]: pam_unix(sudo:session): session closed for user root Jun 29 03:33:22 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a50359f2-dd99-4708-851a-402a96b55fdf tempest-TestInstancesWithCinderVolumes-816660254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-47a2a0b2-eddf-4fbb-a753-0e856fc86fe8" returned: 0 in 1.002s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:33:22 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-a50359f2-dd99-4708-851a-402a96b55fdf tempest-TestInstancesWithCinderVolumes-816660254 None] Lock "cinder-quobyte-47a2a0b2-eddf-4fbb-a753-0e856fc86fe8" released by "delete_volume" :: held 2.508s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:33:22 devstack cinder-volume[93468]: WARNING cinder.quota [None req-a50359f2-dd99-4708-851a-402a96b55fdf tempest-TestInstancesWithCinderVolumes-816660254 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1615408148-652842405 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1615408148-652842405, it is now deprecated. Please use the default quota class for default quota. Jun 29 03:33:22 devstack cinder-volume[93468]: WARNING cinder.quota [None req-a50359f2-dd99-4708-851a-402a96b55fdf tempest-TestInstancesWithCinderVolumes-816660254 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1615408148-652842405 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1615408148-652842405, it is now deprecated. Please use the default quota class for default quota. Jun 29 03:33:22 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-a50359f2-dd99-4708-851a-402a96b55fdf tempest-TestInstancesWithCinderVolumes-816660254 None] Created reservations ['1d4071c0-81d2-42d6-becc-cb35024ca755', '4b857c07-89ed-43d2-93b2-0fdabaf91441', '6a6cc3c4-856c-4630-8aa6-afe71965fd66', 'b7e226c7-1190-4987-bc92-caa5c1b964be'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:33:22 devstack sudo[106570]: pam_unix(sudo:session): session closed for user root Jun 29 03:33:22 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-43aee95e-0622-4d51-aea7-3f19f18ac808 tempest-AttachVolumeTestJSON-872616700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-33717436-5fe0-4ada-a731-379bb543792c" returned: 0 in 1.135s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:33:22 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-43aee95e-0622-4d51-aea7-3f19f18ac808 tempest-AttachVolumeTestJSON-872616700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-33717436-5fe0-4ada-a731-379bb543792c {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:33:22 devstack sudo[106581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-33717436-5fe0-4ada-a731-379bb543792c Jun 29 03:33:22 devstack sudo[106581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:33:22 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-08b05728-e684-4467-86ab-aaded9f6f35d tempest-VolumesCloneNegativeTest-2063110591 None] Acquiring lock "cinder-354c92e9-6de6-471f-9fab-99a7d0ddf90b-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:33:22 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-a50359f2-dd99-4708-851a-402a96b55fdf tempest-TestInstancesWithCinderVolumes-816660254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:33:22 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-a50359f2-dd99-4708-851a-402a96b55fdf tempest-TestInstancesWithCinderVolumes-816660254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:33:22 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-a50359f2-dd99-4708-851a-402a96b55fdf tempest-TestInstancesWithCinderVolumes-816660254 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:33:22 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-a50359f2-dd99-4708-851a-402a96b55fdf tempest-TestInstancesWithCinderVolumes-816660254 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:33:22 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-a50359f2-dd99-4708-851a-402a96b55fdf tempest-TestInstancesWithCinderVolumes-816660254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:33:22 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a50359f2-dd99-4708-851a-402a96b55fdf tempest-TestInstancesWithCinderVolumes-816660254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:33:22 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-08b05728-e684-4467-86ab-aaded9f6f35d tempest-VolumesCloneNegativeTest-2063110591 None] Lock "cinder-354c92e9-6de6-471f-9fab-99a7d0ddf90b-delete_volume" acquired by "delete_volume" :: waited 0.085s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:33:22 devstack sudo[106585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf Jun 29 03:33:22 devstack sudo[106585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:33:22 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-08b05728-e684-4467-86ab-aaded9f6f35d tempest-VolumesCloneNegativeTest-2063110591 None] Acquiring lock "cinder-quobyte-354c92e9-6de6-471f-9fab-99a7d0ddf90b" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:33:22 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-08b05728-e684-4467-86ab-aaded9f6f35d tempest-VolumesCloneNegativeTest-2063110591 None] Lock "cinder-quobyte-354c92e9-6de6-471f-9fab-99a7d0ddf90b" acquired by "delete_volume" :: waited 0.027s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:33:23 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[966faa8a-4f46-4ba9-817d-c147f8b10761]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:33:23 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-08b05728-e684-4467-86ab-aaded9f6f35d tempest-VolumesCloneNegativeTest-2063110591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-354c92e9-6de6-471f-9fab-99a7d0ddf90b {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:33:23 devstack sudo[106589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-354c92e9-6de6-471f-9fab-99a7d0ddf90b Jun 29 03:33:23 devstack sudo[106589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:33:23 devstack sudo[106581]: pam_unix(sudo:session): session closed for user root Jun 29 03:33:23 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-43aee95e-0622-4d51-aea7-3f19f18ac808 tempest-AttachVolumeTestJSON-872616700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-33717436-5fe0-4ada-a731-379bb543792c" returned: 0 in 0.931s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:33:23 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-43aee95e-0622-4d51-aea7-3f19f18ac808 tempest-AttachVolumeTestJSON-872616700 None] Lock "cinder-quobyte-33717436-5fe0-4ada-a731-379bb543792c" released by "delete_volume" :: held 2.140s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:33:23 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-43aee95e-0622-4d51-aea7-3f19f18ac808 tempest-AttachVolumeTestJSON-872616700 None] Created reservations ['9b45109d-ede0-45ed-a210-21f9ed8e4b0a', '0b8111c7-1578-4c6a-9af6-5920f3770800', '87c109ca-2e8d-489f-9722-bbd79dbc6987', 'f7f7da9b-55f0-4125-a277-897e6faaada7'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:33:23 devstack sudo[106585]: pam_unix(sudo:session): session closed for user root Jun 29 03:33:23 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a50359f2-dd99-4708-851a-402a96b55fdf tempest-TestInstancesWithCinderVolumes-816660254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf" returned: 0 in 0.939s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:33:23 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-a50359f2-dd99-4708-851a-402a96b55fdf tempest-TestInstancesWithCinderVolumes-816660254 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:33:23 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-a50359f2-dd99-4708-851a-402a96b55fdf tempest-TestInstancesWithCinderVolumes-816660254 None] Deleted volume successfully. Jun 29 03:33:23 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-43aee95e-0622-4d51-aea7-3f19f18ac808 tempest-AttachVolumeTestJSON-872616700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:33:23 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-43aee95e-0622-4d51-aea7-3f19f18ac808 tempest-AttachVolumeTestJSON-872616700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:33:23 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-43aee95e-0622-4d51-aea7-3f19f18ac808 tempest-AttachVolumeTestJSON-872616700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:33:23 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-43aee95e-0622-4d51-aea7-3f19f18ac808 tempest-AttachVolumeTestJSON-872616700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:33:23 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-43aee95e-0622-4d51-aea7-3f19f18ac808 tempest-AttachVolumeTestJSON-872616700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:33:23 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-43aee95e-0622-4d51-aea7-3f19f18ac808 tempest-AttachVolumeTestJSON-872616700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:33:23 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-a50359f2-dd99-4708-851a-402a96b55fdf tempest-TestInstancesWithCinderVolumes-816660254 None] Lock "cinder-47a2a0b2-eddf-4fbb-a753-0e856fc86fe8-delete_volume" released by "delete_volume" :: held 3.944s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:33:23 devstack sudo[106610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf Jun 29 03:33:23 devstack sudo[106610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:33:24 devstack sudo[106589]: pam_unix(sudo:session): session closed for user root Jun 29 03:33:24 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-08b05728-e684-4467-86ab-aaded9f6f35d tempest-VolumesCloneNegativeTest-2063110591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-354c92e9-6de6-471f-9fab-99a7d0ddf90b" returned: 0 in 1.018s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:33:24 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-08b05728-e684-4467-86ab-aaded9f6f35d tempest-VolumesCloneNegativeTest-2063110591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-354c92e9-6de6-471f-9fab-99a7d0ddf90b {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:33:24 devstack sudo[106612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-354c92e9-6de6-471f-9fab-99a7d0ddf90b Jun 29 03:33:24 devstack sudo[106612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:33:24 devstack sudo[106610]: pam_unix(sudo:session): session closed for user root Jun 29 03:33:24 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-43aee95e-0622-4d51-aea7-3f19f18ac808 tempest-AttachVolumeTestJSON-872616700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf" returned: 0 in 0.688s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:33:24 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-43aee95e-0622-4d51-aea7-3f19f18ac808 tempest-AttachVolumeTestJSON-872616700 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:33:24 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-43aee95e-0622-4d51-aea7-3f19f18ac808 tempest-AttachVolumeTestJSON-872616700 None] Deleted volume successfully. Jun 29 03:33:24 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-43aee95e-0622-4d51-aea7-3f19f18ac808 tempest-AttachVolumeTestJSON-872616700 None] Lock "cinder-33717436-5fe0-4ada-a731-379bb543792c-delete_volume" released by "delete_volume" :: held 3.199s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:33:24 devstack sudo[106612]: pam_unix(sudo:session): session closed for user root Jun 29 03:33:24 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-08b05728-e684-4467-86ab-aaded9f6f35d tempest-VolumesCloneNegativeTest-2063110591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-354c92e9-6de6-471f-9fab-99a7d0ddf90b" returned: 0 in 0.713s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:33:24 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-08b05728-e684-4467-86ab-aaded9f6f35d tempest-VolumesCloneNegativeTest-2063110591 None] Lock "cinder-quobyte-354c92e9-6de6-471f-9fab-99a7d0ddf90b" released by "delete_volume" :: held 1.801s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:33:24 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-08b05728-e684-4467-86ab-aaded9f6f35d tempest-VolumesCloneNegativeTest-2063110591 None] Created reservations ['3a206e61-751c-4060-902d-5974c2136077', 'f6805791-2ca9-43f9-819f-9f6b1e541fb3', '6b688198-5cfe-4e04-b5f0-8fb9862ea12e', 'd0121780-3da0-402c-88cd-b05b77168403'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:33:24 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-a1a15506-9233-4c37-8e40-2af05069c03e tempest-AttachVolumeTestJSON-872616700 None] Acquiring lock "cinder-12adcf13-1f15-44ad-a1b7-8385c5fe549d-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:33:24 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-08b05728-e684-4467-86ab-aaded9f6f35d tempest-VolumesCloneNegativeTest-2063110591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:33:24 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-08b05728-e684-4467-86ab-aaded9f6f35d tempest-VolumesCloneNegativeTest-2063110591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:33:24 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-08b05728-e684-4467-86ab-aaded9f6f35d tempest-VolumesCloneNegativeTest-2063110591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:33:24 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-08b05728-e684-4467-86ab-aaded9f6f35d tempest-VolumesCloneNegativeTest-2063110591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:33:24 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-08b05728-e684-4467-86ab-aaded9f6f35d tempest-VolumesCloneNegativeTest-2063110591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:33:24 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-08b05728-e684-4467-86ab-aaded9f6f35d tempest-VolumesCloneNegativeTest-2063110591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:33:24 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-a1a15506-9233-4c37-8e40-2af05069c03e tempest-AttachVolumeTestJSON-872616700 None] Lock "cinder-12adcf13-1f15-44ad-a1b7-8385c5fe549d-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:33:24 devstack sudo[106616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf Jun 29 03:33:24 devstack sudo[106616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:33:25 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-a1a15506-9233-4c37-8e40-2af05069c03e tempest-AttachVolumeTestJSON-872616700 None] Acquiring lock "cinder-quobyte-12adcf13-1f15-44ad-a1b7-8385c5fe549d" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:33:25 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-a1a15506-9233-4c37-8e40-2af05069c03e tempest-AttachVolumeTestJSON-872616700 None] Lock "cinder-quobyte-12adcf13-1f15-44ad-a1b7-8385c5fe549d" acquired by "delete_volume" :: waited 0.027s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:33:25 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[41dac2eb-a8d9-438d-91cd-fd113899e4da]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:33:25 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a1a15506-9233-4c37-8e40-2af05069c03e tempest-AttachVolumeTestJSON-872616700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-12adcf13-1f15-44ad-a1b7-8385c5fe549d {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:33:25 devstack sudo[106618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-12adcf13-1f15-44ad-a1b7-8385c5fe549d Jun 29 03:33:25 devstack sudo[106618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:33:25 devstack sudo[106616]: pam_unix(sudo:session): session closed for user root Jun 29 03:33:25 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-08b05728-e684-4467-86ab-aaded9f6f35d tempest-VolumesCloneNegativeTest-2063110591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf" returned: 0 in 0.849s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:33:25 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-08b05728-e684-4467-86ab-aaded9f6f35d tempest-VolumesCloneNegativeTest-2063110591 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:33:25 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-08b05728-e684-4467-86ab-aaded9f6f35d tempest-VolumesCloneNegativeTest-2063110591 None] Deleted volume successfully. Jun 29 03:33:25 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-08b05728-e684-4467-86ab-aaded9f6f35d tempest-VolumesCloneNegativeTest-2063110591 None] Lock "cinder-354c92e9-6de6-471f-9fab-99a7d0ddf90b-delete_volume" released by "delete_volume" :: held 2.960s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:33:25 devstack cinder-volume[93468]: INFO cinder.volume.manager [req-81ff2d33-cd54-4825-a47a-236d56a1ecc4 req-6f906138-15a6-4007-855a-683c061e4990 tempest-TestInstancesWithCinderVolumes-816660254 None] Terminate volume connection completed successfully. Jun 29 03:33:25 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [req-81ff2d33-cd54-4825-a47a-236d56a1ecc4 req-6f906138-15a6-4007-855a-683c061e4990 tempest-TestInstancesWithCinderVolumes-816660254 None] Deleting attachment 6ce57e1b-4507-4688-8611-f2358ab7fd8d. {{(pid=93468) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 29 03:33:26 devstack sudo[106618]: pam_unix(sudo:session): session closed for user root Jun 29 03:33:26 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a1a15506-9233-4c37-8e40-2af05069c03e tempest-AttachVolumeTestJSON-872616700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-12adcf13-1f15-44ad-a1b7-8385c5fe549d" returned: 0 in 0.988s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:33:26 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a1a15506-9233-4c37-8e40-2af05069c03e tempest-AttachVolumeTestJSON-872616700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-12adcf13-1f15-44ad-a1b7-8385c5fe549d {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:33:26 devstack sudo[106635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-12adcf13-1f15-44ad-a1b7-8385c5fe549d Jun 29 03:33:26 devstack sudo[106635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:33:26 devstack sudo[106635]: pam_unix(sudo:session): session closed for user root Jun 29 03:33:26 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a1a15506-9233-4c37-8e40-2af05069c03e tempest-AttachVolumeTestJSON-872616700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-12adcf13-1f15-44ad-a1b7-8385c5fe549d" returned: 0 in 0.714s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:33:26 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-a1a15506-9233-4c37-8e40-2af05069c03e tempest-AttachVolumeTestJSON-872616700 None] Lock "cinder-quobyte-12adcf13-1f15-44ad-a1b7-8385c5fe549d" released by "delete_volume" :: held 1.765s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:33:26 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-a1a15506-9233-4c37-8e40-2af05069c03e tempest-AttachVolumeTestJSON-872616700 None] Created reservations ['cb8842ff-c48f-4257-94f4-bf10494bebcd', 'ed8fc051-af5a-4ac0-adcb-582162c5a324', '12d93cc0-57c5-458c-8b10-6710d81b6020', 'cf43069b-fd5a-472e-83d6-abf8b57792ee'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:33:26 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-a1a15506-9233-4c37-8e40-2af05069c03e tempest-AttachVolumeTestJSON-872616700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:33:26 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-a1a15506-9233-4c37-8e40-2af05069c03e tempest-AttachVolumeTestJSON-872616700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:33:26 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-a1a15506-9233-4c37-8e40-2af05069c03e tempest-AttachVolumeTestJSON-872616700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:33:26 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-a1a15506-9233-4c37-8e40-2af05069c03e tempest-AttachVolumeTestJSON-872616700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:33:26 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-a1a15506-9233-4c37-8e40-2af05069c03e tempest-AttachVolumeTestJSON-872616700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:33:26 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a1a15506-9233-4c37-8e40-2af05069c03e tempest-AttachVolumeTestJSON-872616700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:33:26 devstack sudo[106638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf Jun 29 03:33:26 devstack sudo[106638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:33:27 devstack sudo[106638]: pam_unix(sudo:session): session closed for user root Jun 29 03:33:27 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a1a15506-9233-4c37-8e40-2af05069c03e tempest-AttachVolumeTestJSON-872616700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf" returned: 0 in 0.674s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:33:27 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-a1a15506-9233-4c37-8e40-2af05069c03e tempest-AttachVolumeTestJSON-872616700 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:33:27 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-a1a15506-9233-4c37-8e40-2af05069c03e tempest-AttachVolumeTestJSON-872616700 None] Deleted volume successfully. Jun 29 03:33:27 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-a1a15506-9233-4c37-8e40-2af05069c03e tempest-AttachVolumeTestJSON-872616700 None] Lock "cinder-12adcf13-1f15-44ad-a1b7-8385c5fe549d-delete_volume" released by "delete_volume" :: held 2.721s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:33:27 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-19545466-4149-472f-8974-052b964add4f tempest-TestInstancesWithCinderVolumes-816660254 None] Acquiring lock "cinder-2f2e765d-fff0-4c4d-b402-3ec90d0d609c-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:33:27 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-19545466-4149-472f-8974-052b964add4f tempest-TestInstancesWithCinderVolumes-816660254 None] Lock "cinder-2f2e765d-fff0-4c4d-b402-3ec90d0d609c-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:33:27 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-19545466-4149-472f-8974-052b964add4f tempest-TestInstancesWithCinderVolumes-816660254 None] Acquiring lock "cinder-quobyte-2f2e765d-fff0-4c4d-b402-3ec90d0d609c" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:33:27 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-19545466-4149-472f-8974-052b964add4f tempest-TestInstancesWithCinderVolumes-816660254 None] Lock "cinder-quobyte-2f2e765d-fff0-4c4d-b402-3ec90d0d609c" acquired by "delete_volume" :: waited 0.029s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:33:27 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[abadfdc1-b04b-41a1-9a9b-4d7468e4b2be]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:33:27 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-19545466-4149-472f-8974-052b964add4f tempest-TestInstancesWithCinderVolumes-816660254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-2f2e765d-fff0-4c4d-b402-3ec90d0d609c {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:33:28 devstack sudo[106641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-2f2e765d-fff0-4c4d-b402-3ec90d0d609c Jun 29 03:33:28 devstack sudo[106641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:33:28 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-dee98290-cbdf-4379-a521-9c56c18b1989 tempest-VolumesGetTest-1078145542 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:33:28 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-dee98290-cbdf-4379-a521-9c56c18b1989 tempest-VolumesGetTest-1078145542 None] Flow 'volume_create_manager' (65964de3-0992-4be2-96dd-c4fdfc48dbb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:33:28 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-dee98290-cbdf-4379-a521-9c56c18b1989 tempest-VolumesGetTest-1078145542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7380bf0b-fe68-4a56-a50b-eb20832dc7ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:33:28 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-dee98290-cbdf-4379-a521-9c56c18b1989 tempest-VolumesGetTest-1078145542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7380bf0b-fe68-4a56-a50b-eb20832dc7ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:33:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-68427086',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ef037ac-7b1f-45a1-a73e-aaa0a2629df3,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='e640ff4d86d542b88f2dba18116829b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:33:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:33:29Z,use_quota=True,user_id='26202c1ba10d4b91882e33e8c46b1802',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:33:28 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-dee98290-cbdf-4379-a521-9c56c18b1989 tempest-VolumesGetTest-1078145542 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cde85aa0-511b-409f-8e70-3236200a1ac0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:33:28 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-dee98290-cbdf-4379-a521-9c56c18b1989 tempest-VolumesGetTest-1078145542 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cde85aa0-511b-409f-8e70-3236200a1ac0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:33:28 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-dee98290-cbdf-4379-a521-9c56c18b1989 tempest-VolumesGetTest-1078145542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (305d3a17-b100-423a-a4e3-24dcba42efa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:33:28 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-dee98290-cbdf-4379-a521-9c56c18b1989 tempest-VolumesGetTest-1078145542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (305d3a17-b100-423a-a4e3-24dcba42efa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ef037ac-7b1f-45a1-a73e-aaa0a2629df3', 'volume_name': 'volume-3ef037ac-7b1f-45a1-a73e-aaa0a2629df3', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:33:28 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-dee98290-cbdf-4379-a521-9c56c18b1989 tempest-VolumesGetTest-1078145542 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c8d790a-0ed3-4a0f-a58c-df5c6fc203b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:33:28 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-dee98290-cbdf-4379-a521-9c56c18b1989 tempest-VolumesGetTest-1078145542 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c8d790a-0ed3-4a0f-a58c-df5c6fc203b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:33:28 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-dee98290-cbdf-4379-a521-9c56c18b1989 tempest-VolumesGetTest-1078145542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (551dedab-3c23-49cb-87ef-f9f6c41e2f60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:33:28 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-dee98290-cbdf-4379-a521-9c56c18b1989 tempest-VolumesGetTest-1078145542 None] Volume 3ef037ac-7b1f-45a1-a73e-aaa0a2629df3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ef037ac-7b1f-45a1-a73e-aaa0a2629df3', 'volume_size': 1} Jun 29 03:33:28 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-dee98290-cbdf-4379-a521-9c56c18b1989 tempest-VolumesGetTest-1078145542 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:33:28 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-dee98290-cbdf-4379-a521-9c56c18b1989 tempest-VolumesGetTest-1078145542 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:33:28 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-dee98290-cbdf-4379-a521-9c56c18b1989 tempest-VolumesGetTest-1078145542 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:33:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-68427086',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ef037ac-7b1f-45a1-a73e-aaa0a2629df3,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='e640ff4d86d542b88f2dba18116829b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:33:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:33:29Z,use_quota=True,user_id='26202c1ba10d4b91882e33e8c46b1802',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:33:28 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-dee98290-cbdf-4379-a521-9c56c18b1989 tempest-VolumesGetTest-1078145542 None] Creating volume 3ef037ac-7b1f-45a1-a73e-aaa0a2629df3 {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:33:28 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-dee98290-cbdf-4379-a521-9c56c18b1989 tempest-VolumesGetTest-1078145542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:33:28 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-dee98290-cbdf-4379-a521-9c56c18b1989 tempest-VolumesGetTest-1078145542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:33:28 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-dee98290-cbdf-4379-a521-9c56c18b1989 tempest-VolumesGetTest-1078145542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:33:28 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-dee98290-cbdf-4379-a521-9c56c18b1989 tempest-VolumesGetTest-1078145542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:33:28 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-dee98290-cbdf-4379-a521-9c56c18b1989 tempest-VolumesGetTest-1078145542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:33:28 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-dee98290-cbdf-4379-a521-9c56c18b1989 tempest-VolumesGetTest-1078145542 None] Selected osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:33:28 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-dee98290-cbdf-4379-a521-9c56c18b1989 tempest-VolumesGetTest-1078145542 None] casted to osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f Jun 29 03:33:28 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-dee98290-cbdf-4379-a521-9c56c18b1989 tempest-VolumesGetTest-1078145542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-3ef037ac-7b1f-45a1-a73e-aaa0a2629df3 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:33:28 devstack sudo[106643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-3ef037ac-7b1f-45a1-a73e-aaa0a2629df3 1073741824 Jun 29 03:33:28 devstack sudo[106643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:33:29 devstack sudo[106641]: pam_unix(sudo:session): session closed for user root Jun 29 03:33:29 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-19545466-4149-472f-8974-052b964add4f tempest-TestInstancesWithCinderVolumes-816660254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-2f2e765d-fff0-4c4d-b402-3ec90d0d609c" returned: 0 in 1.386s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:33:29 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-19545466-4149-472f-8974-052b964add4f tempest-TestInstancesWithCinderVolumes-816660254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-2f2e765d-fff0-4c4d-b402-3ec90d0d609c {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:33:29 devstack sudo[106649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-2f2e765d-fff0-4c4d-b402-3ec90d0d609c Jun 29 03:33:29 devstack sudo[106649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:33:30 devstack sudo[106649]: pam_unix(sudo:session): session closed for user root Jun 29 03:33:30 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-19545466-4149-472f-8974-052b964add4f tempest-TestInstancesWithCinderVolumes-816660254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-2f2e765d-fff0-4c4d-b402-3ec90d0d609c" returned: 0 in 0.977s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:33:30 devstack sudo[106643]: pam_unix(sudo:session): session closed for user root Jun 29 03:33:30 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-dee98290-cbdf-4379-a521-9c56c18b1989 tempest-VolumesGetTest-1078145542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-3ef037ac-7b1f-45a1-a73e-aaa0a2629df3 1073741824" returned: 0 in 1.456s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:33:30 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-19545466-4149-472f-8974-052b964add4f tempest-TestInstancesWithCinderVolumes-816660254 None] Lock "cinder-quobyte-2f2e765d-fff0-4c4d-b402-3ec90d0d609c" released by "delete_volume" :: held 2.442s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:33:30 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-dee98290-cbdf-4379-a521-9c56c18b1989 tempest-VolumesGetTest-1078145542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-3ef037ac-7b1f-45a1-a73e-aaa0a2629df3 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:33:30 devstack cinder-volume[93468]: WARNING cinder.quota [None req-19545466-4149-472f-8974-052b964add4f tempest-TestInstancesWithCinderVolumes-816660254 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-773978677-292391236 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-773978677-292391236, it is now deprecated. Please use the default quota class for default quota. Jun 29 03:33:30 devstack cinder-volume[93468]: WARNING cinder.quota [None req-19545466-4149-472f-8974-052b964add4f tempest-TestInstancesWithCinderVolumes-816660254 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-773978677-292391236 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-773978677-292391236, it is now deprecated. Please use the default quota class for default quota. Jun 29 03:33:30 devstack sudo[106657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-3ef037ac-7b1f-45a1-a73e-aaa0a2629df3 Jun 29 03:33:30 devstack sudo[106657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:33:30 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-19545466-4149-472f-8974-052b964add4f tempest-TestInstancesWithCinderVolumes-816660254 None] Created reservations ['f9a787ec-c21b-4538-beab-9ff26277c99a', 'bbeac84f-0946-4eae-91d6-1631265d0979', '735c99de-c7ca-46ae-946e-5a352a1248ab', '9cded1dd-b1cf-4b55-a356-f1749b43ae38'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:33:30 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-19545466-4149-472f-8974-052b964add4f tempest-TestInstancesWithCinderVolumes-816660254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:33:30 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-19545466-4149-472f-8974-052b964add4f tempest-TestInstancesWithCinderVolumes-816660254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:33:30 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-19545466-4149-472f-8974-052b964add4f tempest-TestInstancesWithCinderVolumes-816660254 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:33:30 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-19545466-4149-472f-8974-052b964add4f tempest-TestInstancesWithCinderVolumes-816660254 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:33:30 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-19545466-4149-472f-8974-052b964add4f tempest-TestInstancesWithCinderVolumes-816660254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:33:30 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-19545466-4149-472f-8974-052b964add4f tempest-TestInstancesWithCinderVolumes-816660254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:33:30 devstack sudo[106659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf Jun 29 03:33:30 devstack sudo[106659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:33:31 devstack sudo[106657]: pam_unix(sudo:session): session closed for user root Jun 29 03:33:31 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-dee98290-cbdf-4379-a521-9c56c18b1989 tempest-VolumesGetTest-1078145542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-3ef037ac-7b1f-45a1-a73e-aaa0a2629df3" returned: 0 in 1.011s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:33:31 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-dee98290-cbdf-4379-a521-9c56c18b1989 tempest-VolumesGetTest-1078145542 None] <== create_volume: return (2523ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:33:31 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-dee98290-cbdf-4379-a521-9c56c18b1989 tempest-VolumesGetTest-1078145542 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.526s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:33:31 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-dee98290-cbdf-4379-a521-9c56c18b1989 tempest-VolumesGetTest-1078145542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (551dedab-3c23-49cb-87ef-f9f6c41e2f60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ef037ac-7b1f-45a1-a73e-aaa0a2629df3', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:33:31 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-dee98290-cbdf-4379-a521-9c56c18b1989 tempest-VolumesGetTest-1078145542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9c7d1c8-bfcb-40ba-9d23-f1f24f11cd24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:33:31 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-dee98290-cbdf-4379-a521-9c56c18b1989 tempest-VolumesGetTest-1078145542 None] Volume volume-3ef037ac-7b1f-45a1-a73e-aaa0a2629df3 (3ef037ac-7b1f-45a1-a73e-aaa0a2629df3): created successfully Jun 29 03:33:31 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-dee98290-cbdf-4379-a521-9c56c18b1989 tempest-VolumesGetTest-1078145542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9c7d1c8-bfcb-40ba-9d23-f1f24f11cd24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:33:31 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-dee98290-cbdf-4379-a521-9c56c18b1989 tempest-VolumesGetTest-1078145542 None] Flow 'volume_create_manager' (65964de3-0992-4be2-96dd-c4fdfc48dbb2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:33:31 devstack sudo[106659]: pam_unix(sudo:session): session closed for user root Jun 29 03:33:31 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-19545466-4149-472f-8974-052b964add4f tempest-TestInstancesWithCinderVolumes-816660254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf" returned: 0 in 0.905s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:33:31 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-19545466-4149-472f-8974-052b964add4f tempest-TestInstancesWithCinderVolumes-816660254 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:33:31 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-19545466-4149-472f-8974-052b964add4f tempest-TestInstancesWithCinderVolumes-816660254 None] Deleted volume successfully. Jun 29 03:33:31 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-dee98290-cbdf-4379-a521-9c56c18b1989 tempest-VolumesGetTest-1078145542 None] Created volume successfully. Jun 29 03:33:31 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-19545466-4149-472f-8974-052b964add4f tempest-TestInstancesWithCinderVolumes-816660254 None] Lock "cinder-2f2e765d-fff0-4c4d-b402-3ec90d0d609c-delete_volume" released by "delete_volume" :: held 3.714s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:33:33 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b243c55-565a-4929-ac78-c3c9453c0fb5 tempest-VolumesGetTest-1078145542 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:33:33 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-6b243c55-565a-4929-ac78-c3c9453c0fb5 tempest-VolumesGetTest-1078145542 None] Flow 'volume_create_manager' (2b589641-143e-4fc8-bb50-3a9376390ea4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:33:33 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-6b243c55-565a-4929-ac78-c3c9453c0fb5 tempest-VolumesGetTest-1078145542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14544fb8-a5df-4b68-ba43-186259aaf9af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:33:33 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-6b243c55-565a-4929-ac78-c3c9453c0fb5 tempest-VolumesGetTest-1078145542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14544fb8-a5df-4b68-ba43-186259aaf9af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:33:33Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2112158206',display_name='tempest-VolumesGetTest-Volume-1795392600',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c34b2ad3-61b1-4918-929a-ba768b5d0037,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e640ff4d86d542b88f2dba18116829b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:33:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:33:33Z,use_quota=True,user_id='26202c1ba10d4b91882e33e8c46b1802',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:33:33 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-6b243c55-565a-4929-ac78-c3c9453c0fb5 tempest-VolumesGetTest-1078145542 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10e28798-e093-455b-964e-5af7c688607e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:33:33 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-6b243c55-565a-4929-ac78-c3c9453c0fb5 tempest-VolumesGetTest-1078145542 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10e28798-e093-455b-964e-5af7c688607e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:33:33 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-6b243c55-565a-4929-ac78-c3c9453c0fb5 tempest-VolumesGetTest-1078145542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4522a132-235d-4937-878e-ac3c8c886ae2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:33:33 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-6b243c55-565a-4929-ac78-c3c9453c0fb5 tempest-VolumesGetTest-1078145542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4522a132-235d-4937-878e-ac3c8c886ae2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c34b2ad3-61b1-4918-929a-ba768b5d0037', 'volume_name': 'volume-c34b2ad3-61b1-4918-929a-ba768b5d0037', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:33:33 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-6b243c55-565a-4929-ac78-c3c9453c0fb5 tempest-VolumesGetTest-1078145542 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcc04267-0111-4fbe-ac2a-35414eabea81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:33:33 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-6b243c55-565a-4929-ac78-c3c9453c0fb5 tempest-VolumesGetTest-1078145542 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcc04267-0111-4fbe-ac2a-35414eabea81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:33:33 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-6b243c55-565a-4929-ac78-c3c9453c0fb5 tempest-VolumesGetTest-1078145542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69afcd70-7ef0-40ed-9cd3-b05b966590e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:33:33 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-6b243c55-565a-4929-ac78-c3c9453c0fb5 tempest-VolumesGetTest-1078145542 None] Volume c34b2ad3-61b1-4918-929a-ba768b5d0037: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c34b2ad3-61b1-4918-929a-ba768b5d0037', 'volume_size': 1} Jun 29 03:33:33 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-6b243c55-565a-4929-ac78-c3c9453c0fb5 tempest-VolumesGetTest-1078145542 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:33:33 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-6b243c55-565a-4929-ac78-c3c9453c0fb5 tempest-VolumesGetTest-1078145542 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:33:33 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-6b243c55-565a-4929-ac78-c3c9453c0fb5 tempest-VolumesGetTest-1078145542 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:33:33Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2112158206',display_name='tempest-VolumesGetTest-Volume-1795392600',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c34b2ad3-61b1-4918-929a-ba768b5d0037,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e640ff4d86d542b88f2dba18116829b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:33:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:33:33Z,use_quota=True,user_id='26202c1ba10d4b91882e33e8c46b1802',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:33:33 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-6b243c55-565a-4929-ac78-c3c9453c0fb5 tempest-VolumesGetTest-1078145542 None] Creating volume c34b2ad3-61b1-4918-929a-ba768b5d0037 {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:33:33 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-6b243c55-565a-4929-ac78-c3c9453c0fb5 tempest-VolumesGetTest-1078145542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:33:33 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-6b243c55-565a-4929-ac78-c3c9453c0fb5 tempest-VolumesGetTest-1078145542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:33:33 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-6b243c55-565a-4929-ac78-c3c9453c0fb5 tempest-VolumesGetTest-1078145542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:33:33 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-6b243c55-565a-4929-ac78-c3c9453c0fb5 tempest-VolumesGetTest-1078145542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:33:33 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-6b243c55-565a-4929-ac78-c3c9453c0fb5 tempest-VolumesGetTest-1078145542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:33:33 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-6b243c55-565a-4929-ac78-c3c9453c0fb5 tempest-VolumesGetTest-1078145542 None] Selected osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:33:33 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-6b243c55-565a-4929-ac78-c3c9453c0fb5 tempest-VolumesGetTest-1078145542 None] casted to osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f Jun 29 03:33:33 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-6b243c55-565a-4929-ac78-c3c9453c0fb5 tempest-VolumesGetTest-1078145542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-c34b2ad3-61b1-4918-929a-ba768b5d0037 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:33:33 devstack sudo[106759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-c34b2ad3-61b1-4918-929a-ba768b5d0037 1073741824 Jun 29 03:33:33 devstack sudo[106759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:33:35 devstack sudo[106759]: pam_unix(sudo:session): session closed for user root Jun 29 03:33:35 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-6b243c55-565a-4929-ac78-c3c9453c0fb5 tempest-VolumesGetTest-1078145542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-c34b2ad3-61b1-4918-929a-ba768b5d0037 1073741824" returned: 0 in 1.805s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:33:35 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-6b243c55-565a-4929-ac78-c3c9453c0fb5 tempest-VolumesGetTest-1078145542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-c34b2ad3-61b1-4918-929a-ba768b5d0037 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:33:35 devstack sudo[106880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-c34b2ad3-61b1-4918-929a-ba768b5d0037 Jun 29 03:33:35 devstack sudo[106880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:33:36 devstack sudo[106880]: pam_unix(sudo:session): session closed for user root Jun 29 03:33:36 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-6b243c55-565a-4929-ac78-c3c9453c0fb5 tempest-VolumesGetTest-1078145542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-c34b2ad3-61b1-4918-929a-ba768b5d0037" returned: 0 in 0.954s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:33:36 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-6b243c55-565a-4929-ac78-c3c9453c0fb5 tempest-VolumesGetTest-1078145542 None] <== create_volume: return (2892ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:33:36 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-6b243c55-565a-4929-ac78-c3c9453c0fb5 tempest-VolumesGetTest-1078145542 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.895s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:33:36 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-6b243c55-565a-4929-ac78-c3c9453c0fb5 tempest-VolumesGetTest-1078145542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69afcd70-7ef0-40ed-9cd3-b05b966590e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c34b2ad3-61b1-4918-929a-ba768b5d0037', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:33:36 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-6b243c55-565a-4929-ac78-c3c9453c0fb5 tempest-VolumesGetTest-1078145542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c92c9ab8-66ea-4766-9a42-90d559c0b18b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:33:36 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-6b243c55-565a-4929-ac78-c3c9453c0fb5 tempest-VolumesGetTest-1078145542 None] Volume volume-c34b2ad3-61b1-4918-929a-ba768b5d0037 (c34b2ad3-61b1-4918-929a-ba768b5d0037): created successfully Jun 29 03:33:36 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-6b243c55-565a-4929-ac78-c3c9453c0fb5 tempest-VolumesGetTest-1078145542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c92c9ab8-66ea-4766-9a42-90d559c0b18b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:33:36 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-6b243c55-565a-4929-ac78-c3c9453c0fb5 tempest-VolumesGetTest-1078145542 None] Flow 'volume_create_manager' (2b589641-143e-4fc8-bb50-3a9376390ea4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:33:36 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-6b243c55-565a-4929-ac78-c3c9453c0fb5 tempest-VolumesGetTest-1078145542 None] Created volume successfully. Jun 29 03:33:36 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-5662503a-2e2a-48c5-b645-78a8569a2bd3 tempest-VolumesGetTest-1078145542 None] Acquiring lock "cinder-c34b2ad3-61b1-4918-929a-ba768b5d0037-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:33:36 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-5662503a-2e2a-48c5-b645-78a8569a2bd3 tempest-VolumesGetTest-1078145542 None] Lock "cinder-c34b2ad3-61b1-4918-929a-ba768b5d0037-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:33:36 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-5662503a-2e2a-48c5-b645-78a8569a2bd3 tempest-VolumesGetTest-1078145542 None] Acquiring lock "cinder-quobyte-c34b2ad3-61b1-4918-929a-ba768b5d0037" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:33:36 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-5662503a-2e2a-48c5-b645-78a8569a2bd3 tempest-VolumesGetTest-1078145542 None] Lock "cinder-quobyte-c34b2ad3-61b1-4918-929a-ba768b5d0037" acquired by "delete_volume" :: waited 0.015s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:33:36 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[50a62243-9766-4470-a99d-0f7b6c24f0f0]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:33:36 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-5662503a-2e2a-48c5-b645-78a8569a2bd3 tempest-VolumesGetTest-1078145542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-c34b2ad3-61b1-4918-929a-ba768b5d0037 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:33:37 devstack sudo[106961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-c34b2ad3-61b1-4918-929a-ba768b5d0037 Jun 29 03:33:37 devstack sudo[106961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:33:37 devstack cinder-volume[93468]: INFO cinder.volume.manager [req-22b6b562-62d7-4cbb-bc44-11890fc2a591 req-0b3f69f9-75a1-4a9e-90bb-c7e58b67fef0 tempest-TestInstancesWithCinderVolumes-816660254 None] Terminate volume connection completed successfully. Jun 29 03:33:37 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [req-22b6b562-62d7-4cbb-bc44-11890fc2a591 req-0b3f69f9-75a1-4a9e-90bb-c7e58b67fef0 tempest-TestInstancesWithCinderVolumes-816660254 None] Deleting attachment 6ec4d76b-6713-44a9-b00f-3ebf55e3ae6a. {{(pid=93468) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 29 03:33:37 devstack sudo[106961]: pam_unix(sudo:session): session closed for user root Jun 29 03:33:37 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-5662503a-2e2a-48c5-b645-78a8569a2bd3 tempest-VolumesGetTest-1078145542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-c34b2ad3-61b1-4918-929a-ba768b5d0037" returned: 0 in 0.870s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:33:37 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-5662503a-2e2a-48c5-b645-78a8569a2bd3 tempest-VolumesGetTest-1078145542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-c34b2ad3-61b1-4918-929a-ba768b5d0037 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:33:37 devstack sudo[106973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-c34b2ad3-61b1-4918-929a-ba768b5d0037 Jun 29 03:33:37 devstack sudo[106973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:33:38 devstack sudo[106973]: pam_unix(sudo:session): session closed for user root Jun 29 03:33:38 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-5662503a-2e2a-48c5-b645-78a8569a2bd3 tempest-VolumesGetTest-1078145542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-c34b2ad3-61b1-4918-929a-ba768b5d0037" returned: 0 in 0.760s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:33:38 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-5662503a-2e2a-48c5-b645-78a8569a2bd3 tempest-VolumesGetTest-1078145542 None] Lock "cinder-quobyte-c34b2ad3-61b1-4918-929a-ba768b5d0037" released by "delete_volume" :: held 1.691s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:33:38 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-5662503a-2e2a-48c5-b645-78a8569a2bd3 tempest-VolumesGetTest-1078145542 None] Created reservations ['b58b62a2-12b5-4bd7-b8ef-52cfe8636047', 'cbbc1724-1a5c-4fda-b515-eaada5bcfd42', '2984d2bd-3c00-4364-a2e7-1af1597fe64a', '82a7a9be-372c-42b8-b5e7-11a7494733d4'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:33:38 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-5662503a-2e2a-48c5-b645-78a8569a2bd3 tempest-VolumesGetTest-1078145542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:33:38 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-5662503a-2e2a-48c5-b645-78a8569a2bd3 tempest-VolumesGetTest-1078145542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:33:38 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-5662503a-2e2a-48c5-b645-78a8569a2bd3 tempest-VolumesGetTest-1078145542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:33:38 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-5662503a-2e2a-48c5-b645-78a8569a2bd3 tempest-VolumesGetTest-1078145542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:33:38 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-5662503a-2e2a-48c5-b645-78a8569a2bd3 tempest-VolumesGetTest-1078145542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:33:38 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-5662503a-2e2a-48c5-b645-78a8569a2bd3 tempest-VolumesGetTest-1078145542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:33:38 devstack sudo[106982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf Jun 29 03:33:38 devstack sudo[106982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:33:39 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-96bd7db8-f5eb-4ecd-910f-54168c3fbf4a tempest-VolumesGetTest-1078145542 None] Acquiring lock "cinder-3ef037ac-7b1f-45a1-a73e-aaa0a2629df3-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:33:39 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-96bd7db8-f5eb-4ecd-910f-54168c3fbf4a tempest-VolumesGetTest-1078145542 None] Lock "cinder-3ef037ac-7b1f-45a1-a73e-aaa0a2629df3-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:33:39 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-c66f6416-0bf6-4b1f-bdf3-fcdab1e823da tempest-VolumesTestJSON-622242772 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:33:39 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-c66f6416-0bf6-4b1f-bdf3-fcdab1e823da tempest-VolumesTestJSON-622242772 None] Flow 'volume_create_manager' (01323430-5285-4d66-98a2-33015caa862f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:33:39 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-c66f6416-0bf6-4b1f-bdf3-fcdab1e823da tempest-VolumesTestJSON-622242772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9c2aa4c-d936-4b85-9b21-0bb891c952e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:33:39 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-c66f6416-0bf6-4b1f-bdf3-fcdab1e823da tempest-VolumesTestJSON-622242772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9c2aa4c-d936-4b85-9b21-0bb891c952e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:33:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-813714988',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=271256fa-0f9b-42c2-9d2f-4cefedf1226c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9e78c33ddf8c4e95b71673b212f7c6ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:33:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:33:39Z,use_quota=True,user_id='1426da3ddc324646b532de33f8d0e040',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:33:39 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-c66f6416-0bf6-4b1f-bdf3-fcdab1e823da tempest-VolumesTestJSON-622242772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e1305e5-8a93-4e30-af7d-dc7faeb9ef39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:33:39 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-c66f6416-0bf6-4b1f-bdf3-fcdab1e823da tempest-VolumesTestJSON-622242772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e1305e5-8a93-4e30-af7d-dc7faeb9ef39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:33:39 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-c66f6416-0bf6-4b1f-bdf3-fcdab1e823da tempest-VolumesTestJSON-622242772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05d99732-701c-4b6f-9325-9ab235611705) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:33:39 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-c66f6416-0bf6-4b1f-bdf3-fcdab1e823da tempest-VolumesTestJSON-622242772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05d99732-701c-4b6f-9325-9ab235611705) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '271256fa-0f9b-42c2-9d2f-4cefedf1226c', 'volume_name': 'volume-271256fa-0f9b-42c2-9d2f-4cefedf1226c', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:33:39 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-c66f6416-0bf6-4b1f-bdf3-fcdab1e823da tempest-VolumesTestJSON-622242772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25927d62-962e-4c83-bae0-14c1999b1603) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:33:39 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-c66f6416-0bf6-4b1f-bdf3-fcdab1e823da tempest-VolumesTestJSON-622242772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25927d62-962e-4c83-bae0-14c1999b1603) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:33:39 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-c66f6416-0bf6-4b1f-bdf3-fcdab1e823da tempest-VolumesTestJSON-622242772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29807cc1-9172-42a2-a88f-f1345e9ff1a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:33:39 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-c66f6416-0bf6-4b1f-bdf3-fcdab1e823da tempest-VolumesTestJSON-622242772 None] Volume 271256fa-0f9b-42c2-9d2f-4cefedf1226c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-271256fa-0f9b-42c2-9d2f-4cefedf1226c', 'volume_size': 1} Jun 29 03:33:39 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-c66f6416-0bf6-4b1f-bdf3-fcdab1e823da tempest-VolumesTestJSON-622242772 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:33:39 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-c66f6416-0bf6-4b1f-bdf3-fcdab1e823da tempest-VolumesTestJSON-622242772 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:33:39 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-c66f6416-0bf6-4b1f-bdf3-fcdab1e823da tempest-VolumesTestJSON-622242772 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:33:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-813714988',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=271256fa-0f9b-42c2-9d2f-4cefedf1226c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9e78c33ddf8c4e95b71673b212f7c6ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:33:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:33:39Z,use_quota=True,user_id='1426da3ddc324646b532de33f8d0e040',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:33:39 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-c66f6416-0bf6-4b1f-bdf3-fcdab1e823da tempest-VolumesTestJSON-622242772 None] Creating volume 271256fa-0f9b-42c2-9d2f-4cefedf1226c {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:33:39 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-c66f6416-0bf6-4b1f-bdf3-fcdab1e823da tempest-VolumesTestJSON-622242772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:33:39 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-c66f6416-0bf6-4b1f-bdf3-fcdab1e823da tempest-VolumesTestJSON-622242772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:33:39 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-c66f6416-0bf6-4b1f-bdf3-fcdab1e823da tempest-VolumesTestJSON-622242772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:33:39 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-c66f6416-0bf6-4b1f-bdf3-fcdab1e823da tempest-VolumesTestJSON-622242772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:33:39 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-c66f6416-0bf6-4b1f-bdf3-fcdab1e823da tempest-VolumesTestJSON-622242772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:33:39 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-c66f6416-0bf6-4b1f-bdf3-fcdab1e823da tempest-VolumesTestJSON-622242772 None] Selected osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:33:39 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-c66f6416-0bf6-4b1f-bdf3-fcdab1e823da tempest-VolumesTestJSON-622242772 None] casted to osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f Jun 29 03:33:39 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c66f6416-0bf6-4b1f-bdf3-fcdab1e823da tempest-VolumesTestJSON-622242772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-271256fa-0f9b-42c2-9d2f-4cefedf1226c 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:33:39 devstack sudo[107303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-271256fa-0f9b-42c2-9d2f-4cefedf1226c 1073741824 Jun 29 03:33:39 devstack sudo[107303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:33:39 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-96bd7db8-f5eb-4ecd-910f-54168c3fbf4a tempest-VolumesGetTest-1078145542 None] Acquiring lock "cinder-quobyte-3ef037ac-7b1f-45a1-a73e-aaa0a2629df3" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:33:39 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-96bd7db8-f5eb-4ecd-910f-54168c3fbf4a tempest-VolumesGetTest-1078145542 None] Lock "cinder-quobyte-3ef037ac-7b1f-45a1-a73e-aaa0a2629df3" acquired by "delete_volume" :: waited 0.018s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:33:39 devstack sudo[106982]: pam_unix(sudo:session): session closed for user root Jun 29 03:33:39 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-5662503a-2e2a-48c5-b645-78a8569a2bd3 tempest-VolumesGetTest-1078145542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf" returned: 0 in 0.822s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:33:39 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-5662503a-2e2a-48c5-b645-78a8569a2bd3 tempest-VolumesGetTest-1078145542 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:33:39 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-5662503a-2e2a-48c5-b645-78a8569a2bd3 tempest-VolumesGetTest-1078145542 None] Deleted volume successfully. Jun 29 03:33:39 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[bccf0ff5-0864-4bc7-9cfb-0233b92e8976]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:33:39 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-96bd7db8-f5eb-4ecd-910f-54168c3fbf4a tempest-VolumesGetTest-1078145542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-3ef037ac-7b1f-45a1-a73e-aaa0a2629df3 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:33:39 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-5662503a-2e2a-48c5-b645-78a8569a2bd3 tempest-VolumesGetTest-1078145542 None] Lock "cinder-c34b2ad3-61b1-4918-929a-ba768b5d0037-delete_volume" released by "delete_volume" :: held 2.785s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:33:39 devstack sudo[107307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-3ef037ac-7b1f-45a1-a73e-aaa0a2629df3 Jun 29 03:33:39 devstack sudo[107307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:33:40 devstack sudo[107307]: pam_unix(sudo:session): session closed for user root Jun 29 03:33:40 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-96bd7db8-f5eb-4ecd-910f-54168c3fbf4a tempest-VolumesGetTest-1078145542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-3ef037ac-7b1f-45a1-a73e-aaa0a2629df3" returned: 0 in 1.036s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:33:40 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-96bd7db8-f5eb-4ecd-910f-54168c3fbf4a tempest-VolumesGetTest-1078145542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-3ef037ac-7b1f-45a1-a73e-aaa0a2629df3 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:33:40 devstack sudo[107365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-3ef037ac-7b1f-45a1-a73e-aaa0a2629df3 Jun 29 03:33:40 devstack sudo[107365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:33:40 devstack sudo[107303]: pam_unix(sudo:session): session closed for user root Jun 29 03:33:40 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c66f6416-0bf6-4b1f-bdf3-fcdab1e823da tempest-VolumesTestJSON-622242772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-271256fa-0f9b-42c2-9d2f-4cefedf1226c 1073741824" returned: 0 in 1.233s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:33:40 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c66f6416-0bf6-4b1f-bdf3-fcdab1e823da tempest-VolumesTestJSON-622242772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-271256fa-0f9b-42c2-9d2f-4cefedf1226c {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:33:40 devstack sudo[107372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-271256fa-0f9b-42c2-9d2f-4cefedf1226c Jun 29 03:33:40 devstack sudo[107372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:33:41 devstack sudo[107365]: pam_unix(sudo:session): session closed for user root Jun 29 03:33:41 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-96bd7db8-f5eb-4ecd-910f-54168c3fbf4a tempest-VolumesGetTest-1078145542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-3ef037ac-7b1f-45a1-a73e-aaa0a2629df3" returned: 0 in 1.215s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:33:41 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-96bd7db8-f5eb-4ecd-910f-54168c3fbf4a tempest-VolumesGetTest-1078145542 None] Lock "cinder-quobyte-3ef037ac-7b1f-45a1-a73e-aaa0a2629df3" released by "delete_volume" :: held 2.333s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:33:41 devstack cinder-volume[93468]: DEBUG dbcounter [-] [93468] Writing DB stats cinder:SELECT=77,cinder:UPDATE=83,cinder:INSERT=20,cinder:DELETE=10 {{(pid=93468) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 29 03:33:41 devstack cinder-volume[93468]: DEBUG dbcounter [-] [93468] Writing DB stats cinder:SELECT=85,cinder:UPDATE=88,cinder:INSERT=17,cinder:DELETE=2 {{(pid=93468) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 29 03:33:41 devstack sudo[107372]: pam_unix(sudo:session): session closed for user root Jun 29 03:33:41 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c66f6416-0bf6-4b1f-bdf3-fcdab1e823da tempest-VolumesTestJSON-622242772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-271256fa-0f9b-42c2-9d2f-4cefedf1226c" returned: 0 in 1.212s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:33:41 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-c66f6416-0bf6-4b1f-bdf3-fcdab1e823da tempest-VolumesTestJSON-622242772 None] <== create_volume: return (2532ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:33:41 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-c66f6416-0bf6-4b1f-bdf3-fcdab1e823da tempest-VolumesTestJSON-622242772 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.535s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:33:41 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-96bd7db8-f5eb-4ecd-910f-54168c3fbf4a tempest-VolumesGetTest-1078145542 None] Created reservations ['d247b48e-3f9d-4dbb-9001-fc790f8ce4f2', '48929904-ada0-4627-a99d-68be5636191a', 'cb7d2c69-35e1-4518-a166-9d505ee55324', '6c48e281-7402-439a-aaad-5362a1bb0926'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:33:41 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-c66f6416-0bf6-4b1f-bdf3-fcdab1e823da tempest-VolumesTestJSON-622242772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29807cc1-9172-42a2-a88f-f1345e9ff1a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-271256fa-0f9b-42c2-9d2f-4cefedf1226c', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:33:41 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-c66f6416-0bf6-4b1f-bdf3-fcdab1e823da tempest-VolumesTestJSON-622242772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bae38361-16f2-4287-994a-8fd1dd05e62a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:33:41 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-c66f6416-0bf6-4b1f-bdf3-fcdab1e823da tempest-VolumesTestJSON-622242772 None] Volume volume-271256fa-0f9b-42c2-9d2f-4cefedf1226c (271256fa-0f9b-42c2-9d2f-4cefedf1226c): created successfully Jun 29 03:33:41 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-c66f6416-0bf6-4b1f-bdf3-fcdab1e823da tempest-VolumesTestJSON-622242772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bae38361-16f2-4287-994a-8fd1dd05e62a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:33:41 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-c66f6416-0bf6-4b1f-bdf3-fcdab1e823da tempest-VolumesTestJSON-622242772 None] Flow 'volume_create_manager' (01323430-5285-4d66-98a2-33015caa862f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:33:41 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-475acb5e-8a58-437a-8e13-dcf47fa336dc tempest-TestInstancesWithCinderVolumes-816660254 None] Acquiring lock "cinder-330e8f60-b546-42e1-b2b8-7296ced87a6d-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:33:42 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-475acb5e-8a58-437a-8e13-dcf47fa336dc tempest-TestInstancesWithCinderVolumes-816660254 None] Lock "cinder-330e8f60-b546-42e1-b2b8-7296ced87a6d-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:33:42 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-c66f6416-0bf6-4b1f-bdf3-fcdab1e823da tempest-VolumesTestJSON-622242772 None] Created volume successfully. Jun 29 03:33:42 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-96bd7db8-f5eb-4ecd-910f-54168c3fbf4a tempest-VolumesGetTest-1078145542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:33:42 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-96bd7db8-f5eb-4ecd-910f-54168c3fbf4a tempest-VolumesGetTest-1078145542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:33:42 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-96bd7db8-f5eb-4ecd-910f-54168c3fbf4a tempest-VolumesGetTest-1078145542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:33:42 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-96bd7db8-f5eb-4ecd-910f-54168c3fbf4a tempest-VolumesGetTest-1078145542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:33:42 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-96bd7db8-f5eb-4ecd-910f-54168c3fbf4a tempest-VolumesGetTest-1078145542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:33:42 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-96bd7db8-f5eb-4ecd-910f-54168c3fbf4a tempest-VolumesGetTest-1078145542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:33:42 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-475acb5e-8a58-437a-8e13-dcf47fa336dc tempest-TestInstancesWithCinderVolumes-816660254 None] Acquiring lock "cinder-quobyte-330e8f60-b546-42e1-b2b8-7296ced87a6d" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:33:42 devstack sudo[107437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf Jun 29 03:33:42 devstack sudo[107437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:33:42 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-475acb5e-8a58-437a-8e13-dcf47fa336dc tempest-TestInstancesWithCinderVolumes-816660254 None] Lock "cinder-quobyte-330e8f60-b546-42e1-b2b8-7296ced87a6d" acquired by "delete_volume" :: waited 0.021s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:33:42 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[1db67783-4863-4c7d-9247-bd7f306f4a28]: (4, 'raw') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:33:42 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-475acb5e-8a58-437a-8e13-dcf47fa336dc tempest-TestInstancesWithCinderVolumes-816660254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-330e8f60-b546-42e1-b2b8-7296ced87a6d {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:33:42 devstack sudo[107443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-330e8f60-b546-42e1-b2b8-7296ced87a6d Jun 29 03:33:42 devstack sudo[107443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:33:42 devstack sudo[107437]: pam_unix(sudo:session): session closed for user root Jun 29 03:33:42 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-96bd7db8-f5eb-4ecd-910f-54168c3fbf4a tempest-VolumesGetTest-1078145542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf" returned: 0 in 0.859s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:33:42 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-96bd7db8-f5eb-4ecd-910f-54168c3fbf4a tempest-VolumesGetTest-1078145542 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:33:42 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-96bd7db8-f5eb-4ecd-910f-54168c3fbf4a tempest-VolumesGetTest-1078145542 None] Deleted volume successfully. Jun 29 03:33:42 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-96bd7db8-f5eb-4ecd-910f-54168c3fbf4a tempest-VolumesGetTest-1078145542 None] Lock "cinder-3ef037ac-7b1f-45a1-a73e-aaa0a2629df3-delete_volume" released by "delete_volume" :: held 3.798s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:33:43 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-62b81359-015e-4a0a-a004-42b06598e31b tempest-VolumesTestJSON-622242772 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:33:43 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-62b81359-015e-4a0a-a004-42b06598e31b tempest-VolumesTestJSON-622242772 None] Flow 'volume_create_manager' (45c62744-fdef-43f4-930f-f1c13e3bc1c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:33:43 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-62b81359-015e-4a0a-a004-42b06598e31b tempest-VolumesTestJSON-622242772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80790164-19f9-4cc8-b463-0a5eab7df5b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:33:43 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-62b81359-015e-4a0a-a004-42b06598e31b tempest-VolumesTestJSON-622242772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80790164-19f9-4cc8-b463-0a5eab7df5b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:33:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-707108543',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c1ec44c-ec5d-4a10-bbc0-52953e536b43,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9e78c33ddf8c4e95b71673b212f7c6ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:33:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:33:43Z,use_quota=True,user_id='1426da3ddc324646b532de33f8d0e040',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:33:43 devstack sudo[107443]: pam_unix(sudo:session): session closed for user root Jun 29 03:33:43 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-62b81359-015e-4a0a-a004-42b06598e31b tempest-VolumesTestJSON-622242772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3e6b81c-00b5-444e-9fcc-7ecffd0bcc6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:33:43 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-62b81359-015e-4a0a-a004-42b06598e31b tempest-VolumesTestJSON-622242772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3e6b81c-00b5-444e-9fcc-7ecffd0bcc6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:33:43 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-62b81359-015e-4a0a-a004-42b06598e31b tempest-VolumesTestJSON-622242772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd6f968a-ca7b-4f7f-8748-cf8a2cb84b45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:33:43 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-62b81359-015e-4a0a-a004-42b06598e31b tempest-VolumesTestJSON-622242772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd6f968a-ca7b-4f7f-8748-cf8a2cb84b45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c1ec44c-ec5d-4a10-bbc0-52953e536b43', 'volume_name': 'volume-0c1ec44c-ec5d-4a10-bbc0-52953e536b43', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:33:43 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-62b81359-015e-4a0a-a004-42b06598e31b tempest-VolumesTestJSON-622242772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b76ae90e-6467-44af-8743-3ef7ec698b6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:33:43 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-62b81359-015e-4a0a-a004-42b06598e31b tempest-VolumesTestJSON-622242772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b76ae90e-6467-44af-8743-3ef7ec698b6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:33:43 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-62b81359-015e-4a0a-a004-42b06598e31b tempest-VolumesTestJSON-622242772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c25042d2-db16-4f1c-865a-0f5e2200bf59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:33:43 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-62b81359-015e-4a0a-a004-42b06598e31b tempest-VolumesTestJSON-622242772 None] Volume 0c1ec44c-ec5d-4a10-bbc0-52953e536b43: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c1ec44c-ec5d-4a10-bbc0-52953e536b43', 'volume_size': 1} Jun 29 03:33:43 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-62b81359-015e-4a0a-a004-42b06598e31b tempest-VolumesTestJSON-622242772 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:33:43 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-62b81359-015e-4a0a-a004-42b06598e31b tempest-VolumesTestJSON-622242772 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:33:43 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-62b81359-015e-4a0a-a004-42b06598e31b tempest-VolumesTestJSON-622242772 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:33:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-707108543',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c1ec44c-ec5d-4a10-bbc0-52953e536b43,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9e78c33ddf8c4e95b71673b212f7c6ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:33:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:33:43Z,use_quota=True,user_id='1426da3ddc324646b532de33f8d0e040',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:33:43 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-62b81359-015e-4a0a-a004-42b06598e31b tempest-VolumesTestJSON-622242772 None] Creating volume 0c1ec44c-ec5d-4a10-bbc0-52953e536b43 {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:33:43 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-62b81359-015e-4a0a-a004-42b06598e31b tempest-VolumesTestJSON-622242772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:33:43 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-62b81359-015e-4a0a-a004-42b06598e31b tempest-VolumesTestJSON-622242772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:33:43 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-62b81359-015e-4a0a-a004-42b06598e31b tempest-VolumesTestJSON-622242772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:33:43 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-62b81359-015e-4a0a-a004-42b06598e31b tempest-VolumesTestJSON-622242772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:33:43 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-62b81359-015e-4a0a-a004-42b06598e31b tempest-VolumesTestJSON-622242772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:33:43 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-62b81359-015e-4a0a-a004-42b06598e31b tempest-VolumesTestJSON-622242772 None] Selected osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:33:43 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-62b81359-015e-4a0a-a004-42b06598e31b tempest-VolumesTestJSON-622242772 None] casted to osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f Jun 29 03:33:43 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-62b81359-015e-4a0a-a004-42b06598e31b tempest-VolumesTestJSON-622242772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-0c1ec44c-ec5d-4a10-bbc0-52953e536b43 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:33:43 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-475acb5e-8a58-437a-8e13-dcf47fa336dc tempest-TestInstancesWithCinderVolumes-816660254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-330e8f60-b546-42e1-b2b8-7296ced87a6d" returned: 0 in 1.486s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:33:43 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-475acb5e-8a58-437a-8e13-dcf47fa336dc tempest-TestInstancesWithCinderVolumes-816660254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-330e8f60-b546-42e1-b2b8-7296ced87a6d {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:33:43 devstack sudo[107450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-0c1ec44c-ec5d-4a10-bbc0-52953e536b43 1073741824 Jun 29 03:33:43 devstack sudo[107450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:33:43 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e4973aa-4148-4c6d-88b1-890185cfee5d tempest-VolumesGetTest-1078145542 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:33:43 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-7e4973aa-4148-4c6d-88b1-890185cfee5d tempest-VolumesGetTest-1078145542 None] Flow 'volume_create_manager' (ba7f9b53-7422-481e-b228-a4e3b51c4974) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:33:43 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-7e4973aa-4148-4c6d-88b1-890185cfee5d tempest-VolumesGetTest-1078145542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb01a6b8-291b-4fd7-b7a4-5dfb55879e16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:33:43 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-7e4973aa-4148-4c6d-88b1-890185cfee5d tempest-VolumesGetTest-1078145542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb01a6b8-291b-4fd7-b7a4-5dfb55879e16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:33:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1422172741',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc0f74c3-55bd-4c8b-ac8a-2884a8a5b6c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e640ff4d86d542b88f2dba18116829b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:33:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:33:44Z,use_quota=True,user_id='26202c1ba10d4b91882e33e8c46b1802',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:33:43 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-7e4973aa-4148-4c6d-88b1-890185cfee5d tempest-VolumesGetTest-1078145542 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77262a47-0234-4622-809c-f632f83c5899) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:33:43 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-7e4973aa-4148-4c6d-88b1-890185cfee5d tempest-VolumesGetTest-1078145542 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77262a47-0234-4622-809c-f632f83c5899) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:33:43 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-7e4973aa-4148-4c6d-88b1-890185cfee5d tempest-VolumesGetTest-1078145542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d357aab2-034e-40ba-9554-45c61340b839) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:33:43 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-7e4973aa-4148-4c6d-88b1-890185cfee5d tempest-VolumesGetTest-1078145542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d357aab2-034e-40ba-9554-45c61340b839) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc0f74c3-55bd-4c8b-ac8a-2884a8a5b6c7', 'volume_name': 'volume-cc0f74c3-55bd-4c8b-ac8a-2884a8a5b6c7', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:33:43 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-7e4973aa-4148-4c6d-88b1-890185cfee5d tempest-VolumesGetTest-1078145542 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c4aae45-6105-440e-8010-965cb9b9406b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:33:43 devstack sudo[107451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-330e8f60-b546-42e1-b2b8-7296ced87a6d Jun 29 03:33:43 devstack sudo[107451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:33:43 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-7e4973aa-4148-4c6d-88b1-890185cfee5d tempest-VolumesGetTest-1078145542 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c4aae45-6105-440e-8010-965cb9b9406b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:33:43 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-7e4973aa-4148-4c6d-88b1-890185cfee5d tempest-VolumesGetTest-1078145542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee1554bd-0ee0-4c28-bd85-b0218c8e23fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:33:43 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-7e4973aa-4148-4c6d-88b1-890185cfee5d tempest-VolumesGetTest-1078145542 None] Volume cc0f74c3-55bd-4c8b-ac8a-2884a8a5b6c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc0f74c3-55bd-4c8b-ac8a-2884a8a5b6c7', 'volume_size': 1} Jun 29 03:33:43 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-7e4973aa-4148-4c6d-88b1-890185cfee5d tempest-VolumesGetTest-1078145542 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:33:44 devstack sudo[107451]: pam_unix(sudo:session): session closed for user root Jun 29 03:33:44 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-475acb5e-8a58-437a-8e13-dcf47fa336dc tempest-TestInstancesWithCinderVolumes-816660254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-330e8f60-b546-42e1-b2b8-7296ced87a6d" returned: 1 in 1.033s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:33:44 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-475acb5e-8a58-437a-8e13-dcf47fa336dc tempest-TestInstancesWithCinderVolumes-816660254 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-330e8f60-b546-42e1-b2b8-7296ced87a6d' failed. Not Retrying. {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 29 03:33:44 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-475acb5e-8a58-437a-8e13-dcf47fa336dc tempest-TestInstancesWithCinderVolumes-816660254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-330e8f60-b546-42e1-b2b8-7296ced87a6d {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:33:44 devstack sudo[107460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-330e8f60-b546-42e1-b2b8-7296ced87a6d Jun 29 03:33:44 devstack sudo[107460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:33:44 devstack sudo[107450]: pam_unix(sudo:session): session closed for user root Jun 29 03:33:44 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-62b81359-015e-4a0a-a004-42b06598e31b tempest-VolumesTestJSON-622242772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-0c1ec44c-ec5d-4a10-bbc0-52953e536b43 1073741824" returned: 0 in 1.161s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:33:44 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-62b81359-015e-4a0a-a004-42b06598e31b tempest-VolumesTestJSON-622242772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-0c1ec44c-ec5d-4a10-bbc0-52953e536b43 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:33:44 devstack sudo[107462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-0c1ec44c-ec5d-4a10-bbc0-52953e536b43 Jun 29 03:33:44 devstack sudo[107462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:33:45 devstack sudo[107460]: pam_unix(sudo:session): session closed for user root Jun 29 03:33:45 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-475acb5e-8a58-437a-8e13-dcf47fa336dc tempest-TestInstancesWithCinderVolumes-816660254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-330e8f60-b546-42e1-b2b8-7296ced87a6d" returned: 0 in 0.685s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:33:45 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-475acb5e-8a58-437a-8e13-dcf47fa336dc tempest-TestInstancesWithCinderVolumes-816660254 None] Lock "cinder-quobyte-330e8f60-b546-42e1-b2b8-7296ced87a6d" released by "delete_volume" :: held 3.335s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:33:45 devstack cinder-volume[93468]: WARNING cinder.quota [None req-475acb5e-8a58-437a-8e13-dcf47fa336dc tempest-TestInstancesWithCinderVolumes-816660254 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-704234809-1701043744 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-704234809-1701043744, it is now deprecated. Please use the default quota class for default quota. Jun 29 03:33:45 devstack cinder-volume[93468]: WARNING cinder.quota [None req-475acb5e-8a58-437a-8e13-dcf47fa336dc tempest-TestInstancesWithCinderVolumes-816660254 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-704234809-1701043744 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-704234809-1701043744, it is now deprecated. Please use the default quota class for default quota. Jun 29 03:33:45 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-475acb5e-8a58-437a-8e13-dcf47fa336dc tempest-TestInstancesWithCinderVolumes-816660254 None] Created reservations ['308b07f8-3df4-4546-b87e-1e85e416546a', '9468fc8c-c6cd-4c2e-ac42-79318d558912', '6838a973-272e-4abc-ae5a-86c43aa9b4f1', '5685453e-429b-412e-bdc4-93ad592d41c9'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:33:45 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-475acb5e-8a58-437a-8e13-dcf47fa336dc tempest-TestInstancesWithCinderVolumes-816660254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:33:45 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-475acb5e-8a58-437a-8e13-dcf47fa336dc tempest-TestInstancesWithCinderVolumes-816660254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:33:45 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-475acb5e-8a58-437a-8e13-dcf47fa336dc tempest-TestInstancesWithCinderVolumes-816660254 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:33:45 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-475acb5e-8a58-437a-8e13-dcf47fa336dc tempest-TestInstancesWithCinderVolumes-816660254 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:33:45 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-475acb5e-8a58-437a-8e13-dcf47fa336dc tempest-TestInstancesWithCinderVolumes-816660254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:33:45 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-475acb5e-8a58-437a-8e13-dcf47fa336dc tempest-TestInstancesWithCinderVolumes-816660254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:33:45 devstack sudo[107466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf Jun 29 03:33:45 devstack sudo[107466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:33:45 devstack sudo[107462]: pam_unix(sudo:session): session closed for user root Jun 29 03:33:45 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-62b81359-015e-4a0a-a004-42b06598e31b tempest-VolumesTestJSON-622242772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-0c1ec44c-ec5d-4a10-bbc0-52953e536b43" returned: 0 in 0.733s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:33:45 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-62b81359-015e-4a0a-a004-42b06598e31b tempest-VolumesTestJSON-622242772 None] <== create_volume: return (1948ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:33:45 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-62b81359-015e-4a0a-a004-42b06598e31b tempest-VolumesTestJSON-622242772 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.952s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:33:45 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-7e4973aa-4148-4c6d-88b1-890185cfee5d tempest-VolumesGetTest-1078145542 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.736s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:33:45 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-7e4973aa-4148-4c6d-88b1-890185cfee5d tempest-VolumesGetTest-1078145542 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:33:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1422172741',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc0f74c3-55bd-4c8b-ac8a-2884a8a5b6c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e640ff4d86d542b88f2dba18116829b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:33:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:33:44Z,use_quota=True,user_id='26202c1ba10d4b91882e33e8c46b1802',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:33:45 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-7e4973aa-4148-4c6d-88b1-890185cfee5d tempest-VolumesGetTest-1078145542 None] Creating volume cc0f74c3-55bd-4c8b-ac8a-2884a8a5b6c7 {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:33:45 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-7e4973aa-4148-4c6d-88b1-890185cfee5d tempest-VolumesGetTest-1078145542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:33:45 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-7e4973aa-4148-4c6d-88b1-890185cfee5d tempest-VolumesGetTest-1078145542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:33:45 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-7e4973aa-4148-4c6d-88b1-890185cfee5d tempest-VolumesGetTest-1078145542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:33:45 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-7e4973aa-4148-4c6d-88b1-890185cfee5d tempest-VolumesGetTest-1078145542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:33:45 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-7e4973aa-4148-4c6d-88b1-890185cfee5d tempest-VolumesGetTest-1078145542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:33:45 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-7e4973aa-4148-4c6d-88b1-890185cfee5d tempest-VolumesGetTest-1078145542 None] Selected osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:33:45 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-7e4973aa-4148-4c6d-88b1-890185cfee5d tempest-VolumesGetTest-1078145542 None] casted to osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f Jun 29 03:33:45 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-7e4973aa-4148-4c6d-88b1-890185cfee5d tempest-VolumesGetTest-1078145542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-cc0f74c3-55bd-4c8b-ac8a-2884a8a5b6c7 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:33:45 devstack sudo[107468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-cc0f74c3-55bd-4c8b-ac8a-2884a8a5b6c7 1073741824 Jun 29 03:33:45 devstack sudo[107468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:33:45 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-62b81359-015e-4a0a-a004-42b06598e31b tempest-VolumesTestJSON-622242772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c25042d2-db16-4f1c-865a-0f5e2200bf59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c1ec44c-ec5d-4a10-bbc0-52953e536b43', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:33:45 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-62b81359-015e-4a0a-a004-42b06598e31b tempest-VolumesTestJSON-622242772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04afd0bf-ec26-4501-9af7-3e668affae16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:33:45 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-62b81359-015e-4a0a-a004-42b06598e31b tempest-VolumesTestJSON-622242772 None] Volume volume-0c1ec44c-ec5d-4a10-bbc0-52953e536b43 (0c1ec44c-ec5d-4a10-bbc0-52953e536b43): created successfully Jun 29 03:33:45 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-62b81359-015e-4a0a-a004-42b06598e31b tempest-VolumesTestJSON-622242772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04afd0bf-ec26-4501-9af7-3e668affae16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:33:45 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-62b81359-015e-4a0a-a004-42b06598e31b tempest-VolumesTestJSON-622242772 None] Flow 'volume_create_manager' (45c62744-fdef-43f4-930f-f1c13e3bc1c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:33:45 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-62b81359-015e-4a0a-a004-42b06598e31b tempest-VolumesTestJSON-622242772 None] Created volume successfully. Jun 29 03:33:46 devstack sudo[107466]: pam_unix(sudo:session): session closed for user root Jun 29 03:33:46 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-475acb5e-8a58-437a-8e13-dcf47fa336dc tempest-TestInstancesWithCinderVolumes-816660254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf" returned: 0 in 0.693s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:33:46 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-475acb5e-8a58-437a-8e13-dcf47fa336dc tempest-TestInstancesWithCinderVolumes-816660254 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:33:46 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-475acb5e-8a58-437a-8e13-dcf47fa336dc tempest-TestInstancesWithCinderVolumes-816660254 None] Deleted volume successfully. Jun 29 03:33:46 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-475acb5e-8a58-437a-8e13-dcf47fa336dc tempest-TestInstancesWithCinderVolumes-816660254 None] Lock "cinder-330e8f60-b546-42e1-b2b8-7296ced87a6d-delete_volume" released by "delete_volume" :: held 4.293s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:33:46 devstack sudo[107468]: pam_unix(sudo:session): session closed for user root Jun 29 03:33:46 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-7e4973aa-4148-4c6d-88b1-890185cfee5d tempest-VolumesGetTest-1078145542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-cc0f74c3-55bd-4c8b-ac8a-2884a8a5b6c7 1073741824" returned: 0 in 0.889s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:33:46 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-7e4973aa-4148-4c6d-88b1-890185cfee5d tempest-VolumesGetTest-1078145542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-cc0f74c3-55bd-4c8b-ac8a-2884a8a5b6c7 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:33:46 devstack sudo[107475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-cc0f74c3-55bd-4c8b-ac8a-2884a8a5b6c7 Jun 29 03:33:46 devstack sudo[107475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:33:47 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8b6e2bc-245f-48d4-9289-e5bdc5f1b2b0 tempest-VolumesTestJSON-622242772 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:33:47 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-f8b6e2bc-245f-48d4-9289-e5bdc5f1b2b0 tempest-VolumesTestJSON-622242772 None] Flow 'volume_create_manager' (c2e9201c-19e8-47c5-89e1-706cb26a620d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:33:47 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-f8b6e2bc-245f-48d4-9289-e5bdc5f1b2b0 tempest-VolumesTestJSON-622242772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7903b40-fd26-48d7-bf83-350f95ddeac0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:33:47 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-f8b6e2bc-245f-48d4-9289-e5bdc5f1b2b0 tempest-VolumesTestJSON-622242772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7903b40-fd26-48d7-bf83-350f95ddeac0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:33:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2081784931',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c6dcfe8-609a-4c54-bac0-66b45fe9af50,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9e78c33ddf8c4e95b71673b212f7c6ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:33:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:33:47Z,use_quota=True,user_id='1426da3ddc324646b532de33f8d0e040',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:33:47 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-f8b6e2bc-245f-48d4-9289-e5bdc5f1b2b0 tempest-VolumesTestJSON-622242772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b342bbe-22ff-49ea-b669-cc0a6bc293a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:33:47 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-f8b6e2bc-245f-48d4-9289-e5bdc5f1b2b0 tempest-VolumesTestJSON-622242772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b342bbe-22ff-49ea-b669-cc0a6bc293a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:33:47 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-f8b6e2bc-245f-48d4-9289-e5bdc5f1b2b0 tempest-VolumesTestJSON-622242772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9631dfbf-dd02-48cf-8947-dcffe4831288) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:33:47 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-f8b6e2bc-245f-48d4-9289-e5bdc5f1b2b0 tempest-VolumesTestJSON-622242772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9631dfbf-dd02-48cf-8947-dcffe4831288) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c6dcfe8-609a-4c54-bac0-66b45fe9af50', 'volume_name': 'volume-9c6dcfe8-609a-4c54-bac0-66b45fe9af50', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:33:47 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-f8b6e2bc-245f-48d4-9289-e5bdc5f1b2b0 tempest-VolumesTestJSON-622242772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb19b08b-94a6-475e-8a7f-998c7e5e293f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:33:47 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-f8b6e2bc-245f-48d4-9289-e5bdc5f1b2b0 tempest-VolumesTestJSON-622242772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb19b08b-94a6-475e-8a7f-998c7e5e293f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:33:47 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-f8b6e2bc-245f-48d4-9289-e5bdc5f1b2b0 tempest-VolumesTestJSON-622242772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (308b6ba8-dabe-422e-82d3-b4abc274aa6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:33:47 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-f8b6e2bc-245f-48d4-9289-e5bdc5f1b2b0 tempest-VolumesTestJSON-622242772 None] Volume 9c6dcfe8-609a-4c54-bac0-66b45fe9af50: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c6dcfe8-609a-4c54-bac0-66b45fe9af50', 'volume_size': 1} Jun 29 03:33:47 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-f8b6e2bc-245f-48d4-9289-e5bdc5f1b2b0 tempest-VolumesTestJSON-622242772 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:33:47 devstack sudo[107475]: pam_unix(sudo:session): session closed for user root Jun 29 03:33:47 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-7e4973aa-4148-4c6d-88b1-890185cfee5d tempest-VolumesGetTest-1078145542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-cc0f74c3-55bd-4c8b-ac8a-2884a8a5b6c7" returned: 0 in 0.860s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:33:47 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-7e4973aa-4148-4c6d-88b1-890185cfee5d tempest-VolumesGetTest-1078145542 None] <== create_volume: return (1797ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:33:47 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-7e4973aa-4148-4c6d-88b1-890185cfee5d tempest-VolumesGetTest-1078145542 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.801s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:33:47 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-f8b6e2bc-245f-48d4-9289-e5bdc5f1b2b0 tempest-VolumesTestJSON-622242772 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.209s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:33:47 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-f8b6e2bc-245f-48d4-9289-e5bdc5f1b2b0 tempest-VolumesTestJSON-622242772 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:33:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2081784931',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c6dcfe8-609a-4c54-bac0-66b45fe9af50,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9e78c33ddf8c4e95b71673b212f7c6ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:33:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:33:47Z,use_quota=True,user_id='1426da3ddc324646b532de33f8d0e040',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:33:47 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-f8b6e2bc-245f-48d4-9289-e5bdc5f1b2b0 tempest-VolumesTestJSON-622242772 None] Creating volume 9c6dcfe8-609a-4c54-bac0-66b45fe9af50 {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:33:47 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-f8b6e2bc-245f-48d4-9289-e5bdc5f1b2b0 tempest-VolumesTestJSON-622242772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:33:47 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-f8b6e2bc-245f-48d4-9289-e5bdc5f1b2b0 tempest-VolumesTestJSON-622242772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:33:47 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-f8b6e2bc-245f-48d4-9289-e5bdc5f1b2b0 tempest-VolumesTestJSON-622242772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:33:47 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-f8b6e2bc-245f-48d4-9289-e5bdc5f1b2b0 tempest-VolumesTestJSON-622242772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:33:47 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-f8b6e2bc-245f-48d4-9289-e5bdc5f1b2b0 tempest-VolumesTestJSON-622242772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:33:47 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-f8b6e2bc-245f-48d4-9289-e5bdc5f1b2b0 tempest-VolumesTestJSON-622242772 None] Selected osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:33:47 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-f8b6e2bc-245f-48d4-9289-e5bdc5f1b2b0 tempest-VolumesTestJSON-622242772 None] casted to osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f Jun 29 03:33:47 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-f8b6e2bc-245f-48d4-9289-e5bdc5f1b2b0 tempest-VolumesTestJSON-622242772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9c6dcfe8-609a-4c54-bac0-66b45fe9af50 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:33:47 devstack sudo[107478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9c6dcfe8-609a-4c54-bac0-66b45fe9af50 1073741824 Jun 29 03:33:47 devstack sudo[107478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:33:47 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-7e4973aa-4148-4c6d-88b1-890185cfee5d tempest-VolumesGetTest-1078145542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee1554bd-0ee0-4c28-bd85-b0218c8e23fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc0f74c3-55bd-4c8b-ac8a-2884a8a5b6c7', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:33:47 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-7e4973aa-4148-4c6d-88b1-890185cfee5d tempest-VolumesGetTest-1078145542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17d3b478-458a-4eea-815a-691a9b3b9a30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:33:47 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-7e4973aa-4148-4c6d-88b1-890185cfee5d tempest-VolumesGetTest-1078145542 None] Volume volume-cc0f74c3-55bd-4c8b-ac8a-2884a8a5b6c7 (cc0f74c3-55bd-4c8b-ac8a-2884a8a5b6c7): created successfully Jun 29 03:33:47 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-7e4973aa-4148-4c6d-88b1-890185cfee5d tempest-VolumesGetTest-1078145542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17d3b478-458a-4eea-815a-691a9b3b9a30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:33:47 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-7e4973aa-4148-4c6d-88b1-890185cfee5d tempest-VolumesGetTest-1078145542 None] Flow 'volume_create_manager' (ba7f9b53-7422-481e-b228-a4e3b51c4974) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:33:47 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-7e4973aa-4148-4c6d-88b1-890185cfee5d tempest-VolumesGetTest-1078145542 None] Created volume successfully. Jun 29 03:33:48 devstack sudo[107478]: pam_unix(sudo:session): session closed for user root Jun 29 03:33:48 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-f8b6e2bc-245f-48d4-9289-e5bdc5f1b2b0 tempest-VolumesTestJSON-622242772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9c6dcfe8-609a-4c54-bac0-66b45fe9af50 1073741824" returned: 0 in 1.224s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:33:48 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-a991ab56-ab54-45c5-ab4a-f8b17d5e41a9 tempest-VolumesGetTest-1078145542 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:33:48 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-a991ab56-ab54-45c5-ab4a-f8b17d5e41a9 tempest-VolumesGetTest-1078145542 None] Flow 'volume_create_manager' (33ef5ac2-056d-4fff-9375-fc29f19de486) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:33:48 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-a991ab56-ab54-45c5-ab4a-f8b17d5e41a9 tempest-VolumesGetTest-1078145542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e06e27e-1248-4def-a183-4d0021722c1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:33:48 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-f8b6e2bc-245f-48d4-9289-e5bdc5f1b2b0 tempest-VolumesTestJSON-622242772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9c6dcfe8-609a-4c54-bac0-66b45fe9af50 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:33:48 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-a991ab56-ab54-45c5-ab4a-f8b17d5e41a9 tempest-VolumesGetTest-1078145542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e06e27e-1248-4def-a183-4d0021722c1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:33:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2015486817',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89dc4c32-8382-478c-a869-b6c54e363dc8,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='e640ff4d86d542b88f2dba18116829b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:33:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=cc0f74c3-55bd-4c8b-ac8a-2884a8a5b6c7,status='creating',terminated_at=None,updated_at=2026-06-29T01:33:49Z,use_quota=True,user_id='26202c1ba10d4b91882e33e8c46b1802',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:33:48 devstack sudo[107483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9c6dcfe8-609a-4c54-bac0-66b45fe9af50 Jun 29 03:33:48 devstack sudo[107483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:33:48 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-a991ab56-ab54-45c5-ab4a-f8b17d5e41a9 tempest-VolumesGetTest-1078145542 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37b28949-65f9-4705-bdaf-ee51501ce19d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:33:48 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-a991ab56-ab54-45c5-ab4a-f8b17d5e41a9 tempest-VolumesGetTest-1078145542 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37b28949-65f9-4705-bdaf-ee51501ce19d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:33:48 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-a991ab56-ab54-45c5-ab4a-f8b17d5e41a9 tempest-VolumesGetTest-1078145542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5ab2bd9-48d0-444d-922c-a1bb247ad094) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:33:48 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-a991ab56-ab54-45c5-ab4a-f8b17d5e41a9 tempest-VolumesGetTest-1078145542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5ab2bd9-48d0-444d-922c-a1bb247ad094) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '89dc4c32-8382-478c-a869-b6c54e363dc8', 'volume_name': 'volume-89dc4c32-8382-478c-a869-b6c54e363dc8', 'volume_size': 1, 'source_volid': 'cc0f74c3-55bd-4c8b-ac8a-2884a8a5b6c7', 'source_volstatus': 'available'}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:33:48 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-a991ab56-ab54-45c5-ab4a-f8b17d5e41a9 tempest-VolumesGetTest-1078145542 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d597d8c-d76a-4481-a1b8-c532b1b80489) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:33:48 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-a991ab56-ab54-45c5-ab4a-f8b17d5e41a9 tempest-VolumesGetTest-1078145542 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d597d8c-d76a-4481-a1b8-c532b1b80489) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:33:48 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-a991ab56-ab54-45c5-ab4a-f8b17d5e41a9 tempest-VolumesGetTest-1078145542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4de99ce1-9567-4f0b-8d47-aae9aa033700) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:33:48 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-a991ab56-ab54-45c5-ab4a-f8b17d5e41a9 tempest-VolumesGetTest-1078145542 None] Volume 89dc4c32-8382-478c-a869-b6c54e363dc8: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-89dc4c32-8382-478c-a869-b6c54e363dc8', 'volume_size': 1, 'source_volid': 'cc0f74c3-55bd-4c8b-ac8a-2884a8a5b6c7', 'source_volstatus': 'available'} Jun 29 03:33:48 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-a991ab56-ab54-45c5-ab4a-f8b17d5e41a9 tempest-VolumesGetTest-1078145542 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:33:49 devstack sudo[107483]: pam_unix(sudo:session): session closed for user root Jun 29 03:33:49 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-f8b6e2bc-245f-48d4-9289-e5bdc5f1b2b0 tempest-VolumesTestJSON-622242772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9c6dcfe8-609a-4c54-bac0-66b45fe9af50" returned: 0 in 0.779s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:33:49 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-f8b6e2bc-245f-48d4-9289-e5bdc5f1b2b0 tempest-VolumesTestJSON-622242772 None] <== create_volume: return (2107ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:33:49 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-f8b6e2bc-245f-48d4-9289-e5bdc5f1b2b0 tempest-VolumesTestJSON-622242772 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.111s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:33:49 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-a991ab56-ab54-45c5-ab4a-f8b17d5e41a9 tempest-VolumesGetTest-1078145542 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.667s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:33:49 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-a991ab56-ab54-45c5-ab4a-f8b17d5e41a9 tempest-VolumesGetTest-1078145542 None] Cloning volume cc0f74c3-55bd-4c8b-ac8a-2884a8a5b6c7 to volume 89dc4c32-8382-478c-a869-b6c54e363dc8 Jun 29 03:33:49 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-f8b6e2bc-245f-48d4-9289-e5bdc5f1b2b0 tempest-VolumesTestJSON-622242772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (308b6ba8-dabe-422e-82d3-b4abc274aa6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c6dcfe8-609a-4c54-bac0-66b45fe9af50', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:33:49 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-f8b6e2bc-245f-48d4-9289-e5bdc5f1b2b0 tempest-VolumesTestJSON-622242772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88f4fc12-f521-470e-ae57-51cd24e5b21c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:33:49 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-f8b6e2bc-245f-48d4-9289-e5bdc5f1b2b0 tempest-VolumesTestJSON-622242772 None] Volume volume-9c6dcfe8-609a-4c54-bac0-66b45fe9af50 (9c6dcfe8-609a-4c54-bac0-66b45fe9af50): created successfully Jun 29 03:33:49 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-f8b6e2bc-245f-48d4-9289-e5bdc5f1b2b0 tempest-VolumesTestJSON-622242772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88f4fc12-f521-470e-ae57-51cd24e5b21c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:33:49 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-f8b6e2bc-245f-48d4-9289-e5bdc5f1b2b0 tempest-VolumesTestJSON-622242772 None] Flow 'volume_create_manager' (c2e9201c-19e8-47c5-89e1-706cb26a620d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:33:49 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-a991ab56-ab54-45c5-ab4a-f8b17d5e41a9 tempest-VolumesGetTest-1078145542 None] Creating offline snapshot 9e915d50-db49-4536-b12e-29aaee6521b2 of volume cc0f74c3-55bd-4c8b-ac8a-2884a8a5b6c7 {{(pid=93468) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 29 03:33:49 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-f8b6e2bc-245f-48d4-9289-e5bdc5f1b2b0 tempest-VolumesTestJSON-622242772 None] Created volume successfully. Jun 29 03:33:49 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c244c55-4343-458b-9e4f-97d0d395a761]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:33:49 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a991ab56-ab54-45c5-ab4a-f8b17d5e41a9 tempest-VolumesGetTest-1078145542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-cc0f74c3-55bd-4c8b-ac8a-2884a8a5b6c7 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:33:49 devstack sudo[107487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-cc0f74c3-55bd-4c8b-ac8a-2884a8a5b6c7 Jun 29 03:33:49 devstack sudo[107487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:33:50 devstack sudo[107487]: pam_unix(sudo:session): session closed for user root Jun 29 03:33:50 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a991ab56-ab54-45c5-ab4a-f8b17d5e41a9 tempest-VolumesGetTest-1078145542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-cc0f74c3-55bd-4c8b-ac8a-2884a8a5b6c7" returned: 0 in 0.931s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:33:50 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a991ab56-ab54-45c5-ab4a-f8b17d5e41a9 tempest-VolumesGetTest-1078145542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-cc0f74c3-55bd-4c8b-ac8a-2884a8a5b6c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-cc0f74c3-55bd-4c8b-ac8a-2884a8a5b6c7.9e915d50-db49-4536-b12e-29aaee6521b2 1G {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:33:50 devstack sudo[107492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-cc0f74c3-55bd-4c8b-ac8a-2884a8a5b6c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-cc0f74c3-55bd-4c8b-ac8a-2884a8a5b6c7.9e915d50-db49-4536-b12e-29aaee6521b2 1G Jun 29 03:33:50 devstack sudo[107492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:33:51 devstack sudo[107492]: pam_unix(sudo:session): session closed for user root Jun 29 03:33:51 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a991ab56-ab54-45c5-ab4a-f8b17d5e41a9 tempest-VolumesGetTest-1078145542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-cc0f74c3-55bd-4c8b-ac8a-2884a8a5b6c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-cc0f74c3-55bd-4c8b-ac8a-2884a8a5b6c7.9e915d50-db49-4536-b12e-29aaee6521b2 1G" returned: 0 in 1.113s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:33:51 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a991ab56-ab54-45c5-ab4a-f8b17d5e41a9 tempest-VolumesGetTest-1078145542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc0f74c3-55bd-4c8b-ac8a-2884a8a5b6c7 -F qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-cc0f74c3-55bd-4c8b-ac8a-2884a8a5b6c7.9e915d50-db49-4536-b12e-29aaee6521b2 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:33:51 devstack sudo[107500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc0f74c3-55bd-4c8b-ac8a-2884a8a5b6c7 -F qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-cc0f74c3-55bd-4c8b-ac8a-2884a8a5b6c7.9e915d50-db49-4536-b12e-29aaee6521b2 Jun 29 03:33:51 devstack sudo[107500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:33:51 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-5ddc953f-f2e1-49ea-83cb-69599862e828 tempest-VolumesTestJSON-622242772 None] Acquiring lock "cinder-9c6dcfe8-609a-4c54-bac0-66b45fe9af50-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:33:51 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-5ddc953f-f2e1-49ea-83cb-69599862e828 tempest-VolumesTestJSON-622242772 None] Lock "cinder-9c6dcfe8-609a-4c54-bac0-66b45fe9af50-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:33:51 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-5ddc953f-f2e1-49ea-83cb-69599862e828 tempest-VolumesTestJSON-622242772 None] Acquiring lock "cinder-quobyte-9c6dcfe8-609a-4c54-bac0-66b45fe9af50" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:33:51 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-5ddc953f-f2e1-49ea-83cb-69599862e828 tempest-VolumesTestJSON-622242772 None] Lock "cinder-quobyte-9c6dcfe8-609a-4c54-bac0-66b45fe9af50" acquired by "delete_volume" :: waited 0.039s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:33:52 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[33ecdbdc-31c1-44d7-8e54-a1ab633480e3]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:33:52 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-5ddc953f-f2e1-49ea-83cb-69599862e828 tempest-VolumesTestJSON-622242772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9c6dcfe8-609a-4c54-bac0-66b45fe9af50 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:33:52 devstack sudo[107502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9c6dcfe8-609a-4c54-bac0-66b45fe9af50 Jun 29 03:33:52 devstack sudo[107502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:33:52 devstack sudo[107500]: pam_unix(sudo:session): session closed for user root Jun 29 03:33:52 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a991ab56-ab54-45c5-ab4a-f8b17d5e41a9 tempest-VolumesGetTest-1078145542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc0f74c3-55bd-4c8b-ac8a-2884a8a5b6c7 -F qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-cc0f74c3-55bd-4c8b-ac8a-2884a8a5b6c7.9e915d50-db49-4536-b12e-29aaee6521b2" returned: 0 in 1.016s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:33:52 devstack cinder-volume[93468]: WARNING cinder.volume.drivers.remotefs [None req-a991ab56-ab54-45c5-ab4a-f8b17d5e41a9 tempest-VolumesGetTest-1078145542 None] /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-cc0f74c3-55bd-4c8b-ac8a-2884a8a5b6c7.9e915d50-db49-4536-b12e-29aaee6521b2 is being set with open permissions: ugo+rw Jun 29 03:33:52 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a991ab56-ab54-45c5-ab4a-f8b17d5e41a9 tempest-VolumesGetTest-1078145542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-cc0f74c3-55bd-4c8b-ac8a-2884a8a5b6c7.9e915d50-db49-4536-b12e-29aaee6521b2 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:33:52 devstack sudo[107509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-cc0f74c3-55bd-4c8b-ac8a-2884a8a5b6c7.9e915d50-db49-4536-b12e-29aaee6521b2 Jun 29 03:33:52 devstack sudo[107509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:33:53 devstack sudo[107502]: pam_unix(sudo:session): session closed for user root Jun 29 03:33:53 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-5ddc953f-f2e1-49ea-83cb-69599862e828 tempest-VolumesTestJSON-622242772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9c6dcfe8-609a-4c54-bac0-66b45fe9af50" returned: 0 in 1.216s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:33:53 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-5ddc953f-f2e1-49ea-83cb-69599862e828 tempest-VolumesTestJSON-622242772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9c6dcfe8-609a-4c54-bac0-66b45fe9af50 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:33:53 devstack sudo[107514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9c6dcfe8-609a-4c54-bac0-66b45fe9af50 Jun 29 03:33:53 devstack sudo[107514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:33:53 devstack sudo[107509]: pam_unix(sudo:session): session closed for user root Jun 29 03:33:53 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a991ab56-ab54-45c5-ab4a-f8b17d5e41a9 tempest-VolumesGetTest-1078145542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-cc0f74c3-55bd-4c8b-ac8a-2884a8a5b6c7.9e915d50-db49-4536-b12e-29aaee6521b2" returned: 0 in 0.819s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:33:53 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a991ab56-ab54-45c5-ab4a-f8b17d5e41a9 tempest-VolumesGetTest-1078145542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-cc0f74c3-55bd-4c8b-ac8a-2884a8a5b6c7.info {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:33:53 devstack sudo[107517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-cc0f74c3-55bd-4c8b-ac8a-2884a8a5b6c7.info Jun 29 03:33:53 devstack sudo[107517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:33:54 devstack sudo[107514]: pam_unix(sudo:session): session closed for user root Jun 29 03:33:54 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-5ddc953f-f2e1-49ea-83cb-69599862e828 tempest-VolumesTestJSON-622242772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9c6dcfe8-609a-4c54-bac0-66b45fe9af50" returned: 0 in 0.815s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:33:54 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-5ddc953f-f2e1-49ea-83cb-69599862e828 tempest-VolumesTestJSON-622242772 None] Lock "cinder-quobyte-9c6dcfe8-609a-4c54-bac0-66b45fe9af50" released by "delete_volume" :: held 2.121s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:33:54 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-5ddc953f-f2e1-49ea-83cb-69599862e828 tempest-VolumesTestJSON-622242772 None] Created reservations ['a4d5311f-530d-4981-944c-c28dde88b4d3', '9fdd78b7-4aea-4c90-a637-935ccb2f469a', 'b83c2aa2-99b2-41b1-a291-e7323f0d5bbd', '61e4a84b-8234-4617-986c-3494d257e281'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:33:54 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-5ddc953f-f2e1-49ea-83cb-69599862e828 tempest-VolumesTestJSON-622242772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:33:54 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-5ddc953f-f2e1-49ea-83cb-69599862e828 tempest-VolumesTestJSON-622242772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:33:54 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-5ddc953f-f2e1-49ea-83cb-69599862e828 tempest-VolumesTestJSON-622242772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:33:54 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-5ddc953f-f2e1-49ea-83cb-69599862e828 tempest-VolumesTestJSON-622242772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:33:54 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-5ddc953f-f2e1-49ea-83cb-69599862e828 tempest-VolumesTestJSON-622242772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:33:54 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-5ddc953f-f2e1-49ea-83cb-69599862e828 tempest-VolumesTestJSON-622242772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:33:54 devstack sudo[107520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf Jun 29 03:33:54 devstack sudo[107520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:33:54 devstack sudo[107517]: pam_unix(sudo:session): session closed for user root Jun 29 03:33:54 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a991ab56-ab54-45c5-ab4a-f8b17d5e41a9 tempest-VolumesGetTest-1078145542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-cc0f74c3-55bd-4c8b-ac8a-2884a8a5b6c7.info" returned: 0 in 0.976s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:33:54 devstack cinder-volume[93468]: WARNING cinder.volume.drivers.remotefs [None req-a991ab56-ab54-45c5-ab4a-f8b17d5e41a9 tempest-VolumesGetTest-1078145542 None] /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-cc0f74c3-55bd-4c8b-ac8a-2884a8a5b6c7.info is being set with open permissions: ugo+rw Jun 29 03:33:54 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a991ab56-ab54-45c5-ab4a-f8b17d5e41a9 tempest-VolumesGetTest-1078145542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-cc0f74c3-55bd-4c8b-ac8a-2884a8a5b6c7.info {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:33:54 devstack sudo[107524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-cc0f74c3-55bd-4c8b-ac8a-2884a8a5b6c7.info Jun 29 03:33:54 devstack sudo[107524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:33:55 devstack sudo[107520]: pam_unix(sudo:session): session closed for user root Jun 29 03:33:55 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-5ddc953f-f2e1-49ea-83cb-69599862e828 tempest-VolumesTestJSON-622242772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf" returned: 0 in 0.881s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:33:55 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-5ddc953f-f2e1-49ea-83cb-69599862e828 tempest-VolumesTestJSON-622242772 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:33:55 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-5ddc953f-f2e1-49ea-83cb-69599862e828 tempest-VolumesTestJSON-622242772 None] Deleted volume successfully. Jun 29 03:33:55 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-5ddc953f-f2e1-49ea-83cb-69599862e828 tempest-VolumesTestJSON-622242772 None] Lock "cinder-9c6dcfe8-609a-4c54-bac0-66b45fe9af50-delete_volume" released by "delete_volume" :: held 3.418s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:33:55 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-4d3629ed-1b71-465d-8804-e64d0e80ed44 tempest-VolumesTestJSON-622242772 None] Acquiring lock "cinder-0c1ec44c-ec5d-4a10-bbc0-52953e536b43-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:33:55 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-4d3629ed-1b71-465d-8804-e64d0e80ed44 tempest-VolumesTestJSON-622242772 None] Lock "cinder-0c1ec44c-ec5d-4a10-bbc0-52953e536b43-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:33:55 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-4d3629ed-1b71-465d-8804-e64d0e80ed44 tempest-VolumesTestJSON-622242772 None] Acquiring lock "cinder-quobyte-0c1ec44c-ec5d-4a10-bbc0-52953e536b43" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:33:55 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-4d3629ed-1b71-465d-8804-e64d0e80ed44 tempest-VolumesTestJSON-622242772 None] Lock "cinder-quobyte-0c1ec44c-ec5d-4a10-bbc0-52953e536b43" acquired by "delete_volume" :: waited 0.027s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:33:55 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[084f85b6-8df9-4d10-8fd7-4b9a5741e270]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:33:55 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-4d3629ed-1b71-465d-8804-e64d0e80ed44 tempest-VolumesTestJSON-622242772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-0c1ec44c-ec5d-4a10-bbc0-52953e536b43 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:33:55 devstack sudo[107524]: pam_unix(sudo:session): session closed for user root Jun 29 03:33:55 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a991ab56-ab54-45c5-ab4a-f8b17d5e41a9 tempest-VolumesGetTest-1078145542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-cc0f74c3-55bd-4c8b-ac8a-2884a8a5b6c7.info" returned: 0 in 0.872s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:33:55 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-a991ab56-ab54-45c5-ab4a-f8b17d5e41a9 tempest-VolumesGetTest-1078145542 None] Acquiring lock "cinder-quobyte-89dc4c32-8382-478c-a869-b6c54e363dc8" by "_copy_volume_from_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:33:55 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-a991ab56-ab54-45c5-ab4a-f8b17d5e41a9 tempest-VolumesGetTest-1078145542 None] Lock "cinder-quobyte-89dc4c32-8382-478c-a869-b6c54e363dc8" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:33:55 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-a991ab56-ab54-45c5-ab4a-f8b17d5e41a9 tempest-VolumesGetTest-1078145542 None] snapshot: 9e915d50-db49-4536-b12e-29aaee6521b2, volume: 89dc4c32-8382-478c-a869-b6c54e363dc8, {{(pid=93468) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 29 03:33:55 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-a991ab56-ab54-45c5-ab4a-f8b17d5e41a9 tempest-VolumesGetTest-1078145542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:33:55 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-a991ab56-ab54-45c5-ab4a-f8b17d5e41a9 tempest-VolumesGetTest-1078145542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:33:55 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-a991ab56-ab54-45c5-ab4a-f8b17d5e41a9 tempest-VolumesGetTest-1078145542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:33:55 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-a991ab56-ab54-45c5-ab4a-f8b17d5e41a9 tempest-VolumesGetTest-1078145542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:33:55 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-a991ab56-ab54-45c5-ab4a-f8b17d5e41a9 tempest-VolumesGetTest-1078145542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:33:55 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[8900f642-f195-48ee-b668-ad6afb7eeadf]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:33:55 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a991ab56-ab54-45c5-ab4a-f8b17d5e41a9 tempest-VolumesGetTest-1078145542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-cc0f74c3-55bd-4c8b-ac8a-2884a8a5b6c7.9e915d50-db49-4536-b12e-29aaee6521b2 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:33:55 devstack sudo[107547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-0c1ec44c-ec5d-4a10-bbc0-52953e536b43 Jun 29 03:33:55 devstack sudo[107547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:33:55 devstack sudo[107548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-cc0f74c3-55bd-4c8b-ac8a-2884a8a5b6c7.9e915d50-db49-4536-b12e-29aaee6521b2 Jun 29 03:33:55 devstack sudo[107548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:33:56 devstack sudo[107547]: pam_unix(sudo:session): session closed for user root Jun 29 03:33:56 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-4d3629ed-1b71-465d-8804-e64d0e80ed44 tempest-VolumesTestJSON-622242772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-0c1ec44c-ec5d-4a10-bbc0-52953e536b43" returned: 0 in 0.839s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:33:56 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-4d3629ed-1b71-465d-8804-e64d0e80ed44 tempest-VolumesTestJSON-622242772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-0c1ec44c-ec5d-4a10-bbc0-52953e536b43 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:33:56 devstack sudo[107581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-0c1ec44c-ec5d-4a10-bbc0-52953e536b43 Jun 29 03:33:56 devstack sudo[107581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:33:56 devstack sudo[107548]: pam_unix(sudo:session): session closed for user root Jun 29 03:33:56 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a991ab56-ab54-45c5-ab4a-f8b17d5e41a9 tempest-VolumesGetTest-1078145542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-cc0f74c3-55bd-4c8b-ac8a-2884a8a5b6c7.9e915d50-db49-4536-b12e-29aaee6521b2" returned: 0 in 0.886s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:33:56 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-a991ab56-ab54-45c5-ab4a-f8b17d5e41a9 tempest-VolumesGetTest-1078145542 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cc0f74c3-55bd-4c8b-ac8a-2884a8a5b6c7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93468) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 29 03:33:56 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-a991ab56-ab54-45c5-ab4a-f8b17d5e41a9 tempest-VolumesGetTest-1078145542 None] will copy from snapshot at /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-cc0f74c3-55bd-4c8b-ac8a-2884a8a5b6c7 {{(pid=93468) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 29 03:33:56 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-a991ab56-ab54-45c5-ab4a-f8b17d5e41a9 tempest-VolumesGetTest-1078145542 None] Creating direct copy from snapshot {{(pid=93468) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 29 03:33:56 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec478653-6620-4721-af5d-44f9614c20e6]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:33:56 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a991ab56-ab54-45c5-ab4a-f8b17d5e41a9 tempest-VolumesGetTest-1078145542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-cc0f74c3-55bd-4c8b-ac8a-2884a8a5b6c7 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:33:56 devstack sudo[107583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-cc0f74c3-55bd-4c8b-ac8a-2884a8a5b6c7 Jun 29 03:33:56 devstack sudo[107583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:33:56 devstack sudo[107581]: pam_unix(sudo:session): session closed for user root Jun 29 03:33:56 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-4d3629ed-1b71-465d-8804-e64d0e80ed44 tempest-VolumesTestJSON-622242772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-0c1ec44c-ec5d-4a10-bbc0-52953e536b43" returned: 0 in 0.702s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:33:57 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-4d3629ed-1b71-465d-8804-e64d0e80ed44 tempest-VolumesTestJSON-622242772 None] Lock "cinder-quobyte-0c1ec44c-ec5d-4a10-bbc0-52953e536b43" released by "delete_volume" :: held 1.622s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:33:57 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-4d3629ed-1b71-465d-8804-e64d0e80ed44 tempest-VolumesTestJSON-622242772 None] Created reservations ['5e5d89b7-0ec3-4f92-90e4-f52f95b67c66', 'ca73ed72-0d4d-4780-9f78-7e72cf8b4262', 'db640a9d-6915-4788-8e86-59e7d8441863', '38a5131f-fc43-4804-aaf9-18a4cfe2bfad'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:33:57 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-4d3629ed-1b71-465d-8804-e64d0e80ed44 tempest-VolumesTestJSON-622242772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:33:57 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-4d3629ed-1b71-465d-8804-e64d0e80ed44 tempest-VolumesTestJSON-622242772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:33:57 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-4d3629ed-1b71-465d-8804-e64d0e80ed44 tempest-VolumesTestJSON-622242772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:33:57 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-4d3629ed-1b71-465d-8804-e64d0e80ed44 tempest-VolumesTestJSON-622242772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:33:57 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-4d3629ed-1b71-465d-8804-e64d0e80ed44 tempest-VolumesTestJSON-622242772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:33:57 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-4d3629ed-1b71-465d-8804-e64d0e80ed44 tempest-VolumesTestJSON-622242772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:33:57 devstack sudo[107589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf Jun 29 03:33:57 devstack sudo[107589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:33:57 devstack sudo[107583]: pam_unix(sudo:session): session closed for user root Jun 29 03:33:57 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a991ab56-ab54-45c5-ab4a-f8b17d5e41a9 tempest-VolumesGetTest-1078145542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-cc0f74c3-55bd-4c8b-ac8a-2884a8a5b6c7" returned: 0 in 0.901s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:33:57 devstack cinder-volume[93468]: DEBUG cinder.utils [None req-a991ab56-ab54-45c5-ab4a-f8b17d5e41a9 tempest-VolumesGetTest-1078145542 None] Path /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-89dc4c32-8382-478c-a869-b6c54e363dc8 not found in is_blk_device check {{(pid=93468) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 29 03:33:57 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a991ab56-ab54-45c5-ab4a-f8b17d5e41a9 tempest-VolumesGetTest-1078145542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-cc0f74c3-55bd-4c8b-ac8a-2884a8a5b6c7 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-89dc4c32-8382-478c-a869-b6c54e363dc8 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:33:57 devstack sudo[107591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-cc0f74c3-55bd-4c8b-ac8a-2884a8a5b6c7 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-89dc4c32-8382-478c-a869-b6c54e363dc8 Jun 29 03:33:57 devstack sudo[107591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:33:57 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-44b33895-7edb-4c58-b93b-b28b70c462f8 tempest-VolumesTestJSON-622242772 None] Acquiring lock "cinder-271256fa-0f9b-42c2-9d2f-4cefedf1226c-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:33:57 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-44b33895-7edb-4c58-b93b-b28b70c462f8 tempest-VolumesTestJSON-622242772 None] Lock "cinder-271256fa-0f9b-42c2-9d2f-4cefedf1226c-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:33:57 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-44b33895-7edb-4c58-b93b-b28b70c462f8 tempest-VolumesTestJSON-622242772 None] Acquiring lock "cinder-quobyte-271256fa-0f9b-42c2-9d2f-4cefedf1226c" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:33:57 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-44b33895-7edb-4c58-b93b-b28b70c462f8 tempest-VolumesTestJSON-622242772 None] Lock "cinder-quobyte-271256fa-0f9b-42c2-9d2f-4cefedf1226c" acquired by "delete_volume" :: waited 0.018s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:33:57 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd437802-a029-4863-ab88-0354110e0991]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:33:57 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-44b33895-7edb-4c58-b93b-b28b70c462f8 tempest-VolumesTestJSON-622242772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-271256fa-0f9b-42c2-9d2f-4cefedf1226c {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:33:57 devstack sudo[107593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-271256fa-0f9b-42c2-9d2f-4cefedf1226c Jun 29 03:33:57 devstack sudo[107593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:33:58 devstack sudo[107589]: pam_unix(sudo:session): session closed for user root Jun 29 03:33:58 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-4d3629ed-1b71-465d-8804-e64d0e80ed44 tempest-VolumesTestJSON-622242772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf" returned: 0 in 0.944s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:33:58 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-4d3629ed-1b71-465d-8804-e64d0e80ed44 tempest-VolumesTestJSON-622242772 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:33:58 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-4d3629ed-1b71-465d-8804-e64d0e80ed44 tempest-VolumesTestJSON-622242772 None] Deleted volume successfully. Jun 29 03:33:58 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-4d3629ed-1b71-465d-8804-e64d0e80ed44 tempest-VolumesTestJSON-622242772 None] Lock "cinder-0c1ec44c-ec5d-4a10-bbc0-52953e536b43-delete_volume" released by "delete_volume" :: held 2.913s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:33:58 devstack sudo[107593]: pam_unix(sudo:session): session closed for user root Jun 29 03:33:58 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-44b33895-7edb-4c58-b93b-b28b70c462f8 tempest-VolumesTestJSON-622242772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-271256fa-0f9b-42c2-9d2f-4cefedf1226c" returned: 0 in 1.286s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:33:58 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-44b33895-7edb-4c58-b93b-b28b70c462f8 tempest-VolumesTestJSON-622242772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-271256fa-0f9b-42c2-9d2f-4cefedf1226c {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:33:59 devstack sudo[107610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-271256fa-0f9b-42c2-9d2f-4cefedf1226c Jun 29 03:33:59 devstack sudo[107610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:34:00 devstack sudo[107610]: pam_unix(sudo:session): session closed for user root Jun 29 03:34:00 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-44b33895-7edb-4c58-b93b-b28b70c462f8 tempest-VolumesTestJSON-622242772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-271256fa-0f9b-42c2-9d2f-4cefedf1226c" returned: 0 in 1.670s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:34:00 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-44b33895-7edb-4c58-b93b-b28b70c462f8 tempest-VolumesTestJSON-622242772 None] Lock "cinder-quobyte-271256fa-0f9b-42c2-9d2f-4cefedf1226c" released by "delete_volume" :: held 3.022s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:34:00 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-44b33895-7edb-4c58-b93b-b28b70c462f8 tempest-VolumesTestJSON-622242772 None] Created reservations ['66a82d3b-fccb-47ae-b167-cec4b8647e99', '7e0e7779-2734-401d-b7f1-bac8ee6944ab', '4ea6606e-8fe6-47a5-a47e-fa7c9b65b5c1', '4c1dc77d-f480-42a0-bd20-f58760bdb654'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:34:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-44b33895-7edb-4c58-b93b-b28b70c462f8 tempest-VolumesTestJSON-622242772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:34:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-44b33895-7edb-4c58-b93b-b28b70c462f8 tempest-VolumesTestJSON-622242772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:34:01 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-44b33895-7edb-4c58-b93b-b28b70c462f8 tempest-VolumesTestJSON-622242772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:34:01 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-44b33895-7edb-4c58-b93b-b28b70c462f8 tempest-VolumesTestJSON-622242772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:34:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-44b33895-7edb-4c58-b93b-b28b70c462f8 tempest-VolumesTestJSON-622242772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:34:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-44b33895-7edb-4c58-b93b-b28b70c462f8 tempest-VolumesTestJSON-622242772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:34:01 devstack sudo[107614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf Jun 29 03:34:01 devstack sudo[107614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:34:03 devstack sudo[107614]: pam_unix(sudo:session): session closed for user root Jun 29 03:34:03 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-44b33895-7edb-4c58-b93b-b28b70c462f8 tempest-VolumesTestJSON-622242772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf" returned: 0 in 2.125s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:34:03 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-44b33895-7edb-4c58-b93b-b28b70c462f8 tempest-VolumesTestJSON-622242772 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:34:03 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-44b33895-7edb-4c58-b93b-b28b70c462f8 tempest-VolumesTestJSON-622242772 None] Deleted volume successfully. Jun 29 03:34:03 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-44b33895-7edb-4c58-b93b-b28b70c462f8 tempest-VolumesTestJSON-622242772 None] Lock "cinder-271256fa-0f9b-42c2-9d2f-4cefedf1226c-delete_volume" released by "delete_volume" :: held 5.705s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:34:03 devstack sudo[107591]: pam_unix(sudo:session): session closed for user root Jun 29 03:34:03 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a991ab56-ab54-45c5-ab4a-f8b17d5e41a9 tempest-VolumesGetTest-1078145542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-cc0f74c3-55bd-4c8b-ac8a-2884a8a5b6c7 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-89dc4c32-8382-478c-a869-b6c54e363dc8" returned: 0 in 6.462s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:34:03 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[4280b716-b8e9-4f02-b2a0-c29dbd332a14]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:34:03 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a991ab56-ab54-45c5-ab4a-f8b17d5e41a9 tempest-VolumesGetTest-1078145542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-cc0f74c3-55bd-4c8b-ac8a-2884a8a5b6c7 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:34:03 devstack sudo[107618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-cc0f74c3-55bd-4c8b-ac8a-2884a8a5b6c7 Jun 29 03:34:03 devstack sudo[107618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:34:05 devstack sudo[107618]: pam_unix(sudo:session): session closed for user root Jun 29 03:34:05 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a991ab56-ab54-45c5-ab4a-f8b17d5e41a9 tempest-VolumesGetTest-1078145542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-cc0f74c3-55bd-4c8b-ac8a-2884a8a5b6c7" returned: 0 in 1.344s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:34:05 devstack cinder-volume[93468]: DEBUG cinder.image.image_utils [None req-a991ab56-ab54-45c5-ab4a-f8b17d5e41a9 tempest-VolumesGetTest-1078145542 None] Image conversion details: src /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-cc0f74c3-55bd-4c8b-ac8a-2884a8a5b6c7, size 1024.00 MB, duration 6.46 sec, destination /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-89dc4c32-8382-478c-a869-b6c54e363dc8 {{(pid=93468) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 29 03:34:05 devstack cinder-volume[93468]: INFO cinder.image.image_utils [None req-a991ab56-ab54-45c5-ab4a-f8b17d5e41a9 tempest-VolumesGetTest-1078145542 None] Converted 1024.00 MB image at 158.40 MB/s Jun 29 03:34:05 devstack cinder-volume[93468]: WARNING cinder.volume.drivers.remotefs [None req-a991ab56-ab54-45c5-ab4a-f8b17d5e41a9 tempest-VolumesGetTest-1078145542 None] /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-89dc4c32-8382-478c-a869-b6c54e363dc8 is being set with open permissions: ugo+rw Jun 29 03:34:05 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a991ab56-ab54-45c5-ab4a-f8b17d5e41a9 tempest-VolumesGetTest-1078145542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-89dc4c32-8382-478c-a869-b6c54e363dc8 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:34:05 devstack sudo[107623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-89dc4c32-8382-478c-a869-b6c54e363dc8 Jun 29 03:34:05 devstack sudo[107623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:34:05 devstack sudo[107623]: pam_unix(sudo:session): session closed for user root Jun 29 03:34:05 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a991ab56-ab54-45c5-ab4a-f8b17d5e41a9 tempest-VolumesGetTest-1078145542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-89dc4c32-8382-478c-a869-b6c54e363dc8" returned: 0 in 0.720s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:34:05 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-a991ab56-ab54-45c5-ab4a-f8b17d5e41a9 tempest-VolumesGetTest-1078145542 None] Lock "cinder-quobyte-89dc4c32-8382-478c-a869-b6c54e363dc8" released by "_copy_volume_from_snapshot" :: held 10.421s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:34:05 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-a991ab56-ab54-45c5-ab4a-f8b17d5e41a9 tempest-VolumesGetTest-1078145542 None] Acquiring lock "cinder-quobyte-9e915d50-db49-4536-b12e-29aaee6521b2" by "_delete_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:34:05 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-a991ab56-ab54-45c5-ab4a-f8b17d5e41a9 tempest-VolumesGetTest-1078145542 None] Lock "cinder-quobyte-9e915d50-db49-4536-b12e-29aaee6521b2" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:34:05 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-a991ab56-ab54-45c5-ab4a-f8b17d5e41a9 tempest-VolumesGetTest-1078145542 None] Deleting offline snapshot 9e915d50-db49-4536-b12e-29aaee6521b2 of volume cc0f74c3-55bd-4c8b-ac8a-2884a8a5b6c7 {{(pid=93468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 29 03:34:05 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-a991ab56-ab54-45c5-ab4a-f8b17d5e41a9 tempest-VolumesGetTest-1078145542 None] snapshot_file for this snap is: volume-cc0f74c3-55bd-4c8b-ac8a-2884a8a5b6c7.9e915d50-db49-4536-b12e-29aaee6521b2 {{(pid=93468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 29 03:34:06 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[53eba93f-d6e4-4e63-a619-aaf027053b71]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:34:06 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a991ab56-ab54-45c5-ab4a-f8b17d5e41a9 tempest-VolumesGetTest-1078145542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-cc0f74c3-55bd-4c8b-ac8a-2884a8a5b6c7.9e915d50-db49-4536-b12e-29aaee6521b2 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:34:06 devstack sudo[107626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-cc0f74c3-55bd-4c8b-ac8a-2884a8a5b6c7.9e915d50-db49-4536-b12e-29aaee6521b2 Jun 29 03:34:06 devstack sudo[107626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:34:06 devstack sudo[107626]: pam_unix(sudo:session): session closed for user root Jun 29 03:34:06 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a991ab56-ab54-45c5-ab4a-f8b17d5e41a9 tempest-VolumesGetTest-1078145542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-cc0f74c3-55bd-4c8b-ac8a-2884a8a5b6c7.9e915d50-db49-4536-b12e-29aaee6521b2" returned: 0 in 0.955s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:34:06 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-a991ab56-ab54-45c5-ab4a-f8b17d5e41a9 tempest-VolumesGetTest-1078145542 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cc0f74c3-55bd-4c8b-ac8a-2884a8a5b6c7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93468) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 29 03:34:07 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[f74a3f0e-2c30-454a-9c84-7e922c3985fd]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:34:07 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a991ab56-ab54-45c5-ab4a-f8b17d5e41a9 tempest-VolumesGetTest-1078145542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-cc0f74c3-55bd-4c8b-ac8a-2884a8a5b6c7 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:34:07 devstack sudo[107635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-cc0f74c3-55bd-4c8b-ac8a-2884a8a5b6c7 Jun 29 03:34:07 devstack sudo[107635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:34:07 devstack sudo[107635]: pam_unix(sudo:session): session closed for user root Jun 29 03:34:07 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a991ab56-ab54-45c5-ab4a-f8b17d5e41a9 tempest-VolumesGetTest-1078145542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-cc0f74c3-55bd-4c8b-ac8a-2884a8a5b6c7" returned: 0 in 0.990s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:34:07 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a991ab56-ab54-45c5-ab4a-f8b17d5e41a9 tempest-VolumesGetTest-1078145542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-cc0f74c3-55bd-4c8b-ac8a-2884a8a5b6c7.9e915d50-db49-4536-b12e-29aaee6521b2 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:34:08 devstack sudo[107642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-cc0f74c3-55bd-4c8b-ac8a-2884a8a5b6c7.9e915d50-db49-4536-b12e-29aaee6521b2 Jun 29 03:34:08 devstack sudo[107642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:34:08 devstack sudo[107642]: pam_unix(sudo:session): session closed for user root Jun 29 03:34:08 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a991ab56-ab54-45c5-ab4a-f8b17d5e41a9 tempest-VolumesGetTest-1078145542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-cc0f74c3-55bd-4c8b-ac8a-2884a8a5b6c7.9e915d50-db49-4536-b12e-29aaee6521b2" returned: 0 in 0.955s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:34:08 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a991ab56-ab54-45c5-ab4a-f8b17d5e41a9 tempest-VolumesGetTest-1078145542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-cc0f74c3-55bd-4c8b-ac8a-2884a8a5b6c7.9e915d50-db49-4536-b12e-29aaee6521b2 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:34:08 devstack sudo[107648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-cc0f74c3-55bd-4c8b-ac8a-2884a8a5b6c7.9e915d50-db49-4536-b12e-29aaee6521b2 Jun 29 03:34:08 devstack sudo[107648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:34:09 devstack sudo[107648]: pam_unix(sudo:session): session closed for user root Jun 29 03:34:09 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a991ab56-ab54-45c5-ab4a-f8b17d5e41a9 tempest-VolumesGetTest-1078145542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-cc0f74c3-55bd-4c8b-ac8a-2884a8a5b6c7.9e915d50-db49-4536-b12e-29aaee6521b2" returned: 0 in 0.784s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:34:09 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-a991ab56-ab54-45c5-ab4a-f8b17d5e41a9 tempest-VolumesGetTest-1078145542 None] Lock "cinder-quobyte-9e915d50-db49-4536-b12e-29aaee6521b2" released by "_delete_snapshot" :: held 3.845s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:34:09 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-a991ab56-ab54-45c5-ab4a-f8b17d5e41a9 tempest-VolumesGetTest-1078145542 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 20.287s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:34:09 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-a991ab56-ab54-45c5-ab4a-f8b17d5e41a9 tempest-VolumesGetTest-1078145542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4de99ce1-9567-4f0b-8d47-aae9aa033700) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89dc4c32-8382-478c-a869-b6c54e363dc8', 'volume_size': 1, 'source_volid': 'cc0f74c3-55bd-4c8b-ac8a-2884a8a5b6c7', 'source_volstatus': 'available'}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:34:09 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-a991ab56-ab54-45c5-ab4a-f8b17d5e41a9 tempest-VolumesGetTest-1078145542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c07b73f-906b-45d3-8fd8-281a274d0d3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:34:09 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-a991ab56-ab54-45c5-ab4a-f8b17d5e41a9 tempest-VolumesGetTest-1078145542 None] Volume volume-89dc4c32-8382-478c-a869-b6c54e363dc8 (89dc4c32-8382-478c-a869-b6c54e363dc8): created successfully Jun 29 03:34:09 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-a991ab56-ab54-45c5-ab4a-f8b17d5e41a9 tempest-VolumesGetTest-1078145542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c07b73f-906b-45d3-8fd8-281a274d0d3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:34:09 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-a991ab56-ab54-45c5-ab4a-f8b17d5e41a9 tempest-VolumesGetTest-1078145542 None] Flow 'volume_create_manager' (33ef5ac2-056d-4fff-9375-fc29f19de486) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:34:09 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-a991ab56-ab54-45c5-ab4a-f8b17d5e41a9 tempest-VolumesGetTest-1078145542 None] Created volume successfully. Jun 29 03:34:11 devstack cinder-volume[93468]: INFO cinder.volume.manager [req-0a91704e-446e-42c5-9621-0cda466f26a8 req-394901a0-581d-4876-8c67-fb7fd66603fc tempest-TestMinimumBasicScenario-1317041294 None] Terminate volume connection completed successfully. Jun 29 03:34:11 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [req-0a91704e-446e-42c5-9621-0cda466f26a8 req-394901a0-581d-4876-8c67-fb7fd66603fc tempest-TestMinimumBasicScenario-1317041294 None] Deleting attachment 9b68d3ec-c1ae-4e27-9ce9-aaf2c38c6ac5. {{(pid=93468) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 29 03:34:11 devstack cinder-volume[93468]: DEBUG oslo_service.periodic_task [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93468) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 29 03:34:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:34:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:34:11 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:34:11 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:34:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:34:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:34:11 devstack sudo[107669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf Jun 29 03:34:11 devstack sudo[107669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:34:12 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-e333bb30-7bc8-47b7-a937-4bf51c3ffc1a tempest-VolumesGetTest-1078145542 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:34:12 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-e333bb30-7bc8-47b7-a937-4bf51c3ffc1a tempest-VolumesGetTest-1078145542 None] Flow 'volume_create_manager' (090d0175-9631-42ef-a5d7-cf5cafacef33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:34:12 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-e333bb30-7bc8-47b7-a937-4bf51c3ffc1a tempest-VolumesGetTest-1078145542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f483488b-9fe5-43a9-b76a-6bcb56ffb062) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:34:12 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-e333bb30-7bc8-47b7-a937-4bf51c3ffc1a tempest-VolumesGetTest-1078145542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f483488b-9fe5-43a9-b76a-6bcb56ffb062) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:34:12Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1084475702',display_name='tempest-VolumesGetTest-Volume-1761046277',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5485e7fa-353d-4485-ba24-30f2daad7f92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e640ff4d86d542b88f2dba18116829b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:34:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:34:12Z,use_quota=True,user_id='26202c1ba10d4b91882e33e8c46b1802',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:34:12 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-e333bb30-7bc8-47b7-a937-4bf51c3ffc1a tempest-VolumesGetTest-1078145542 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3813961-6fc1-4105-97b6-8862c67fe647) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:34:12 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-e333bb30-7bc8-47b7-a937-4bf51c3ffc1a tempest-VolumesGetTest-1078145542 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3813961-6fc1-4105-97b6-8862c67fe647) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:34:12 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-e333bb30-7bc8-47b7-a937-4bf51c3ffc1a tempest-VolumesGetTest-1078145542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a86a8e41-28ab-4dd2-a0e5-749b6e1d4c61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:34:12 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-e333bb30-7bc8-47b7-a937-4bf51c3ffc1a tempest-VolumesGetTest-1078145542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a86a8e41-28ab-4dd2-a0e5-749b6e1d4c61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5485e7fa-353d-4485-ba24-30f2daad7f92', 'volume_name': 'volume-5485e7fa-353d-4485-ba24-30f2daad7f92', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:34:12 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-e333bb30-7bc8-47b7-a937-4bf51c3ffc1a tempest-VolumesGetTest-1078145542 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdcb9243-34b3-4f50-9127-5e433de650c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:34:12 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-e333bb30-7bc8-47b7-a937-4bf51c3ffc1a tempest-VolumesGetTest-1078145542 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdcb9243-34b3-4f50-9127-5e433de650c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:34:12 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-e333bb30-7bc8-47b7-a937-4bf51c3ffc1a tempest-VolumesGetTest-1078145542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (441a75cc-526c-49fd-a127-06485be008ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:34:12 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-e333bb30-7bc8-47b7-a937-4bf51c3ffc1a tempest-VolumesGetTest-1078145542 None] Volume 5485e7fa-353d-4485-ba24-30f2daad7f92: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5485e7fa-353d-4485-ba24-30f2daad7f92', 'volume_size': 1} Jun 29 03:34:12 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-e333bb30-7bc8-47b7-a937-4bf51c3ffc1a tempest-VolumesGetTest-1078145542 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:34:12 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-e333bb30-7bc8-47b7-a937-4bf51c3ffc1a tempest-VolumesGetTest-1078145542 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:34:12 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-e333bb30-7bc8-47b7-a937-4bf51c3ffc1a tempest-VolumesGetTest-1078145542 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:34:12Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1084475702',display_name='tempest-VolumesGetTest-Volume-1761046277',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5485e7fa-353d-4485-ba24-30f2daad7f92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e640ff4d86d542b88f2dba18116829b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:34:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:34:12Z,use_quota=True,user_id='26202c1ba10d4b91882e33e8c46b1802',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:34:12 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-e333bb30-7bc8-47b7-a937-4bf51c3ffc1a tempest-VolumesGetTest-1078145542 None] Creating volume 5485e7fa-353d-4485-ba24-30f2daad7f92 {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:34:12 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-e333bb30-7bc8-47b7-a937-4bf51c3ffc1a tempest-VolumesGetTest-1078145542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:34:12 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-e333bb30-7bc8-47b7-a937-4bf51c3ffc1a tempest-VolumesGetTest-1078145542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:34:12 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-e333bb30-7bc8-47b7-a937-4bf51c3ffc1a tempest-VolumesGetTest-1078145542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:34:12 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-e333bb30-7bc8-47b7-a937-4bf51c3ffc1a tempest-VolumesGetTest-1078145542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:34:12 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-e333bb30-7bc8-47b7-a937-4bf51c3ffc1a tempest-VolumesGetTest-1078145542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:34:12 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-e333bb30-7bc8-47b7-a937-4bf51c3ffc1a tempest-VolumesGetTest-1078145542 None] Selected osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:34:12 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-e333bb30-7bc8-47b7-a937-4bf51c3ffc1a tempest-VolumesGetTest-1078145542 None] casted to osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f Jun 29 03:34:12 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-e333bb30-7bc8-47b7-a937-4bf51c3ffc1a tempest-VolumesGetTest-1078145542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-5485e7fa-353d-4485-ba24-30f2daad7f92 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:34:12 devstack sudo[107672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-5485e7fa-353d-4485-ba24-30f2daad7f92 1073741824 Jun 29 03:34:12 devstack sudo[107672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:34:13 devstack sudo[107669]: pam_unix(sudo:session): session closed for user root Jun 29 03:34:13 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf" returned: 0 in 1.175s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:34:13 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:34:13 devstack cinder-volume[93468]: DEBUG oslo_service.periodic_task [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Running periodic task VolumeManager._thread_info {{(pid=93468) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 29 03:34:13 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] thread count: 28 {{(pid=93468) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 29 03:34:13 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] thread info: [<_MainThread(MainThread, started 132331377287296)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93468) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 29 03:34:13 devstack sudo[107672]: pam_unix(sudo:session): session closed for user root Jun 29 03:34:13 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-e333bb30-7bc8-47b7-a937-4bf51c3ffc1a tempest-VolumesGetTest-1078145542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-5485e7fa-353d-4485-ba24-30f2daad7f92 1073741824" returned: 0 in 1.099s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:34:13 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-e333bb30-7bc8-47b7-a937-4bf51c3ffc1a tempest-VolumesGetTest-1078145542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-5485e7fa-353d-4485-ba24-30f2daad7f92 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:34:13 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-14654dc9-f7a1-4d3e-86d5-d125d8f04b8a tempest-TestMinimumBasicScenario-1317041294 None] Acquiring lock "cinder-6c65cd75-f256-41bb-90a8-b4cb2b8d4d07-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:34:13 devstack sudo[107679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-5485e7fa-353d-4485-ba24-30f2daad7f92 Jun 29 03:34:13 devstack sudo[107679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:34:13 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-14654dc9-f7a1-4d3e-86d5-d125d8f04b8a tempest-TestMinimumBasicScenario-1317041294 None] Lock "cinder-6c65cd75-f256-41bb-90a8-b4cb2b8d4d07-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:34:13 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-14654dc9-f7a1-4d3e-86d5-d125d8f04b8a tempest-TestMinimumBasicScenario-1317041294 None] Acquiring lock "cinder-quobyte-6c65cd75-f256-41bb-90a8-b4cb2b8d4d07" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:34:13 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-14654dc9-f7a1-4d3e-86d5-d125d8f04b8a tempest-TestMinimumBasicScenario-1317041294 None] Lock "cinder-quobyte-6c65cd75-f256-41bb-90a8-b4cb2b8d4d07" acquired by "delete_volume" :: waited 0.018s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:34:13 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[e401b87d-e9c4-4897-865e-64fd5416b9f8]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:34:13 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-14654dc9-f7a1-4d3e-86d5-d125d8f04b8a tempest-TestMinimumBasicScenario-1317041294 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-6c65cd75-f256-41bb-90a8-b4cb2b8d4d07 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:34:13 devstack sudo[107681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-6c65cd75-f256-41bb-90a8-b4cb2b8d4d07 Jun 29 03:34:13 devstack sudo[107681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:34:14 devstack sudo[107679]: pam_unix(sudo:session): session closed for user root Jun 29 03:34:14 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-e333bb30-7bc8-47b7-a937-4bf51c3ffc1a tempest-VolumesGetTest-1078145542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-5485e7fa-353d-4485-ba24-30f2daad7f92" returned: 0 in 0.928s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:34:14 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-e333bb30-7bc8-47b7-a937-4bf51c3ffc1a tempest-VolumesGetTest-1078145542 None] <== create_volume: return (2098ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:34:14 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-e333bb30-7bc8-47b7-a937-4bf51c3ffc1a tempest-VolumesGetTest-1078145542 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.102s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:34:14 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-e333bb30-7bc8-47b7-a937-4bf51c3ffc1a tempest-VolumesGetTest-1078145542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (441a75cc-526c-49fd-a127-06485be008ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5485e7fa-353d-4485-ba24-30f2daad7f92', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:34:14 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-e333bb30-7bc8-47b7-a937-4bf51c3ffc1a tempest-VolumesGetTest-1078145542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c7e664f-1ff3-4777-87c8-74041b208431) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:34:14 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-e333bb30-7bc8-47b7-a937-4bf51c3ffc1a tempest-VolumesGetTest-1078145542 None] Volume volume-5485e7fa-353d-4485-ba24-30f2daad7f92 (5485e7fa-353d-4485-ba24-30f2daad7f92): created successfully Jun 29 03:34:14 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-e333bb30-7bc8-47b7-a937-4bf51c3ffc1a tempest-VolumesGetTest-1078145542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c7e664f-1ff3-4777-87c8-74041b208431) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:34:14 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-e333bb30-7bc8-47b7-a937-4bf51c3ffc1a tempest-VolumesGetTest-1078145542 None] Flow 'volume_create_manager' (090d0175-9631-42ef-a5d7-cf5cafacef33) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:34:14 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-e333bb30-7bc8-47b7-a937-4bf51c3ffc1a tempest-VolumesGetTest-1078145542 None] Created volume successfully. Jun 29 03:34:14 devstack sudo[107681]: pam_unix(sudo:session): session closed for user root Jun 29 03:34:14 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-14654dc9-f7a1-4d3e-86d5-d125d8f04b8a tempest-TestMinimumBasicScenario-1317041294 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-6c65cd75-f256-41bb-90a8-b4cb2b8d4d07" returned: 0 in 1.042s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:34:14 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-14654dc9-f7a1-4d3e-86d5-d125d8f04b8a tempest-TestMinimumBasicScenario-1317041294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-6c65cd75-f256-41bb-90a8-b4cb2b8d4d07 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:34:14 devstack sudo[107689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-6c65cd75-f256-41bb-90a8-b4cb2b8d4d07 Jun 29 03:34:14 devstack sudo[107689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:34:15 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-4abcbabf-f386-4d88-a574-09d49cca1bde tempest-VolumesGetTest-1078145542 None] Acquiring lock "cinder-5485e7fa-353d-4485-ba24-30f2daad7f92-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:34:15 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-4abcbabf-f386-4d88-a574-09d49cca1bde tempest-VolumesGetTest-1078145542 None] Lock "cinder-5485e7fa-353d-4485-ba24-30f2daad7f92-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:34:15 devstack sudo[107689]: pam_unix(sudo:session): session closed for user root Jun 29 03:34:15 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-14654dc9-f7a1-4d3e-86d5-d125d8f04b8a tempest-TestMinimumBasicScenario-1317041294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-6c65cd75-f256-41bb-90a8-b4cb2b8d4d07" returned: 0 in 1.104s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:34:15 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-4abcbabf-f386-4d88-a574-09d49cca1bde tempest-VolumesGetTest-1078145542 None] Acquiring lock "cinder-quobyte-5485e7fa-353d-4485-ba24-30f2daad7f92" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:34:16 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-14654dc9-f7a1-4d3e-86d5-d125d8f04b8a tempest-TestMinimumBasicScenario-1317041294 None] Lock "cinder-quobyte-6c65cd75-f256-41bb-90a8-b4cb2b8d4d07" released by "delete_volume" :: held 2.233s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:34:16 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-4abcbabf-f386-4d88-a574-09d49cca1bde tempest-VolumesGetTest-1078145542 None] Lock "cinder-quobyte-5485e7fa-353d-4485-ba24-30f2daad7f92" acquired by "delete_volume" :: waited 0.036s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:34:16 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd44e006-328b-46de-b236-44ff51b28fb7]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:34:16 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-4abcbabf-f386-4d88-a574-09d49cca1bde tempest-VolumesGetTest-1078145542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-5485e7fa-353d-4485-ba24-30f2daad7f92 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:34:16 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-14654dc9-f7a1-4d3e-86d5-d125d8f04b8a tempest-TestMinimumBasicScenario-1317041294 None] Created reservations ['7c378374-0d7e-4161-be8e-9eca73a4c326', '980523ca-0a06-4921-83ee-f57a7168721d', '1765aa3c-5db0-4bb5-bbd9-81dbdada50a3', '6f11404b-3d8c-4bf8-a048-0dda100b72de'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:34:16 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-14654dc9-f7a1-4d3e-86d5-d125d8f04b8a tempest-TestMinimumBasicScenario-1317041294 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:34:16 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-14654dc9-f7a1-4d3e-86d5-d125d8f04b8a tempest-TestMinimumBasicScenario-1317041294 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:34:16 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-14654dc9-f7a1-4d3e-86d5-d125d8f04b8a tempest-TestMinimumBasicScenario-1317041294 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:34:16 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-14654dc9-f7a1-4d3e-86d5-d125d8f04b8a tempest-TestMinimumBasicScenario-1317041294 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:34:16 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-14654dc9-f7a1-4d3e-86d5-d125d8f04b8a tempest-TestMinimumBasicScenario-1317041294 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:34:16 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-14654dc9-f7a1-4d3e-86d5-d125d8f04b8a tempest-TestMinimumBasicScenario-1317041294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:34:16 devstack sudo[107693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf Jun 29 03:34:16 devstack sudo[107693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:34:16 devstack sudo[107692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-5485e7fa-353d-4485-ba24-30f2daad7f92 Jun 29 03:34:16 devstack sudo[107692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:34:17 devstack sudo[107692]: pam_unix(sudo:session): session closed for user root Jun 29 03:34:17 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-4abcbabf-f386-4d88-a574-09d49cca1bde tempest-VolumesGetTest-1078145542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-5485e7fa-353d-4485-ba24-30f2daad7f92" returned: 0 in 1.119s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:34:17 devstack sudo[107693]: pam_unix(sudo:session): session closed for user root Jun 29 03:34:17 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-4abcbabf-f386-4d88-a574-09d49cca1bde tempest-VolumesGetTest-1078145542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-5485e7fa-353d-4485-ba24-30f2daad7f92 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:34:17 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-14654dc9-f7a1-4d3e-86d5-d125d8f04b8a tempest-TestMinimumBasicScenario-1317041294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf" returned: 0 in 1.016s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:34:17 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-14654dc9-f7a1-4d3e-86d5-d125d8f04b8a tempest-TestMinimumBasicScenario-1317041294 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:34:17 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-14654dc9-f7a1-4d3e-86d5-d125d8f04b8a tempest-TestMinimumBasicScenario-1317041294 None] Deleted volume successfully. Jun 29 03:34:17 devstack sudo[107703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-5485e7fa-353d-4485-ba24-30f2daad7f92 Jun 29 03:34:17 devstack sudo[107703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:34:17 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-14654dc9-f7a1-4d3e-86d5-d125d8f04b8a tempest-TestMinimumBasicScenario-1317041294 None] Lock "cinder-6c65cd75-f256-41bb-90a8-b4cb2b8d4d07-delete_volume" released by "delete_volume" :: held 3.594s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:34:18 devstack sudo[107703]: pam_unix(sudo:session): session closed for user root Jun 29 03:34:18 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-4abcbabf-f386-4d88-a574-09d49cca1bde tempest-VolumesGetTest-1078145542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-5485e7fa-353d-4485-ba24-30f2daad7f92" returned: 0 in 1.155s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:34:18 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-4abcbabf-f386-4d88-a574-09d49cca1bde tempest-VolumesGetTest-1078145542 None] Lock "cinder-quobyte-5485e7fa-353d-4485-ba24-30f2daad7f92" released by "delete_volume" :: held 2.355s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:34:18 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-4abcbabf-f386-4d88-a574-09d49cca1bde tempest-VolumesGetTest-1078145542 None] Created reservations ['231a3813-6a7e-462c-8814-7a63c9adae11', '6f036212-030a-4ab7-b03f-79265f2a5cc1', '5ab92343-e2bf-4aca-9bc5-72f6049cfd36', '4735d49b-4c68-4e4f-8265-4a26f6565880'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:34:18 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-4abcbabf-f386-4d88-a574-09d49cca1bde tempest-VolumesGetTest-1078145542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:34:18 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-4abcbabf-f386-4d88-a574-09d49cca1bde tempest-VolumesGetTest-1078145542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:34:18 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-4abcbabf-f386-4d88-a574-09d49cca1bde tempest-VolumesGetTest-1078145542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:34:18 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-4abcbabf-f386-4d88-a574-09d49cca1bde tempest-VolumesGetTest-1078145542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:34:18 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-4abcbabf-f386-4d88-a574-09d49cca1bde tempest-VolumesGetTest-1078145542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:34:18 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-4abcbabf-f386-4d88-a574-09d49cca1bde tempest-VolumesGetTest-1078145542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:34:18 devstack sudo[107731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf Jun 29 03:34:18 devstack sudo[107731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:34:19 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-c31325e6-3c5f-4047-b261-ef1a8f3de92f tempest-GroupsTest-656558624 None] Group tempest-Group1-1996401383: creating Jun 29 03:34:19 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-c31325e6-3c5f-4047-b261-ef1a8f3de92f tempest-GroupsTest-656558624 None] Group tempest-Group1-1996401383: created successfully Jun 29 03:34:19 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-c31325e6-3c5f-4047-b261-ef1a8f3de92f tempest-GroupsTest-656558624 None] Create group completed successfully. Jun 29 03:34:19 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-30e45698-ae8e-4237-b74b-ab1ad9e43639 tempest-VolumesGetTest-1078145542 None] Acquiring lock "cinder-89dc4c32-8382-478c-a869-b6c54e363dc8-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:34:19 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-30e45698-ae8e-4237-b74b-ab1ad9e43639 tempest-VolumesGetTest-1078145542 None] Lock "cinder-89dc4c32-8382-478c-a869-b6c54e363dc8-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:34:19 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-30e45698-ae8e-4237-b74b-ab1ad9e43639 tempest-VolumesGetTest-1078145542 None] Acquiring lock "cinder-quobyte-89dc4c32-8382-478c-a869-b6c54e363dc8" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:34:19 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-30e45698-ae8e-4237-b74b-ab1ad9e43639 tempest-VolumesGetTest-1078145542 None] Lock "cinder-quobyte-89dc4c32-8382-478c-a869-b6c54e363dc8" acquired by "delete_volume" :: waited 0.019s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:34:19 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfb5ad21-4260-47ed-9af1-e87328df2d43]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:34:19 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-30e45698-ae8e-4237-b74b-ab1ad9e43639 tempest-VolumesGetTest-1078145542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-89dc4c32-8382-478c-a869-b6c54e363dc8 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:34:19 devstack sudo[107747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-89dc4c32-8382-478c-a869-b6c54e363dc8 Jun 29 03:34:19 devstack sudo[107747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:34:19 devstack sudo[107731]: pam_unix(sudo:session): session closed for user root Jun 29 03:34:19 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-4abcbabf-f386-4d88-a574-09d49cca1bde tempest-VolumesGetTest-1078145542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf" returned: 0 in 0.926s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:34:19 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-4abcbabf-f386-4d88-a574-09d49cca1bde tempest-VolumesGetTest-1078145542 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:34:19 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-4abcbabf-f386-4d88-a574-09d49cca1bde tempest-VolumesGetTest-1078145542 None] Deleted volume successfully. Jun 29 03:34:19 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-4abcbabf-f386-4d88-a574-09d49cca1bde tempest-VolumesGetTest-1078145542 None] Lock "cinder-5485e7fa-353d-4485-ba24-30f2daad7f92-delete_volume" released by "delete_volume" :: held 3.811s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:34:20 devstack sudo[107747]: pam_unix(sudo:session): session closed for user root Jun 29 03:34:20 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-30e45698-ae8e-4237-b74b-ab1ad9e43639 tempest-VolumesGetTest-1078145542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-89dc4c32-8382-478c-a869-b6c54e363dc8" returned: 0 in 0.904s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:34:20 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-30e45698-ae8e-4237-b74b-ab1ad9e43639 tempest-VolumesGetTest-1078145542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-89dc4c32-8382-478c-a869-b6c54e363dc8 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:34:20 devstack sudo[107755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-89dc4c32-8382-478c-a869-b6c54e363dc8 Jun 29 03:34:20 devstack sudo[107755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:34:20 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-6edead10-f8f6-4f4f-ade4-532fa0bc63e3 tempest-GroupsTest-656558624 None] Group tempest-Group2-1262682346: creating Jun 29 03:34:20 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-6edead10-f8f6-4f4f-ade4-532fa0bc63e3 tempest-GroupsTest-656558624 None] Group tempest-Group2-1262682346: created successfully Jun 29 03:34:20 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-6edead10-f8f6-4f4f-ade4-532fa0bc63e3 tempest-GroupsTest-656558624 None] Create group completed successfully. Jun 29 03:34:21 devstack sudo[107755]: pam_unix(sudo:session): session closed for user root Jun 29 03:34:21 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-30e45698-ae8e-4237-b74b-ab1ad9e43639 tempest-VolumesGetTest-1078145542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-89dc4c32-8382-478c-a869-b6c54e363dc8" returned: 0 in 0.844s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:34:21 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-30e45698-ae8e-4237-b74b-ab1ad9e43639 tempest-VolumesGetTest-1078145542 None] Lock "cinder-quobyte-89dc4c32-8382-478c-a869-b6c54e363dc8" released by "delete_volume" :: held 1.806s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:34:21 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-30e45698-ae8e-4237-b74b-ab1ad9e43639 tempest-VolumesGetTest-1078145542 None] Created reservations ['6c75befd-eeed-44fa-b5da-ee27d11bbf84', 'bbbd7425-4646-44d2-ad9c-11d262a097f7', 'cc066d9a-3086-429b-933b-b6cfe92c1b80', 'dc08d3f3-c28f-4162-8133-29fb38b8a35b'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:34:21 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-30e45698-ae8e-4237-b74b-ab1ad9e43639 tempest-VolumesGetTest-1078145542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:34:21 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-30e45698-ae8e-4237-b74b-ab1ad9e43639 tempest-VolumesGetTest-1078145542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:34:21 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-30e45698-ae8e-4237-b74b-ab1ad9e43639 tempest-VolumesGetTest-1078145542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:34:21 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-30e45698-ae8e-4237-b74b-ab1ad9e43639 tempest-VolumesGetTest-1078145542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:34:21 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-30e45698-ae8e-4237-b74b-ab1ad9e43639 tempest-VolumesGetTest-1078145542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:34:21 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-30e45698-ae8e-4237-b74b-ab1ad9e43639 tempest-VolumesGetTest-1078145542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:34:21 devstack sudo[107759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf Jun 29 03:34:21 devstack sudo[107759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:34:21 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-e347fbc0-ba66-4be9-8ab6-40ad8b08ccf6 tempest-VolumesGetTest-1078145542 None] Acquiring lock "cinder-cc0f74c3-55bd-4c8b-ac8a-2884a8a5b6c7-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:34:21 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-e347fbc0-ba66-4be9-8ab6-40ad8b08ccf6 tempest-VolumesGetTest-1078145542 None] Lock "cinder-cc0f74c3-55bd-4c8b-ac8a-2884a8a5b6c7-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:34:21 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-e347fbc0-ba66-4be9-8ab6-40ad8b08ccf6 tempest-VolumesGetTest-1078145542 None] Acquiring lock "cinder-quobyte-cc0f74c3-55bd-4c8b-ac8a-2884a8a5b6c7" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:34:21 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-e347fbc0-ba66-4be9-8ab6-40ad8b08ccf6 tempest-VolumesGetTest-1078145542 None] Lock "cinder-quobyte-cc0f74c3-55bd-4c8b-ac8a-2884a8a5b6c7" acquired by "delete_volume" :: waited 0.032s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:34:21 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[04ee18f1-78e8-408f-99fb-b6adccbac258]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:34:21 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-e347fbc0-ba66-4be9-8ab6-40ad8b08ccf6 tempest-VolumesGetTest-1078145542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-cc0f74c3-55bd-4c8b-ac8a-2884a8a5b6c7 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:34:22 devstack sudo[107762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-cc0f74c3-55bd-4c8b-ac8a-2884a8a5b6c7 Jun 29 03:34:22 devstack sudo[107762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:34:22 devstack sudo[107759]: pam_unix(sudo:session): session closed for user root Jun 29 03:34:22 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-30e45698-ae8e-4237-b74b-ab1ad9e43639 tempest-VolumesGetTest-1078145542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf" returned: 0 in 1.080s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:34:22 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-30e45698-ae8e-4237-b74b-ab1ad9e43639 tempest-VolumesGetTest-1078145542 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:34:22 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-30e45698-ae8e-4237-b74b-ab1ad9e43639 tempest-VolumesGetTest-1078145542 None] Deleted volume successfully. Jun 29 03:34:22 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a1374d1-8b3c-4ade-9c54-1d8b482140cc tempest-GroupsTest-656558624 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:34:22 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-4a1374d1-8b3c-4ade-9c54-1d8b482140cc tempest-GroupsTest-656558624 None] Flow 'volume_create_manager' (cfacc5b7-084f-4652-9115-6bd6543e9ef7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:34:22 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-4a1374d1-8b3c-4ade-9c54-1d8b482140cc tempest-GroupsTest-656558624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5c32e66-2c8a-4b25-af58-93a4d941e8e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:34:22 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-30e45698-ae8e-4237-b74b-ab1ad9e43639 tempest-VolumesGetTest-1078145542 None] Lock "cinder-89dc4c32-8382-478c-a869-b6c54e363dc8-delete_volume" released by "delete_volume" :: held 3.147s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:34:22 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-4a1374d1-8b3c-4ade-9c54-1d8b482140cc tempest-GroupsTest-656558624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5c32e66-2c8a-4b25-af58-93a4d941e8e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:34:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-321743161',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ea1e100a-8279-44d3-bb67-f174ce99c9ae,host='devstack@QuobyteHD#QuobyteHD',id=7a92c935-1aa1-425a-91c4-28225b038edc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46a88042177b4cac87af8d51e6ec873d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:34:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:34:22Z,use_quota=True,user_id='b17870b7b91d4b8b94db557ec7a5faf4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc399803-7ceb-4adb-ae5e-e28726fe1a44),volume_type_id=fc399803-7ceb-4adb-ae5e-e28726fe1a44)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:34:22 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-4a1374d1-8b3c-4ade-9c54-1d8b482140cc tempest-GroupsTest-656558624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f21d77c-1127-40ea-80a8-a5b5b057697f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:34:22 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-4a1374d1-8b3c-4ade-9c54-1d8b482140cc tempest-GroupsTest-656558624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f21d77c-1127-40ea-80a8-a5b5b057697f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:34:22 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-4a1374d1-8b3c-4ade-9c54-1d8b482140cc tempest-GroupsTest-656558624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d169454e-73a9-4c46-93e6-aa1afc13d484) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:34:22 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-4a1374d1-8b3c-4ade-9c54-1d8b482140cc tempest-GroupsTest-656558624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d169454e-73a9-4c46-93e6-aa1afc13d484) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a92c935-1aa1-425a-91c4-28225b038edc', 'volume_name': 'volume-7a92c935-1aa1-425a-91c4-28225b038edc', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:34:22 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-4a1374d1-8b3c-4ade-9c54-1d8b482140cc tempest-GroupsTest-656558624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82154b02-5804-44c8-a61e-77caddbed986) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:34:22 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-4a1374d1-8b3c-4ade-9c54-1d8b482140cc tempest-GroupsTest-656558624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82154b02-5804-44c8-a61e-77caddbed986) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:34:22 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-4a1374d1-8b3c-4ade-9c54-1d8b482140cc tempest-GroupsTest-656558624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4c29f45-83cc-48b8-a6e1-9e36e542ff53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:34:22 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-4a1374d1-8b3c-4ade-9c54-1d8b482140cc tempest-GroupsTest-656558624 None] Volume 7a92c935-1aa1-425a-91c4-28225b038edc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a92c935-1aa1-425a-91c4-28225b038edc', 'volume_size': 1} Jun 29 03:34:22 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-4a1374d1-8b3c-4ade-9c54-1d8b482140cc tempest-GroupsTest-656558624 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:34:22 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-4a1374d1-8b3c-4ade-9c54-1d8b482140cc tempest-GroupsTest-656558624 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:34:22 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-4a1374d1-8b3c-4ade-9c54-1d8b482140cc tempest-GroupsTest-656558624 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=ea1e100a-8279-44d3-bb67-f174ce99c9ae,created_at=2026-06-29T01:34:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-321743161',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ea1e100a-8279-44d3-bb67-f174ce99c9ae,host='devstack@QuobyteHD#QuobyteHD',id=7a92c935-1aa1-425a-91c4-28225b038edc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46a88042177b4cac87af8d51e6ec873d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:34:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:34:22Z,use_quota=True,user_id='b17870b7b91d4b8b94db557ec7a5faf4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc399803-7ceb-4adb-ae5e-e28726fe1a44),volume_type_id=fc399803-7ceb-4adb-ae5e-e28726fe1a44)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:34:22 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-4a1374d1-8b3c-4ade-9c54-1d8b482140cc tempest-GroupsTest-656558624 None] Creating volume 7a92c935-1aa1-425a-91c4-28225b038edc {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:34:22 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-4a1374d1-8b3c-4ade-9c54-1d8b482140cc tempest-GroupsTest-656558624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:34:22 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-4a1374d1-8b3c-4ade-9c54-1d8b482140cc tempest-GroupsTest-656558624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:34:22 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-4a1374d1-8b3c-4ade-9c54-1d8b482140cc tempest-GroupsTest-656558624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:34:22 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-4a1374d1-8b3c-4ade-9c54-1d8b482140cc tempest-GroupsTest-656558624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:34:22 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-4a1374d1-8b3c-4ade-9c54-1d8b482140cc tempest-GroupsTest-656558624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:34:22 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-4a1374d1-8b3c-4ade-9c54-1d8b482140cc tempest-GroupsTest-656558624 None] Selected osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:34:22 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-4a1374d1-8b3c-4ade-9c54-1d8b482140cc tempest-GroupsTest-656558624 None] casted to osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f Jun 29 03:34:22 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-4a1374d1-8b3c-4ade-9c54-1d8b482140cc tempest-GroupsTest-656558624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-7a92c935-1aa1-425a-91c4-28225b038edc 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:34:22 devstack sudo[107765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-7a92c935-1aa1-425a-91c4-28225b038edc 1073741824 Jun 29 03:34:22 devstack sudo[107765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:34:23 devstack sudo[107762]: pam_unix(sudo:session): session closed for user root Jun 29 03:34:23 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-e347fbc0-ba66-4be9-8ab6-40ad8b08ccf6 tempest-VolumesGetTest-1078145542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-cc0f74c3-55bd-4c8b-ac8a-2884a8a5b6c7" returned: 0 in 1.246s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:34:23 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-e347fbc0-ba66-4be9-8ab6-40ad8b08ccf6 tempest-VolumesGetTest-1078145542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-cc0f74c3-55bd-4c8b-ac8a-2884a8a5b6c7 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:34:23 devstack sudo[107770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-cc0f74c3-55bd-4c8b-ac8a-2884a8a5b6c7 Jun 29 03:34:23 devstack sudo[107770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:34:23 devstack sudo[107765]: pam_unix(sudo:session): session closed for user root Jun 29 03:34:23 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-4a1374d1-8b3c-4ade-9c54-1d8b482140cc tempest-GroupsTest-656558624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-7a92c935-1aa1-425a-91c4-28225b038edc 1073741824" returned: 0 in 1.258s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:34:23 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-4a1374d1-8b3c-4ade-9c54-1d8b482140cc tempest-GroupsTest-656558624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-7a92c935-1aa1-425a-91c4-28225b038edc {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:34:23 devstack sudo[107777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-7a92c935-1aa1-425a-91c4-28225b038edc Jun 29 03:34:23 devstack sudo[107777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:34:24 devstack sudo[107770]: pam_unix(sudo:session): session closed for user root Jun 29 03:34:24 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-e347fbc0-ba66-4be9-8ab6-40ad8b08ccf6 tempest-VolumesGetTest-1078145542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-cc0f74c3-55bd-4c8b-ac8a-2884a8a5b6c7" returned: 0 in 0.825s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:34:24 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-e347fbc0-ba66-4be9-8ab6-40ad8b08ccf6 tempest-VolumesGetTest-1078145542 None] Lock "cinder-quobyte-cc0f74c3-55bd-4c8b-ac8a-2884a8a5b6c7" released by "delete_volume" :: held 2.197s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:34:24 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-e347fbc0-ba66-4be9-8ab6-40ad8b08ccf6 tempest-VolumesGetTest-1078145542 None] Created reservations ['dec5b3ba-6bc5-4b61-a5f8-75194b45e543', '042ea778-a810-4d9e-aa45-a45884c8e40a', '961f7161-ab78-4378-98ff-38fcafd024bf', '7cc67d1b-de70-49b5-b696-9045bc8d167d'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:34:24 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-e347fbc0-ba66-4be9-8ab6-40ad8b08ccf6 tempest-VolumesGetTest-1078145542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:34:24 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-e347fbc0-ba66-4be9-8ab6-40ad8b08ccf6 tempest-VolumesGetTest-1078145542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:34:24 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-e347fbc0-ba66-4be9-8ab6-40ad8b08ccf6 tempest-VolumesGetTest-1078145542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:34:24 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-e347fbc0-ba66-4be9-8ab6-40ad8b08ccf6 tempest-VolumesGetTest-1078145542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:34:24 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-e347fbc0-ba66-4be9-8ab6-40ad8b08ccf6 tempest-VolumesGetTest-1078145542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:34:24 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-e347fbc0-ba66-4be9-8ab6-40ad8b08ccf6 tempest-VolumesGetTest-1078145542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:34:24 devstack sudo[107779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf Jun 29 03:34:24 devstack sudo[107779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:34:24 devstack sudo[107777]: pam_unix(sudo:session): session closed for user root Jun 29 03:34:24 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-4a1374d1-8b3c-4ade-9c54-1d8b482140cc tempest-GroupsTest-656558624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-7a92c935-1aa1-425a-91c4-28225b038edc" returned: 0 in 0.890s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:34:24 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-4a1374d1-8b3c-4ade-9c54-1d8b482140cc tempest-GroupsTest-656558624 None] <== create_volume: return (2209ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:34:24 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-4a1374d1-8b3c-4ade-9c54-1d8b482140cc tempest-GroupsTest-656558624 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.213s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:34:24 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-4a1374d1-8b3c-4ade-9c54-1d8b482140cc tempest-GroupsTest-656558624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4c29f45-83cc-48b8-a6e1-9e36e542ff53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a92c935-1aa1-425a-91c4-28225b038edc', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:34:24 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-4a1374d1-8b3c-4ade-9c54-1d8b482140cc tempest-GroupsTest-656558624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0047b800-7a71-415c-a482-98a758eb00e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:34:24 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-4a1374d1-8b3c-4ade-9c54-1d8b482140cc tempest-GroupsTest-656558624 None] Volume volume-7a92c935-1aa1-425a-91c4-28225b038edc (7a92c935-1aa1-425a-91c4-28225b038edc): created successfully Jun 29 03:34:24 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-4a1374d1-8b3c-4ade-9c54-1d8b482140cc tempest-GroupsTest-656558624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0047b800-7a71-415c-a482-98a758eb00e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:34:24 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-4a1374d1-8b3c-4ade-9c54-1d8b482140cc tempest-GroupsTest-656558624 None] Flow 'volume_create_manager' (cfacc5b7-084f-4652-9115-6bd6543e9ef7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:34:24 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-4a1374d1-8b3c-4ade-9c54-1d8b482140cc tempest-GroupsTest-656558624 None] Created volume successfully. Jun 29 03:34:25 devstack sudo[107779]: pam_unix(sudo:session): session closed for user root Jun 29 03:34:25 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-e347fbc0-ba66-4be9-8ab6-40ad8b08ccf6 tempest-VolumesGetTest-1078145542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf" returned: 0 in 0.891s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:34:25 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-e347fbc0-ba66-4be9-8ab6-40ad8b08ccf6 tempest-VolumesGetTest-1078145542 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:34:25 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-e347fbc0-ba66-4be9-8ab6-40ad8b08ccf6 tempest-VolumesGetTest-1078145542 None] Deleted volume successfully. Jun 29 03:34:25 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-e347fbc0-ba66-4be9-8ab6-40ad8b08ccf6 tempest-VolumesGetTest-1078145542 None] Lock "cinder-cc0f74c3-55bd-4c8b-ac8a-2884a8a5b6c7-delete_volume" released by "delete_volume" :: held 3.439s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:34:26 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-e70b0415-c823-4354-b2e5-59fa33ad95c5 tempest-VolumesGetTest-1078145542 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:34:26 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-e70b0415-c823-4354-b2e5-59fa33ad95c5 tempest-VolumesGetTest-1078145542 None] Flow 'volume_create_manager' (fbb9db26-5556-4128-83ba-644feb0d4f2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:34:26 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-e70b0415-c823-4354-b2e5-59fa33ad95c5 tempest-VolumesGetTest-1078145542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8724b199-9257-40ff-8f07-2dd34df58c7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:34:26 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-e70b0415-c823-4354-b2e5-59fa33ad95c5 tempest-VolumesGetTest-1078145542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8724b199-9257-40ff-8f07-2dd34df58c7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:34:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-134997067',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69d5fa60-e59f-4e22-be42-ee6cc9c7293e,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='e640ff4d86d542b88f2dba18116829b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:34:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:34:26Z,use_quota=True,user_id='26202c1ba10d4b91882e33e8c46b1802',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:34:26 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-e70b0415-c823-4354-b2e5-59fa33ad95c5 tempest-VolumesGetTest-1078145542 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65679180-97ff-4a19-b0d3-3f4cfece458a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:34:26 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-e70b0415-c823-4354-b2e5-59fa33ad95c5 tempest-VolumesGetTest-1078145542 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65679180-97ff-4a19-b0d3-3f4cfece458a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:34:26 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-e70b0415-c823-4354-b2e5-59fa33ad95c5 tempest-VolumesGetTest-1078145542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6b73d1f-dae3-4966-bde8-1cb50c801e9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:34:26 devstack cinder-volume[93468]: DEBUG cinder.image.glance [None req-e70b0415-c823-4354-b2e5-59fa33ad95c5 tempest-VolumesGetTest-1078145542 None] Creating Keystone auth plugin from conf {{(pid=93468) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 29 03:34:26 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-e70b0415-c823-4354-b2e5-59fa33ad95c5 tempest-VolumesGetTest-1078145542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6b73d1f-dae3-4966-bde8-1cb50c801e9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '69d5fa60-e59f-4e22-be42-ee6cc9c7293e', 'volume_name': 'volume-69d5fa60-e59f-4e22-be42-ee6cc9c7293e', 'volume_size': 1, 'image_id': '24cf6ce1-1d2d-493f-a115-2a39928c82fb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/24cf6ce1-1d2d-493f-a115-2a39928c82fb', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1335b5873eea4762b9fea7f84dd1615c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '24cf6ce1-1d2d-493f-a115-2a39928c82fb', 'created_at': datetime.datetime(2026, 6, 29, 1, 13, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 29, 1, 13, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/24cf6ce1-1d2d-493f-a115-2a39928c82fb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:34:26 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-e70b0415-c823-4354-b2e5-59fa33ad95c5 tempest-VolumesGetTest-1078145542 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ca24b2e-8913-45c9-873a-dec5761480e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:34:26 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-e70b0415-c823-4354-b2e5-59fa33ad95c5 tempest-VolumesGetTest-1078145542 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ca24b2e-8913-45c9-873a-dec5761480e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:34:26 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-e70b0415-c823-4354-b2e5-59fa33ad95c5 tempest-VolumesGetTest-1078145542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8aab6627-ceed-4717-9ac5-517c260ca4e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:34:26 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-e70b0415-c823-4354-b2e5-59fa33ad95c5 tempest-VolumesGetTest-1078145542 None] Volume 69d5fa60-e59f-4e22-be42-ee6cc9c7293e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-69d5fa60-e59f-4e22-be42-ee6cc9c7293e', 'volume_size': 1, 'image_id': '24cf6ce1-1d2d-493f-a115-2a39928c82fb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/24cf6ce1-1d2d-493f-a115-2a39928c82fb', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1335b5873eea4762b9fea7f84dd1615c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '24cf6ce1-1d2d-493f-a115-2a39928c82fb', 'created_at': datetime.datetime(2026, 6, 29, 1, 13, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 29, 1, 13, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/24cf6ce1-1d2d-493f-a115-2a39928c82fb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jun 29 03:34:26 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-e70b0415-c823-4354-b2e5-59fa33ad95c5 tempest-VolumesGetTest-1078145542 None] Trying to clone 69d5fa60-e59f-4e22-be42-ee6cc9c7293e from image 24cf6ce1-1d2d-493f-a115-2a39928c82fb at location (None, [{'url': 'file:///opt/stack/data/glance/images/24cf6ce1-1d2d-493f-a115-2a39928c82fb', 'metadata': {}}]). {{(pid=93468) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 29 03:34:27 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-595b6e50-0981-4226-967d-45b92054b313 tempest-GroupsTest-656558624 None] Acquiring lock "cinder-quobyte-7a92c935-1aa1-425a-91c4-28225b038edc" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:34:27 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-595b6e50-0981-4226-967d-45b92054b313 tempest-GroupsTest-656558624 None] Lock "cinder-quobyte-7a92c935-1aa1-425a-91c4-28225b038edc" acquired by "delete_volume" :: waited 0.031s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:34:27 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[70f70c85-eb6b-4b00-bb15-79f42bc1605f]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:34:27 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-595b6e50-0981-4226-967d-45b92054b313 tempest-GroupsTest-656558624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-7a92c935-1aa1-425a-91c4-28225b038edc {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:34:27 devstack cinder-volume[93468]: DEBUG cinder.image.image_utils [None req-e70b0415-c823-4354-b2e5-59fa33ad95c5 tempest-VolumesGetTest-1078145542 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_24cf6ce1-1d2d-493f-a115-2a39928c82fb_a29m6jg5devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=93468) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 29 03:34:27 devstack cinder-volume[93468]: INFO cinder.image.image_utils [None req-e70b0415-c823-4354-b2e5-59fa33ad95c5 tempest-VolumesGetTest-1078145542 None] Image download 20.69 MB at 20.69 MB/s Jun 29 03:34:27 devstack sudo[107791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-7a92c935-1aa1-425a-91c4-28225b038edc Jun 29 03:34:27 devstack sudo[107791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:34:27 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[785e3b68-4cf4-4f7b-9314-85b9718e73c7]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:34:27 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-e70b0415-c823-4354-b2e5-59fa33ad95c5 tempest-VolumesGetTest-1078145542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_24cf6ce1-1d2d-493f-a115-2a39928c82fb_a29m6jg5devstack@QuobyteHD {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:34:27 devstack sudo[107793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_24cf6ce1-1d2d-493f-a115-2a39928c82fb_a29m6jg5devstack@QuobyteHD Jun 29 03:34:27 devstack sudo[107793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:34:28 devstack sudo[107791]: pam_unix(sudo:session): session closed for user root Jun 29 03:34:28 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-595b6e50-0981-4226-967d-45b92054b313 tempest-GroupsTest-656558624 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-7a92c935-1aa1-425a-91c4-28225b038edc" returned: 0 in 0.883s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:34:28 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-595b6e50-0981-4226-967d-45b92054b313 tempest-GroupsTest-656558624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-7a92c935-1aa1-425a-91c4-28225b038edc {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:34:28 devstack sudo[107801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-7a92c935-1aa1-425a-91c4-28225b038edc Jun 29 03:34:28 devstack sudo[107801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:34:28 devstack sudo[107793]: pam_unix(sudo:session): session closed for user root Jun 29 03:34:28 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-e70b0415-c823-4354-b2e5-59fa33ad95c5 tempest-VolumesGetTest-1078145542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_24cf6ce1-1d2d-493f-a115-2a39928c82fb_a29m6jg5devstack@QuobyteHD" returned: 0 in 0.847s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:34:28 devstack cinder-volume[93468]: DEBUG cinder.image.image_utils [None req-e70b0415-c823-4354-b2e5-59fa33ad95c5 tempest-VolumesGetTest-1078145542 None] Temporary image 24cf6ce1-1d2d-493f-a115-2a39928c82fb is fetched for user 26202c1ba10d4b91882e33e8c46b1802. {{(pid=93468) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 29 03:34:28 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcb211e4-23dc-4275-854d-eacbe1dd500d]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:34:28 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-e70b0415-c823-4354-b2e5-59fa33ad95c5 tempest-VolumesGetTest-1078145542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_24cf6ce1-1d2d-493f-a115-2a39928c82fb_a29m6jg5devstack@QuobyteHD {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:34:28 devstack sudo[107803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_24cf6ce1-1d2d-493f-a115-2a39928c82fb_a29m6jg5devstack@QuobyteHD Jun 29 03:34:28 devstack sudo[107803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:34:29 devstack sudo[107801]: pam_unix(sudo:session): session closed for user root Jun 29 03:34:29 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-595b6e50-0981-4226-967d-45b92054b313 tempest-GroupsTest-656558624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-7a92c935-1aa1-425a-91c4-28225b038edc" returned: 0 in 1.032s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:34:29 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-595b6e50-0981-4226-967d-45b92054b313 tempest-GroupsTest-656558624 None] Lock "cinder-quobyte-7a92c935-1aa1-425a-91c4-28225b038edc" released by "delete_volume" :: held 1.995s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:34:29 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-595b6e50-0981-4226-967d-45b92054b313 tempest-GroupsTest-656558624 None] Created reservations ['56221157-e257-4957-8ea2-1f88dd318832'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:34:29 devstack cinder-volume[93468]: WARNING cinder.quota [None req-595b6e50-0981-4226-967d-45b92054b313 tempest-GroupsTest-656558624 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-59031161 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-59031161, it is now deprecated. Please use the default quota class for default quota. Jun 29 03:34:29 devstack cinder-volume[93468]: WARNING cinder.quota [None req-595b6e50-0981-4226-967d-45b92054b313 tempest-GroupsTest-656558624 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-59031161 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-59031161, it is now deprecated. Please use the default quota class for default quota. Jun 29 03:34:29 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-595b6e50-0981-4226-967d-45b92054b313 tempest-GroupsTest-656558624 None] Created reservations ['2f0857af-f5e5-49d5-9de0-3be4a6307a9b', '8369e83d-71c2-4be7-974d-86380f8451e3', 'f39a3d32-38b2-4e7c-9199-45aaff302dc9', 'b75544a6-c54f-4112-a167-dd161e8cdefb'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:34:29 devstack sudo[107803]: pam_unix(sudo:session): session closed for user root Jun 29 03:34:29 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-e70b0415-c823-4354-b2e5-59fa33ad95c5 tempest-VolumesGetTest-1078145542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_24cf6ce1-1d2d-493f-a115-2a39928c82fb_a29m6jg5devstack@QuobyteHD" returned: 0 in 0.993s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:34:29 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-e70b0415-c823-4354-b2e5-59fa33ad95c5 tempest-VolumesGetTest-1078145542 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:34:29 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-e70b0415-c823-4354-b2e5-59fa33ad95c5 tempest-VolumesGetTest-1078145542 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:34:29 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-e70b0415-c823-4354-b2e5-59fa33ad95c5 tempest-VolumesGetTest-1078145542 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:34:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-134997067',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69d5fa60-e59f-4e22-be42-ee6cc9c7293e,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='e640ff4d86d542b88f2dba18116829b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:34:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:34:26Z,use_quota=True,user_id='26202c1ba10d4b91882e33e8c46b1802',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:34:29 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-e70b0415-c823-4354-b2e5-59fa33ad95c5 tempest-VolumesGetTest-1078145542 None] Creating volume 69d5fa60-e59f-4e22-be42-ee6cc9c7293e {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:34:29 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-e70b0415-c823-4354-b2e5-59fa33ad95c5 tempest-VolumesGetTest-1078145542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:34:29 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-e70b0415-c823-4354-b2e5-59fa33ad95c5 tempest-VolumesGetTest-1078145542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:34:29 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-e70b0415-c823-4354-b2e5-59fa33ad95c5 tempest-VolumesGetTest-1078145542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:34:29 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-e70b0415-c823-4354-b2e5-59fa33ad95c5 tempest-VolumesGetTest-1078145542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:34:29 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-e70b0415-c823-4354-b2e5-59fa33ad95c5 tempest-VolumesGetTest-1078145542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:34:29 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-e70b0415-c823-4354-b2e5-59fa33ad95c5 tempest-VolumesGetTest-1078145542 None] Selected osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:34:29 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-e70b0415-c823-4354-b2e5-59fa33ad95c5 tempest-VolumesGetTest-1078145542 None] casted to osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f Jun 29 03:34:29 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-e70b0415-c823-4354-b2e5-59fa33ad95c5 tempest-VolumesGetTest-1078145542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-69d5fa60-e59f-4e22-be42-ee6cc9c7293e 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:34:29 devstack sudo[107810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-69d5fa60-e59f-4e22-be42-ee6cc9c7293e 1073741824 Jun 29 03:34:29 devstack sudo[107810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:34:29 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-595b6e50-0981-4226-967d-45b92054b313 tempest-GroupsTest-656558624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:34:29 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-595b6e50-0981-4226-967d-45b92054b313 tempest-GroupsTest-656558624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:34:29 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-595b6e50-0981-4226-967d-45b92054b313 tempest-GroupsTest-656558624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:34:29 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-595b6e50-0981-4226-967d-45b92054b313 tempest-GroupsTest-656558624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:34:29 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-595b6e50-0981-4226-967d-45b92054b313 tempest-GroupsTest-656558624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:34:29 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-595b6e50-0981-4226-967d-45b92054b313 tempest-GroupsTest-656558624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:34:29 devstack sudo[107812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf Jun 29 03:34:29 devstack sudo[107812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:34:30 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-89248f6b-683c-4311-9284-ecf918716dd8 tempest-GroupsTest-656558624 None] Created reservations ['16893d86-6004-400b-b31f-58bba96a6212'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:34:30 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-89248f6b-683c-4311-9284-ecf918716dd8 tempest-GroupsTest-656558624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:34:30 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-89248f6b-683c-4311-9284-ecf918716dd8 tempest-GroupsTest-656558624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:34:30 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-89248f6b-683c-4311-9284-ecf918716dd8 tempest-GroupsTest-656558624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:34:30 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-89248f6b-683c-4311-9284-ecf918716dd8 tempest-GroupsTest-656558624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:34:30 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-89248f6b-683c-4311-9284-ecf918716dd8 tempest-GroupsTest-656558624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:34:30 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-89248f6b-683c-4311-9284-ecf918716dd8 tempest-GroupsTest-656558624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:34:30 devstack sudo[107815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf Jun 29 03:34:30 devstack sudo[107815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:34:30 devstack sudo[107812]: pam_unix(sudo:session): session closed for user root Jun 29 03:34:30 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-595b6e50-0981-4226-967d-45b92054b313 tempest-GroupsTest-656558624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf" returned: 0 in 0.875s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:34:30 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-595b6e50-0981-4226-967d-45b92054b313 tempest-GroupsTest-656558624 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:34:30 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-595b6e50-0981-4226-967d-45b92054b313 tempest-GroupsTest-656558624 None] Delete group completed successfully. Jun 29 03:34:30 devstack sudo[107810]: pam_unix(sudo:session): session closed for user root Jun 29 03:34:30 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-e70b0415-c823-4354-b2e5-59fa33ad95c5 tempest-VolumesGetTest-1078145542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-69d5fa60-e59f-4e22-be42-ee6cc9c7293e 1073741824" returned: 0 in 1.557s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:34:31 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-e70b0415-c823-4354-b2e5-59fa33ad95c5 tempest-VolumesGetTest-1078145542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-69d5fa60-e59f-4e22-be42-ee6cc9c7293e {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:34:31 devstack sudo[107823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-69d5fa60-e59f-4e22-be42-ee6cc9c7293e Jun 29 03:34:31 devstack sudo[107823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:34:31 devstack sudo[107815]: pam_unix(sudo:session): session closed for user root Jun 29 03:34:31 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-89248f6b-683c-4311-9284-ecf918716dd8 tempest-GroupsTest-656558624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf" returned: 0 in 1.058s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:34:31 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-89248f6b-683c-4311-9284-ecf918716dd8 tempest-GroupsTest-656558624 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:34:31 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-89248f6b-683c-4311-9284-ecf918716dd8 tempest-GroupsTest-656558624 None] Delete group completed successfully. Jun 29 03:34:31 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-90e93acf-1f41-45c9-9371-c69720d54120 tempest-GroupsTest-656558624 None] Group tempest-GroupsTest-Group-1347445044: creating Jun 29 03:34:31 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-90e93acf-1f41-45c9-9371-c69720d54120 tempest-GroupsTest-656558624 None] Group tempest-GroupsTest-Group-1347445044: created successfully Jun 29 03:34:31 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-90e93acf-1f41-45c9-9371-c69720d54120 tempest-GroupsTest-656558624 None] Create group completed successfully. Jun 29 03:34:32 devstack sudo[107823]: pam_unix(sudo:session): session closed for user root Jun 29 03:34:32 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-e70b0415-c823-4354-b2e5-59fa33ad95c5 tempest-VolumesGetTest-1078145542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-69d5fa60-e59f-4e22-be42-ee6cc9c7293e" returned: 0 in 1.061s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:34:32 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-e70b0415-c823-4354-b2e5-59fa33ad95c5 tempest-VolumesGetTest-1078145542 None] <== create_volume: return (2680ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:34:32 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-e70b0415-c823-4354-b2e5-59fa33ad95c5 tempest-VolumesGetTest-1078145542 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.686s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:34:32 devstack cinder-volume[93468]: DEBUG cinder.volume.volume_utils [None req-e70b0415-c823-4354-b2e5-59fa33ad95c5 tempest-VolumesGetTest-1078145542 None] Attempting download of 24cf6ce1-1d2d-493f-a115-2a39928c82fb ((None, [{'url': 'file:///opt/stack/data/glance/images/24cf6ce1-1d2d-493f-a115-2a39928c82fb', 'metadata': {}}])) to volume 69d5fa60-e59f-4e22-be42-ee6cc9c7293e. {{(pid=93468) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 29 03:34:32 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[af84f485-619e-44bd-b37c-434ad3e971c4]: (4, 'raw') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:34:32 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-e70b0415-c823-4354-b2e5-59fa33ad95c5 tempest-VolumesGetTest-1078145542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_24cf6ce1-1d2d-493f-a115-2a39928c82fb_x83gp76d {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:34:32 devstack sudo[107827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_24cf6ce1-1d2d-493f-a115-2a39928c82fb_x83gp76d Jun 29 03:34:32 devstack sudo[107827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:34:33 devstack sudo[107827]: pam_unix(sudo:session): session closed for user root Jun 29 03:34:33 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-e70b0415-c823-4354-b2e5-59fa33ad95c5 tempest-VolumesGetTest-1078145542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_24cf6ce1-1d2d-493f-a115-2a39928c82fb_x83gp76d" returned: 0 in 0.921s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:34:33 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-e70b0415-c823-4354-b2e5-59fa33ad95c5 tempest-VolumesGetTest-1078145542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_24cf6ce1-1d2d-493f-a115-2a39928c82fb_x83gp76d {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:34:33 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-093ca9ac-1744-4fde-ab3c-0b3e1e8f0890 tempest-TestServerVolumeAttachmentScenario-226006195 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:34:33 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-093ca9ac-1744-4fde-ab3c-0b3e1e8f0890 tempest-TestServerVolumeAttachmentScenario-226006195 None] Flow 'volume_create_manager' (f7d7e675-79c6-4ab0-9457-392d25d8359c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:34:33 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-093ca9ac-1744-4fde-ab3c-0b3e1e8f0890 tempest-TestServerVolumeAttachmentScenario-226006195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (214851d9-014d-40dd-9094-af8577c5971c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:34:33 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-093ca9ac-1744-4fde-ab3c-0b3e1e8f0890 tempest-TestServerVolumeAttachmentScenario-226006195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (214851d9-014d-40dd-9094-af8577c5971c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:34:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1367053920',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b36bdc7-f9a1-482b-9c27-f362183e0d66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a0eda49434443b685ba9c3a5c3a2463',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:34:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:34:33Z,use_quota=True,user_id='067e039975b54f4c8b0369ca6281370b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:34:33 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-093ca9ac-1744-4fde-ab3c-0b3e1e8f0890 tempest-TestServerVolumeAttachmentScenario-226006195 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08452721-16f1-47c3-b37e-0e8afe4428ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:34:33 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-093ca9ac-1744-4fde-ab3c-0b3e1e8f0890 tempest-TestServerVolumeAttachmentScenario-226006195 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08452721-16f1-47c3-b37e-0e8afe4428ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:34:33 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-093ca9ac-1744-4fde-ab3c-0b3e1e8f0890 tempest-TestServerVolumeAttachmentScenario-226006195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe8f9238-0d39-4cd7-80f0-998e1cdecc3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:34:33 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-093ca9ac-1744-4fde-ab3c-0b3e1e8f0890 tempest-TestServerVolumeAttachmentScenario-226006195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe8f9238-0d39-4cd7-80f0-998e1cdecc3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b36bdc7-f9a1-482b-9c27-f362183e0d66', 'volume_name': 'volume-0b36bdc7-f9a1-482b-9c27-f362183e0d66', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:34:33 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-093ca9ac-1744-4fde-ab3c-0b3e1e8f0890 tempest-TestServerVolumeAttachmentScenario-226006195 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d81fd78a-978e-48a8-92ad-3e3109ab3f25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:34:33 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-093ca9ac-1744-4fde-ab3c-0b3e1e8f0890 tempest-TestServerVolumeAttachmentScenario-226006195 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d81fd78a-978e-48a8-92ad-3e3109ab3f25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:34:33 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-093ca9ac-1744-4fde-ab3c-0b3e1e8f0890 tempest-TestServerVolumeAttachmentScenario-226006195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e75a52a-d174-44a5-8f69-06867d86a019) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:34:33 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-093ca9ac-1744-4fde-ab3c-0b3e1e8f0890 tempest-TestServerVolumeAttachmentScenario-226006195 None] Volume 0b36bdc7-f9a1-482b-9c27-f362183e0d66: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b36bdc7-f9a1-482b-9c27-f362183e0d66', 'volume_size': 1} Jun 29 03:34:33 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-093ca9ac-1744-4fde-ab3c-0b3e1e8f0890 tempest-TestServerVolumeAttachmentScenario-226006195 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:34:33 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-093ca9ac-1744-4fde-ab3c-0b3e1e8f0890 tempest-TestServerVolumeAttachmentScenario-226006195 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:34:33 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-093ca9ac-1744-4fde-ab3c-0b3e1e8f0890 tempest-TestServerVolumeAttachmentScenario-226006195 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:34:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1367053920',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b36bdc7-f9a1-482b-9c27-f362183e0d66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a0eda49434443b685ba9c3a5c3a2463',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:34:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:34:33Z,use_quota=True,user_id='067e039975b54f4c8b0369ca6281370b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:34:33 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-093ca9ac-1744-4fde-ab3c-0b3e1e8f0890 tempest-TestServerVolumeAttachmentScenario-226006195 None] Creating volume 0b36bdc7-f9a1-482b-9c27-f362183e0d66 {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:34:33 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-093ca9ac-1744-4fde-ab3c-0b3e1e8f0890 tempest-TestServerVolumeAttachmentScenario-226006195 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:34:33 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-093ca9ac-1744-4fde-ab3c-0b3e1e8f0890 tempest-TestServerVolumeAttachmentScenario-226006195 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:34:33 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-093ca9ac-1744-4fde-ab3c-0b3e1e8f0890 tempest-TestServerVolumeAttachmentScenario-226006195 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:34:33 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-093ca9ac-1744-4fde-ab3c-0b3e1e8f0890 tempest-TestServerVolumeAttachmentScenario-226006195 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:34:33 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-093ca9ac-1744-4fde-ab3c-0b3e1e8f0890 tempest-TestServerVolumeAttachmentScenario-226006195 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:34:33 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-093ca9ac-1744-4fde-ab3c-0b3e1e8f0890 tempest-TestServerVolumeAttachmentScenario-226006195 None] Selected osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:34:33 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-093ca9ac-1744-4fde-ab3c-0b3e1e8f0890 tempest-TestServerVolumeAttachmentScenario-226006195 None] casted to osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f Jun 29 03:34:33 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-093ca9ac-1744-4fde-ab3c-0b3e1e8f0890 tempest-TestServerVolumeAttachmentScenario-226006195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-0b36bdc7-f9a1-482b-9c27-f362183e0d66 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:34:33 devstack sudo[107832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_24cf6ce1-1d2d-493f-a115-2a39928c82fb_x83gp76d Jun 29 03:34:33 devstack sudo[107832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:34:33 devstack sudo[107833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-0b36bdc7-f9a1-482b-9c27-f362183e0d66 1073741824 Jun 29 03:34:33 devstack sudo[107833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:34:34 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-49a54984-98e6-40ee-b5c3-92f3ecdd239b tempest-TestServerVolumeAttachmentScenario-226006195 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:34:34 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-49a54984-98e6-40ee-b5c3-92f3ecdd239b tempest-TestServerVolumeAttachmentScenario-226006195 None] Flow 'volume_create_manager' (2dd60893-a874-4b05-97ed-62986a776033) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:34:34 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-49a54984-98e6-40ee-b5c3-92f3ecdd239b tempest-TestServerVolumeAttachmentScenario-226006195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8a3b413-86f0-4240-b7c1-648fb6df7a2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:34:34 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-49a54984-98e6-40ee-b5c3-92f3ecdd239b tempest-TestServerVolumeAttachmentScenario-226006195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8a3b413-86f0-4240-b7c1-648fb6df7a2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:34:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-808887332',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=527d3e86-7acd-4086-8c2f-cee2a6fe66cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a0eda49434443b685ba9c3a5c3a2463',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:34:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:34:34Z,use_quota=True,user_id='067e039975b54f4c8b0369ca6281370b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:34:34 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-49a54984-98e6-40ee-b5c3-92f3ecdd239b tempest-TestServerVolumeAttachmentScenario-226006195 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8007e93d-8651-4859-b3e6-424594de6792) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:34:34 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-49a54984-98e6-40ee-b5c3-92f3ecdd239b tempest-TestServerVolumeAttachmentScenario-226006195 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8007e93d-8651-4859-b3e6-424594de6792) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:34:34 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-49a54984-98e6-40ee-b5c3-92f3ecdd239b tempest-TestServerVolumeAttachmentScenario-226006195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ced78ba9-6442-45e7-8418-86058af6163e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:34:34 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-49a54984-98e6-40ee-b5c3-92f3ecdd239b tempest-TestServerVolumeAttachmentScenario-226006195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ced78ba9-6442-45e7-8418-86058af6163e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '527d3e86-7acd-4086-8c2f-cee2a6fe66cd', 'volume_name': 'volume-527d3e86-7acd-4086-8c2f-cee2a6fe66cd', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:34:34 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-49a54984-98e6-40ee-b5c3-92f3ecdd239b tempest-TestServerVolumeAttachmentScenario-226006195 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b13571a1-0aea-4eb3-8491-f67a544f9ae3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:34:34 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-49a54984-98e6-40ee-b5c3-92f3ecdd239b tempest-TestServerVolumeAttachmentScenario-226006195 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b13571a1-0aea-4eb3-8491-f67a544f9ae3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:34:34 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-49a54984-98e6-40ee-b5c3-92f3ecdd239b tempest-TestServerVolumeAttachmentScenario-226006195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afc2532e-a1ce-4f39-9721-03074e776386) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:34:34 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-49a54984-98e6-40ee-b5c3-92f3ecdd239b tempest-TestServerVolumeAttachmentScenario-226006195 None] Volume 527d3e86-7acd-4086-8c2f-cee2a6fe66cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-527d3e86-7acd-4086-8c2f-cee2a6fe66cd', 'volume_size': 1} Jun 29 03:34:34 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-49a54984-98e6-40ee-b5c3-92f3ecdd239b tempest-TestServerVolumeAttachmentScenario-226006195 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:34:34 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-710745f4-4141-4fb0-a4e2-471ae5f81794 tempest-GroupsTest-656558624 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:34:34 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-710745f4-4141-4fb0-a4e2-471ae5f81794 tempest-GroupsTest-656558624 None] Flow 'volume_create_manager' (775f4e41-f427-44d4-b712-80c21bb643ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:34:34 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-710745f4-4141-4fb0-a4e2-471ae5f81794 tempest-GroupsTest-656558624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a579ac2-8e8a-482c-8c4a-2cae98ccbe54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:34:34 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-710745f4-4141-4fb0-a4e2-471ae5f81794 tempest-GroupsTest-656558624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a579ac2-8e8a-482c-8c4a-2cae98ccbe54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:34:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1382526584',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=263f6744-139c-4f0d-b70c-085f7cb933c8,host='devstack@QuobyteHD#QuobyteHD',id=404b6c9f-866e-4fc2-81ef-304315502582,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46a88042177b4cac87af8d51e6ec873d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:34:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:34:34Z,use_quota=True,user_id='b17870b7b91d4b8b94db557ec7a5faf4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97c7fb5f-141d-40c7-911e-39deef2b89f0),volume_type_id=97c7fb5f-141d-40c7-911e-39deef2b89f0)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:34:34 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-710745f4-4141-4fb0-a4e2-471ae5f81794 tempest-GroupsTest-656558624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cab7dd46-ab0d-46a7-a3e4-d15baac141f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:34:34 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-710745f4-4141-4fb0-a4e2-471ae5f81794 tempest-GroupsTest-656558624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cab7dd46-ab0d-46a7-a3e4-d15baac141f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:34:34 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-710745f4-4141-4fb0-a4e2-471ae5f81794 tempest-GroupsTest-656558624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fce3f62c-2aa3-498a-a469-113efc7e6815) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:34:34 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-710745f4-4141-4fb0-a4e2-471ae5f81794 tempest-GroupsTest-656558624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fce3f62c-2aa3-498a-a469-113efc7e6815) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '404b6c9f-866e-4fc2-81ef-304315502582', 'volume_name': 'volume-404b6c9f-866e-4fc2-81ef-304315502582', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:34:34 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-710745f4-4141-4fb0-a4e2-471ae5f81794 tempest-GroupsTest-656558624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93f0a211-4a0a-4538-9d8d-d6c65a4879dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:34:34 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-710745f4-4141-4fb0-a4e2-471ae5f81794 tempest-GroupsTest-656558624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93f0a211-4a0a-4538-9d8d-d6c65a4879dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:34:34 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-710745f4-4141-4fb0-a4e2-471ae5f81794 tempest-GroupsTest-656558624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (871ea270-1f78-4f88-aec7-81a7efbedaeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:34:34 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-710745f4-4141-4fb0-a4e2-471ae5f81794 tempest-GroupsTest-656558624 None] Volume 404b6c9f-866e-4fc2-81ef-304315502582: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-404b6c9f-866e-4fc2-81ef-304315502582', 'volume_size': 1} Jun 29 03:34:34 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-710745f4-4141-4fb0-a4e2-471ae5f81794 tempest-GroupsTest-656558624 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:34:34 devstack sudo[107832]: pam_unix(sudo:session): session closed for user root Jun 29 03:34:34 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-e70b0415-c823-4354-b2e5-59fa33ad95c5 tempest-VolumesGetTest-1078145542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_24cf6ce1-1d2d-493f-a115-2a39928c82fb_x83gp76d" returned: 1 in 1.547s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:34:34 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-e70b0415-c823-4354-b2e5-59fa33ad95c5 tempest-VolumesGetTest-1078145542 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_24cf6ce1-1d2d-493f-a115-2a39928c82fb_x83gp76d' failed. Not Retrying. {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 29 03:34:34 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bbc205f-0c6b-4cad-ba9d-a44216c19204]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:34:34 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-e70b0415-c823-4354-b2e5-59fa33ad95c5 tempest-VolumesGetTest-1078145542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_24cf6ce1-1d2d-493f-a115-2a39928c82fb_a29m6jg5devstack@QuobyteHD {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:34:34 devstack sudo[107842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_24cf6ce1-1d2d-493f-a115-2a39928c82fb_a29m6jg5devstack@QuobyteHD Jun 29 03:34:34 devstack sudo[107842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:34:34 devstack sudo[107833]: pam_unix(sudo:session): session closed for user root Jun 29 03:34:34 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-093ca9ac-1744-4fde-ab3c-0b3e1e8f0890 tempest-TestServerVolumeAttachmentScenario-226006195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-0b36bdc7-f9a1-482b-9c27-f362183e0d66 1073741824" returned: 0 in 1.627s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:34:35 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-093ca9ac-1744-4fde-ab3c-0b3e1e8f0890 tempest-TestServerVolumeAttachmentScenario-226006195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-0b36bdc7-f9a1-482b-9c27-f362183e0d66 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:34:35 devstack sudo[107844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-0b36bdc7-f9a1-482b-9c27-f362183e0d66 Jun 29 03:34:35 devstack sudo[107844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:34:35 devstack sudo[107842]: pam_unix(sudo:session): session closed for user root Jun 29 03:34:35 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-e70b0415-c823-4354-b2e5-59fa33ad95c5 tempest-VolumesGetTest-1078145542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_24cf6ce1-1d2d-493f-a115-2a39928c82fb_a29m6jg5devstack@QuobyteHD" returned: 0 in 0.937s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:34:35 devstack cinder-volume[93468]: DEBUG cinder.image.image_utils [None req-e70b0415-c823-4354-b2e5-59fa33ad95c5 tempest-VolumesGetTest-1078145542 None] 24cf6ce1-1d2d-493f-a115-2a39928c82fb was qcow2, converting to raw {{(pid=93468) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 29 03:34:35 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-e70b0415-c823-4354-b2e5-59fa33ad95c5 tempest-VolumesGetTest-1078145542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_24cf6ce1-1d2d-493f-a115-2a39928c82fb_a29m6jg5devstack@QuobyteHD /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-69d5fa60-e59f-4e22-be42-ee6cc9c7293e {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:34:35 devstack sudo[107851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_24cf6ce1-1d2d-493f-a115-2a39928c82fb_a29m6jg5devstack@QuobyteHD /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-69d5fa60-e59f-4e22-be42-ee6cc9c7293e Jun 29 03:34:35 devstack sudo[107851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:34:35 devstack sudo[107844]: pam_unix(sudo:session): session closed for user root Jun 29 03:34:36 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-093ca9ac-1744-4fde-ab3c-0b3e1e8f0890 tempest-TestServerVolumeAttachmentScenario-226006195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-0b36bdc7-f9a1-482b-9c27-f362183e0d66" returned: 0 in 0.960s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:34:36 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-093ca9ac-1744-4fde-ab3c-0b3e1e8f0890 tempest-TestServerVolumeAttachmentScenario-226006195 None] <== create_volume: return (2678ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:34:36 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-093ca9ac-1744-4fde-ab3c-0b3e1e8f0890 tempest-TestServerVolumeAttachmentScenario-226006195 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.684s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:34:36 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-49a54984-98e6-40ee-b5c3-92f3ecdd239b tempest-TestServerVolumeAttachmentScenario-226006195 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.637s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:34:36 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-49a54984-98e6-40ee-b5c3-92f3ecdd239b tempest-TestServerVolumeAttachmentScenario-226006195 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:34:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-808887332',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=527d3e86-7acd-4086-8c2f-cee2a6fe66cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a0eda49434443b685ba9c3a5c3a2463',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:34:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:34:34Z,use_quota=True,user_id='067e039975b54f4c8b0369ca6281370b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:34:36 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-49a54984-98e6-40ee-b5c3-92f3ecdd239b tempest-TestServerVolumeAttachmentScenario-226006195 None] Creating volume 527d3e86-7acd-4086-8c2f-cee2a6fe66cd {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:34:36 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-49a54984-98e6-40ee-b5c3-92f3ecdd239b tempest-TestServerVolumeAttachmentScenario-226006195 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:34:36 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-49a54984-98e6-40ee-b5c3-92f3ecdd239b tempest-TestServerVolumeAttachmentScenario-226006195 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:34:36 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-49a54984-98e6-40ee-b5c3-92f3ecdd239b tempest-TestServerVolumeAttachmentScenario-226006195 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:34:36 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-49a54984-98e6-40ee-b5c3-92f3ecdd239b tempest-TestServerVolumeAttachmentScenario-226006195 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:34:36 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-49a54984-98e6-40ee-b5c3-92f3ecdd239b tempest-TestServerVolumeAttachmentScenario-226006195 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:34:36 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-49a54984-98e6-40ee-b5c3-92f3ecdd239b tempest-TestServerVolumeAttachmentScenario-226006195 None] Selected osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:34:36 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-49a54984-98e6-40ee-b5c3-92f3ecdd239b tempest-TestServerVolumeAttachmentScenario-226006195 None] casted to osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f Jun 29 03:34:36 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-49a54984-98e6-40ee-b5c3-92f3ecdd239b tempest-TestServerVolumeAttachmentScenario-226006195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-527d3e86-7acd-4086-8c2f-cee2a6fe66cd 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:34:36 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-093ca9ac-1744-4fde-ab3c-0b3e1e8f0890 tempest-TestServerVolumeAttachmentScenario-226006195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e75a52a-d174-44a5-8f69-06867d86a019) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b36bdc7-f9a1-482b-9c27-f362183e0d66', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:34:36 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-093ca9ac-1744-4fde-ab3c-0b3e1e8f0890 tempest-TestServerVolumeAttachmentScenario-226006195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b09e8ab8-3d4d-4ebb-8483-2316a4609824) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:34:36 devstack sudo[107854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-527d3e86-7acd-4086-8c2f-cee2a6fe66cd 1073741824 Jun 29 03:34:36 devstack sudo[107854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:34:36 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-093ca9ac-1744-4fde-ab3c-0b3e1e8f0890 tempest-TestServerVolumeAttachmentScenario-226006195 None] Volume volume-0b36bdc7-f9a1-482b-9c27-f362183e0d66 (0b36bdc7-f9a1-482b-9c27-f362183e0d66): created successfully Jun 29 03:34:36 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-093ca9ac-1744-4fde-ab3c-0b3e1e8f0890 tempest-TestServerVolumeAttachmentScenario-226006195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b09e8ab8-3d4d-4ebb-8483-2316a4609824) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:34:36 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-093ca9ac-1744-4fde-ab3c-0b3e1e8f0890 tempest-TestServerVolumeAttachmentScenario-226006195 None] Flow 'volume_create_manager' (f7d7e675-79c6-4ab0-9457-392d25d8359c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:34:36 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-093ca9ac-1744-4fde-ab3c-0b3e1e8f0890 tempest-TestServerVolumeAttachmentScenario-226006195 None] Created volume successfully. Jun 29 03:34:37 devstack sudo[107854]: pam_unix(sudo:session): session closed for user root Jun 29 03:34:37 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-49a54984-98e6-40ee-b5c3-92f3ecdd239b tempest-TestServerVolumeAttachmentScenario-226006195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-527d3e86-7acd-4086-8c2f-cee2a6fe66cd 1073741824" returned: 0 in 1.230s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:34:37 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-49a54984-98e6-40ee-b5c3-92f3ecdd239b tempest-TestServerVolumeAttachmentScenario-226006195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-527d3e86-7acd-4086-8c2f-cee2a6fe66cd {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:34:37 devstack sudo[107872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-527d3e86-7acd-4086-8c2f-cee2a6fe66cd Jun 29 03:34:37 devstack sudo[107872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:34:38 devstack sudo[107872]: pam_unix(sudo:session): session closed for user root Jun 29 03:34:38 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-49a54984-98e6-40ee-b5c3-92f3ecdd239b tempest-TestServerVolumeAttachmentScenario-226006195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-527d3e86-7acd-4086-8c2f-cee2a6fe66cd" returned: 0 in 1.062s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:34:38 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-49a54984-98e6-40ee-b5c3-92f3ecdd239b tempest-TestServerVolumeAttachmentScenario-226006195 None] <== create_volume: return (2355ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:34:38 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-49a54984-98e6-40ee-b5c3-92f3ecdd239b tempest-TestServerVolumeAttachmentScenario-226006195 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.361s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:34:38 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-710745f4-4141-4fb0-a4e2-471ae5f81794 tempest-GroupsTest-656558624 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.907s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:34:38 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-710745f4-4141-4fb0-a4e2-471ae5f81794 tempest-GroupsTest-656558624 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=263f6744-139c-4f0d-b70c-085f7cb933c8,created_at=2026-06-29T01:34:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1382526584',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=263f6744-139c-4f0d-b70c-085f7cb933c8,host='devstack@QuobyteHD#QuobyteHD',id=404b6c9f-866e-4fc2-81ef-304315502582,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46a88042177b4cac87af8d51e6ec873d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:34:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:34:34Z,use_quota=True,user_id='b17870b7b91d4b8b94db557ec7a5faf4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97c7fb5f-141d-40c7-911e-39deef2b89f0),volume_type_id=97c7fb5f-141d-40c7-911e-39deef2b89f0)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:34:38 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-710745f4-4141-4fb0-a4e2-471ae5f81794 tempest-GroupsTest-656558624 None] Creating volume 404b6c9f-866e-4fc2-81ef-304315502582 {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:34:38 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-710745f4-4141-4fb0-a4e2-471ae5f81794 tempest-GroupsTest-656558624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:34:38 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-710745f4-4141-4fb0-a4e2-471ae5f81794 tempest-GroupsTest-656558624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:34:38 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-710745f4-4141-4fb0-a4e2-471ae5f81794 tempest-GroupsTest-656558624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:34:38 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-710745f4-4141-4fb0-a4e2-471ae5f81794 tempest-GroupsTest-656558624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:34:38 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-710745f4-4141-4fb0-a4e2-471ae5f81794 tempest-GroupsTest-656558624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:34:38 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-710745f4-4141-4fb0-a4e2-471ae5f81794 tempest-GroupsTest-656558624 None] Selected osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:34:38 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-710745f4-4141-4fb0-a4e2-471ae5f81794 tempest-GroupsTest-656558624 None] casted to osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f Jun 29 03:34:38 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-710745f4-4141-4fb0-a4e2-471ae5f81794 tempest-GroupsTest-656558624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-404b6c9f-866e-4fc2-81ef-304315502582 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:34:38 devstack sudo[107851]: pam_unix(sudo:session): session closed for user root Jun 29 03:34:38 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-e70b0415-c823-4354-b2e5-59fa33ad95c5 tempest-VolumesGetTest-1078145542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_24cf6ce1-1d2d-493f-a115-2a39928c82fb_a29m6jg5devstack@QuobyteHD /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-69d5fa60-e59f-4e22-be42-ee6cc9c7293e" returned: 0 in 2.789s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:34:38 devstack cinder-volume[93468]: DEBUG cinder.image.image_utils [None req-e70b0415-c823-4354-b2e5-59fa33ad95c5 tempest-VolumesGetTest-1078145542 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_24cf6ce1-1d2d-493f-a115-2a39928c82fb_a29m6jg5devstack@QuobyteHD, size 112.00 MB, duration 2.79 sec, destination /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-69d5fa60-e59f-4e22-be42-ee6cc9c7293e {{(pid=93468) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 29 03:34:38 devstack cinder-volume[93468]: INFO cinder.image.image_utils [None req-e70b0415-c823-4354-b2e5-59fa33ad95c5 tempest-VolumesGetTest-1078145542 None] Converted 112.00 MB image at 40.12 MB/s Jun 29 03:34:38 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-e70b0415-c823-4354-b2e5-59fa33ad95c5 tempest-VolumesGetTest-1078145542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-69d5fa60-e59f-4e22-be42-ee6cc9c7293e 1G {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:34:38 devstack sudo[107878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-404b6c9f-866e-4fc2-81ef-304315502582 1073741824 Jun 29 03:34:38 devstack sudo[107878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:34:38 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-49a54984-98e6-40ee-b5c3-92f3ecdd239b tempest-TestServerVolumeAttachmentScenario-226006195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afc2532e-a1ce-4f39-9721-03074e776386) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-527d3e86-7acd-4086-8c2f-cee2a6fe66cd', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:34:38 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-49a54984-98e6-40ee-b5c3-92f3ecdd239b tempest-TestServerVolumeAttachmentScenario-226006195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7d91333-522a-4cfc-91fe-ee170176e00b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:34:38 devstack sudo[107880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-69d5fa60-e59f-4e22-be42-ee6cc9c7293e 1G Jun 29 03:34:38 devstack sudo[107880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:34:38 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-49a54984-98e6-40ee-b5c3-92f3ecdd239b tempest-TestServerVolumeAttachmentScenario-226006195 None] Volume volume-527d3e86-7acd-4086-8c2f-cee2a6fe66cd (527d3e86-7acd-4086-8c2f-cee2a6fe66cd): created successfully Jun 29 03:34:38 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-49a54984-98e6-40ee-b5c3-92f3ecdd239b tempest-TestServerVolumeAttachmentScenario-226006195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7d91333-522a-4cfc-91fe-ee170176e00b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:34:38 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-49a54984-98e6-40ee-b5c3-92f3ecdd239b tempest-TestServerVolumeAttachmentScenario-226006195 None] Flow 'volume_create_manager' (2dd60893-a874-4b05-97ed-62986a776033) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:34:38 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-49a54984-98e6-40ee-b5c3-92f3ecdd239b tempest-TestServerVolumeAttachmentScenario-226006195 None] Created volume successfully. Jun 29 03:34:39 devstack sudo[107880]: pam_unix(sudo:session): session closed for user root Jun 29 03:34:39 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-e70b0415-c823-4354-b2e5-59fa33ad95c5 tempest-VolumesGetTest-1078145542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-69d5fa60-e59f-4e22-be42-ee6cc9c7293e 1G" returned: 0 in 0.829s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:34:39 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[90e349bb-2dfc-47e9-896d-70cf781a91e9]: (4, 'raw') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:34:39 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-e70b0415-c823-4354-b2e5-59fa33ad95c5 tempest-VolumesGetTest-1078145542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-69d5fa60-e59f-4e22-be42-ee6cc9c7293e {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:34:39 devstack sudo[107889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-69d5fa60-e59f-4e22-be42-ee6cc9c7293e Jun 29 03:34:39 devstack sudo[107889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:34:39 devstack sudo[107878]: pam_unix(sudo:session): session closed for user root Jun 29 03:34:39 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-710745f4-4141-4fb0-a4e2-471ae5f81794 tempest-GroupsTest-656558624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-404b6c9f-866e-4fc2-81ef-304315502582 1073741824" returned: 0 in 1.201s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:34:39 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-710745f4-4141-4fb0-a4e2-471ae5f81794 tempest-GroupsTest-656558624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-404b6c9f-866e-4fc2-81ef-304315502582 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:34:39 devstack sudo[107891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-404b6c9f-866e-4fc2-81ef-304315502582 Jun 29 03:34:39 devstack sudo[107891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:34:40 devstack sudo[107889]: pam_unix(sudo:session): session closed for user root Jun 29 03:34:40 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-e70b0415-c823-4354-b2e5-59fa33ad95c5 tempest-VolumesGetTest-1078145542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-69d5fa60-e59f-4e22-be42-ee6cc9c7293e" returned: 0 in 0.909s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:34:40 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-e70b0415-c823-4354-b2e5-59fa33ad95c5 tempest-VolumesGetTest-1078145542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-69d5fa60-e59f-4e22-be42-ee6cc9c7293e {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:34:40 devstack sudo[107891]: pam_unix(sudo:session): session closed for user root Jun 29 03:34:40 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-710745f4-4141-4fb0-a4e2-471ae5f81794 tempest-GroupsTest-656558624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-404b6c9f-866e-4fc2-81ef-304315502582" returned: 0 in 0.716s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:34:40 devstack sudo[107895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-69d5fa60-e59f-4e22-be42-ee6cc9c7293e Jun 29 03:34:40 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-710745f4-4141-4fb0-a4e2-471ae5f81794 tempest-GroupsTest-656558624 None] <== create_volume: return (1964ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:34:40 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-710745f4-4141-4fb0-a4e2-471ae5f81794 tempest-GroupsTest-656558624 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.969s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:34:40 devstack sudo[107895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:34:40 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-710745f4-4141-4fb0-a4e2-471ae5f81794 tempest-GroupsTest-656558624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (871ea270-1f78-4f88-aec7-81a7efbedaeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-404b6c9f-866e-4fc2-81ef-304315502582', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:34:40 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-710745f4-4141-4fb0-a4e2-471ae5f81794 tempest-GroupsTest-656558624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60539c86-6152-4dab-a80b-e4e30a39f3fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:34:40 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-710745f4-4141-4fb0-a4e2-471ae5f81794 tempest-GroupsTest-656558624 None] Volume volume-404b6c9f-866e-4fc2-81ef-304315502582 (404b6c9f-866e-4fc2-81ef-304315502582): created successfully Jun 29 03:34:40 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-710745f4-4141-4fb0-a4e2-471ae5f81794 tempest-GroupsTest-656558624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60539c86-6152-4dab-a80b-e4e30a39f3fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:34:40 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-710745f4-4141-4fb0-a4e2-471ae5f81794 tempest-GroupsTest-656558624 None] Flow 'volume_create_manager' (775f4e41-f427-44d4-b712-80c21bb643ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:34:40 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-710745f4-4141-4fb0-a4e2-471ae5f81794 tempest-GroupsTest-656558624 None] Created volume successfully. Jun 29 03:34:41 devstack sudo[107895]: pam_unix(sudo:session): session closed for user root Jun 29 03:34:41 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-e70b0415-c823-4354-b2e5-59fa33ad95c5 tempest-VolumesGetTest-1078145542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-69d5fa60-e59f-4e22-be42-ee6cc9c7293e" returned: 1 in 0.935s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:34:41 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-e70b0415-c823-4354-b2e5-59fa33ad95c5 tempest-VolumesGetTest-1078145542 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-69d5fa60-e59f-4e22-be42-ee6cc9c7293e' failed. Not Retrying. {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 29 03:34:41 devstack cinder-volume[93468]: DEBUG cinder.volume.volume_utils [None req-e70b0415-c823-4354-b2e5-59fa33ad95c5 tempest-VolumesGetTest-1078145542 None] Downloaded image 24cf6ce1-1d2d-493f-a115-2a39928c82fb ((None, [{'url': 'file:///opt/stack/data/glance/images/24cf6ce1-1d2d-493f-a115-2a39928c82fb', 'metadata': {}}])) to volume 69d5fa60-e59f-4e22-be42-ee6cc9c7293e successfully. {{(pid=93468) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 29 03:34:41 devstack cinder-volume[93468]: DEBUG cinder.image.image_utils [None req-e70b0415-c823-4354-b2e5-59fa33ad95c5 tempest-VolumesGetTest-1078145542 None] Temporary image 24cf6ce1-1d2d-493f-a115-2a39928c82fb for user 26202c1ba10d4b91882e33e8c46b1802 is deleted. {{(pid=93468) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 29 03:34:41 devstack cinder-volume[93468]: DEBUG cinder.volume.volume_utils [None req-e70b0415-c823-4354-b2e5-59fa33ad95c5 tempest-VolumesGetTest-1078145542 None] Marking volume 69d5fa60-e59f-4e22-be42-ee6cc9c7293e as bootable. {{(pid=93468) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 29 03:34:41 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-e70b0415-c823-4354-b2e5-59fa33ad95c5 tempest-VolumesGetTest-1078145542 None] Copying metadata from image 24cf6ce1-1d2d-493f-a115-2a39928c82fb to 69d5fa60-e59f-4e22-be42-ee6cc9c7293e. {{(pid=93468) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 29 03:34:41 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-e70b0415-c823-4354-b2e5-59fa33ad95c5 tempest-VolumesGetTest-1078145542 None] Creating volume glance metadata for volume 69d5fa60-e59f-4e22-be42-ee6cc9c7293e backed by image 24cf6ce1-1d2d-493f-a115-2a39928c82fb with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '24cf6ce1-1d2d-493f-a115-2a39928c82fb', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=93468) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 29 03:34:41 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-e70b0415-c823-4354-b2e5-59fa33ad95c5 tempest-VolumesGetTest-1078145542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8aab6627-ceed-4717-9ac5-517c260ca4e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69d5fa60-e59f-4e22-be42-ee6cc9c7293e', 'volume_size': 1, 'image_id': '24cf6ce1-1d2d-493f-a115-2a39928c82fb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/24cf6ce1-1d2d-493f-a115-2a39928c82fb', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1335b5873eea4762b9fea7f84dd1615c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '24cf6ce1-1d2d-493f-a115-2a39928c82fb', 'created_at': datetime.datetime(2026, 6, 29, 1, 13, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 29, 1, 13, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/24cf6ce1-1d2d-493f-a115-2a39928c82fb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:34:41 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-e70b0415-c823-4354-b2e5-59fa33ad95c5 tempest-VolumesGetTest-1078145542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7be1d653-fce1-4812-92f8-38cf16c07661) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:34:41 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-e70b0415-c823-4354-b2e5-59fa33ad95c5 tempest-VolumesGetTest-1078145542 None] Volume volume-69d5fa60-e59f-4e22-be42-ee6cc9c7293e (69d5fa60-e59f-4e22-be42-ee6cc9c7293e): created successfully Jun 29 03:34:41 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-e70b0415-c823-4354-b2e5-59fa33ad95c5 tempest-VolumesGetTest-1078145542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7be1d653-fce1-4812-92f8-38cf16c07661) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:34:41 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-e70b0415-c823-4354-b2e5-59fa33ad95c5 tempest-VolumesGetTest-1078145542 None] Flow 'volume_create_manager' (fbb9db26-5556-4128-83ba-644feb0d4f2d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:34:41 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-e70b0415-c823-4354-b2e5-59fa33ad95c5 tempest-VolumesGetTest-1078145542 None] Created volume successfully. Jun 29 03:34:41 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7fa9b1d-d723-49a3-993d-38e1b10e2691 tempest-GroupsTest-656558624 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:34:41 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-e7fa9b1d-d723-49a3-993d-38e1b10e2691 tempest-GroupsTest-656558624 None] Flow 'volume_create_manager' (19fcd0fc-9e0b-478f-94cf-b8b3ad431577) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:34:41 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-e7fa9b1d-d723-49a3-993d-38e1b10e2691 tempest-GroupsTest-656558624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f09a05a0-3874-4e41-9acb-5672047565ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:34:41 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-e7fa9b1d-d723-49a3-993d-38e1b10e2691 tempest-GroupsTest-656558624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f09a05a0-3874-4e41-9acb-5672047565ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:34:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-808757414',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=263f6744-139c-4f0d-b70c-085f7cb933c8,host='devstack@QuobyteHD#QuobyteHD',id=c71abd3e-84a4-4909-a35d-b61785e4ab3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46a88042177b4cac87af8d51e6ec873d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:34:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:34:41Z,use_quota=True,user_id='b17870b7b91d4b8b94db557ec7a5faf4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97c7fb5f-141d-40c7-911e-39deef2b89f0),volume_type_id=97c7fb5f-141d-40c7-911e-39deef2b89f0)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:34:41 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-e7fa9b1d-d723-49a3-993d-38e1b10e2691 tempest-GroupsTest-656558624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6249eb28-14d8-4474-a30c-07bbd3c0290f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:34:41 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-e7fa9b1d-d723-49a3-993d-38e1b10e2691 tempest-GroupsTest-656558624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6249eb28-14d8-4474-a30c-07bbd3c0290f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:34:41 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-e7fa9b1d-d723-49a3-993d-38e1b10e2691 tempest-GroupsTest-656558624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc3b91a9-900f-4e2b-8ba8-172f7dc12fc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:34:41 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-e7fa9b1d-d723-49a3-993d-38e1b10e2691 tempest-GroupsTest-656558624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc3b91a9-900f-4e2b-8ba8-172f7dc12fc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c71abd3e-84a4-4909-a35d-b61785e4ab3a', 'volume_name': 'volume-c71abd3e-84a4-4909-a35d-b61785e4ab3a', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:34:41 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-e7fa9b1d-d723-49a3-993d-38e1b10e2691 tempest-GroupsTest-656558624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80d7a055-61cd-403a-a7fe-d5148fe55a93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:34:41 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-e7fa9b1d-d723-49a3-993d-38e1b10e2691 tempest-GroupsTest-656558624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80d7a055-61cd-403a-a7fe-d5148fe55a93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:34:41 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-e7fa9b1d-d723-49a3-993d-38e1b10e2691 tempest-GroupsTest-656558624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7cb55635-52c9-4d1b-964b-ef3912fe0587) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:34:41 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-e7fa9b1d-d723-49a3-993d-38e1b10e2691 tempest-GroupsTest-656558624 None] Volume c71abd3e-84a4-4909-a35d-b61785e4ab3a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c71abd3e-84a4-4909-a35d-b61785e4ab3a', 'volume_size': 1} Jun 29 03:34:41 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-e7fa9b1d-d723-49a3-993d-38e1b10e2691 tempest-GroupsTest-656558624 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:34:41 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-e7fa9b1d-d723-49a3-993d-38e1b10e2691 tempest-GroupsTest-656558624 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:34:41 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-e7fa9b1d-d723-49a3-993d-38e1b10e2691 tempest-GroupsTest-656558624 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=263f6744-139c-4f0d-b70c-085f7cb933c8,created_at=2026-06-29T01:34:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-808757414',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=263f6744-139c-4f0d-b70c-085f7cb933c8,host='devstack@QuobyteHD#QuobyteHD',id=c71abd3e-84a4-4909-a35d-b61785e4ab3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46a88042177b4cac87af8d51e6ec873d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:34:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:34:41Z,use_quota=True,user_id='b17870b7b91d4b8b94db557ec7a5faf4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97c7fb5f-141d-40c7-911e-39deef2b89f0),volume_type_id=97c7fb5f-141d-40c7-911e-39deef2b89f0)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:34:41 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-e7fa9b1d-d723-49a3-993d-38e1b10e2691 tempest-GroupsTest-656558624 None] Creating volume c71abd3e-84a4-4909-a35d-b61785e4ab3a {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:34:41 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-e7fa9b1d-d723-49a3-993d-38e1b10e2691 tempest-GroupsTest-656558624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:34:41 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-e7fa9b1d-d723-49a3-993d-38e1b10e2691 tempest-GroupsTest-656558624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:34:41 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-e7fa9b1d-d723-49a3-993d-38e1b10e2691 tempest-GroupsTest-656558624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:34:41 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-e7fa9b1d-d723-49a3-993d-38e1b10e2691 tempest-GroupsTest-656558624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:34:41 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-e7fa9b1d-d723-49a3-993d-38e1b10e2691 tempest-GroupsTest-656558624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:34:41 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-e7fa9b1d-d723-49a3-993d-38e1b10e2691 tempest-GroupsTest-656558624 None] Selected osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:34:41 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-e7fa9b1d-d723-49a3-993d-38e1b10e2691 tempest-GroupsTest-656558624 None] casted to osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f Jun 29 03:34:41 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-e7fa9b1d-d723-49a3-993d-38e1b10e2691 tempest-GroupsTest-656558624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-c71abd3e-84a4-4909-a35d-b61785e4ab3a 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:34:41 devstack sudo[107902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-c71abd3e-84a4-4909-a35d-b61785e4ab3a 1073741824 Jun 29 03:34:41 devstack sudo[107902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:34:42 devstack cinder-volume[93468]: DEBUG dbcounter [-] [93468] Writing DB stats cinder:SELECT=88,cinder:INSERT=41,cinder:UPDATE=125,cinder:DELETE=11 {{(pid=93468) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 29 03:34:42 devstack cinder-volume[93468]: DEBUG dbcounter [-] [93468] Writing DB stats cinder:SELECT=100,cinder:INSERT=26,cinder:UPDATE=121,cinder:DELETE=9 {{(pid=93468) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 29 03:34:42 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f31b64a-1f02-489b-b251-71dfef29c90e tempest-VolumesGetTest-1078145542 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:34:42 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-3f31b64a-1f02-489b-b251-71dfef29c90e tempest-VolumesGetTest-1078145542 None] Flow 'volume_create_manager' (7b0c09a0-a802-438f-9bfb-9b4c9ff7e221) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:34:42 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-3f31b64a-1f02-489b-b251-71dfef29c90e tempest-VolumesGetTest-1078145542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34dfc124-de4f-417a-93c8-62480aaf96c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:34:42 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-3f31b64a-1f02-489b-b251-71dfef29c90e tempest-VolumesGetTest-1078145542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34dfc124-de4f-417a-93c8-62480aaf96c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:34:42Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1463145567',display_name='tempest-VolumesGetTest-Volume-812239333',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17d4fff0-227d-4b48-a1a5-64f7bbce8b23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e640ff4d86d542b88f2dba18116829b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:34:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:34:43Z,use_quota=True,user_id='26202c1ba10d4b91882e33e8c46b1802',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:34:42 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-3f31b64a-1f02-489b-b251-71dfef29c90e tempest-VolumesGetTest-1078145542 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06f4f847-4bce-4088-b9f6-06f44e187e6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:34:42 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-3f31b64a-1f02-489b-b251-71dfef29c90e tempest-VolumesGetTest-1078145542 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06f4f847-4bce-4088-b9f6-06f44e187e6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:34:42 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-3f31b64a-1f02-489b-b251-71dfef29c90e tempest-VolumesGetTest-1078145542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67d6ccd3-834e-44f1-8dfc-1666a67b9c61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:34:42 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-3f31b64a-1f02-489b-b251-71dfef29c90e tempest-VolumesGetTest-1078145542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67d6ccd3-834e-44f1-8dfc-1666a67b9c61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '17d4fff0-227d-4b48-a1a5-64f7bbce8b23', 'volume_name': 'volume-17d4fff0-227d-4b48-a1a5-64f7bbce8b23', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:34:42 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-3f31b64a-1f02-489b-b251-71dfef29c90e tempest-VolumesGetTest-1078145542 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (838e2514-8a5e-40fd-9e3b-7aecdae26a29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:34:42 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-3f31b64a-1f02-489b-b251-71dfef29c90e tempest-VolumesGetTest-1078145542 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (838e2514-8a5e-40fd-9e3b-7aecdae26a29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:34:42 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-3f31b64a-1f02-489b-b251-71dfef29c90e tempest-VolumesGetTest-1078145542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (694cd9bd-654b-465d-8b8b-75f5149f6561) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:34:42 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-3f31b64a-1f02-489b-b251-71dfef29c90e tempest-VolumesGetTest-1078145542 None] Volume 17d4fff0-227d-4b48-a1a5-64f7bbce8b23: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-17d4fff0-227d-4b48-a1a5-64f7bbce8b23', 'volume_size': 1} Jun 29 03:34:42 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-3f31b64a-1f02-489b-b251-71dfef29c90e tempest-VolumesGetTest-1078145542 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:34:42 devstack sudo[107902]: pam_unix(sudo:session): session closed for user root Jun 29 03:34:42 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-e7fa9b1d-d723-49a3-993d-38e1b10e2691 tempest-GroupsTest-656558624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-c71abd3e-84a4-4909-a35d-b61785e4ab3a 1073741824" returned: 0 in 1.201s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:34:42 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-e7fa9b1d-d723-49a3-993d-38e1b10e2691 tempest-GroupsTest-656558624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-c71abd3e-84a4-4909-a35d-b61785e4ab3a {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:34:42 devstack sudo[107943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-c71abd3e-84a4-4909-a35d-b61785e4ab3a Jun 29 03:34:42 devstack sudo[107943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:34:43 devstack sudo[107943]: pam_unix(sudo:session): session closed for user root Jun 29 03:34:43 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-e7fa9b1d-d723-49a3-993d-38e1b10e2691 tempest-GroupsTest-656558624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-c71abd3e-84a4-4909-a35d-b61785e4ab3a" returned: 0 in 0.774s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:34:43 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-e7fa9b1d-d723-49a3-993d-38e1b10e2691 tempest-GroupsTest-656558624 None] <== create_volume: return (2024ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:34:43 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-e7fa9b1d-d723-49a3-993d-38e1b10e2691 tempest-GroupsTest-656558624 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.027s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:34:43 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-3f31b64a-1f02-489b-b251-71dfef29c90e tempest-VolumesGetTest-1078145542 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.854s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:34:43 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-3f31b64a-1f02-489b-b251-71dfef29c90e tempest-VolumesGetTest-1078145542 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:34:42Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1463145567',display_name='tempest-VolumesGetTest-Volume-812239333',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17d4fff0-227d-4b48-a1a5-64f7bbce8b23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e640ff4d86d542b88f2dba18116829b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:34:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:34:43Z,use_quota=True,user_id='26202c1ba10d4b91882e33e8c46b1802',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:34:43 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-3f31b64a-1f02-489b-b251-71dfef29c90e tempest-VolumesGetTest-1078145542 None] Creating volume 17d4fff0-227d-4b48-a1a5-64f7bbce8b23 {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:34:43 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-3f31b64a-1f02-489b-b251-71dfef29c90e tempest-VolumesGetTest-1078145542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:34:43 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-3f31b64a-1f02-489b-b251-71dfef29c90e tempest-VolumesGetTest-1078145542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:34:43 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-3f31b64a-1f02-489b-b251-71dfef29c90e tempest-VolumesGetTest-1078145542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:34:43 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-3f31b64a-1f02-489b-b251-71dfef29c90e tempest-VolumesGetTest-1078145542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:34:43 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-3f31b64a-1f02-489b-b251-71dfef29c90e tempest-VolumesGetTest-1078145542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:34:43 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-3f31b64a-1f02-489b-b251-71dfef29c90e tempest-VolumesGetTest-1078145542 None] Selected osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:34:43 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-3f31b64a-1f02-489b-b251-71dfef29c90e tempest-VolumesGetTest-1078145542 None] casted to osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f Jun 29 03:34:43 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-3f31b64a-1f02-489b-b251-71dfef29c90e tempest-VolumesGetTest-1078145542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-17d4fff0-227d-4b48-a1a5-64f7bbce8b23 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:34:43 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-e7fa9b1d-d723-49a3-993d-38e1b10e2691 tempest-GroupsTest-656558624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7cb55635-52c9-4d1b-964b-ef3912fe0587) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c71abd3e-84a4-4909-a35d-b61785e4ab3a', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:34:43 devstack sudo[107947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-17d4fff0-227d-4b48-a1a5-64f7bbce8b23 1073741824 Jun 29 03:34:43 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-e7fa9b1d-d723-49a3-993d-38e1b10e2691 tempest-GroupsTest-656558624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8e6b870-5c43-4e79-8a67-4f6bc60566bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:34:43 devstack sudo[107947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:34:43 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-e7fa9b1d-d723-49a3-993d-38e1b10e2691 tempest-GroupsTest-656558624 None] Volume volume-c71abd3e-84a4-4909-a35d-b61785e4ab3a (c71abd3e-84a4-4909-a35d-b61785e4ab3a): created successfully Jun 29 03:34:43 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-e7fa9b1d-d723-49a3-993d-38e1b10e2691 tempest-GroupsTest-656558624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8e6b870-5c43-4e79-8a67-4f6bc60566bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:34:43 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-e7fa9b1d-d723-49a3-993d-38e1b10e2691 tempest-GroupsTest-656558624 None] Flow 'volume_create_manager' (19fcd0fc-9e0b-478f-94cf-b8b3ad431577) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:34:43 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-e7fa9b1d-d723-49a3-993d-38e1b10e2691 tempest-GroupsTest-656558624 None] Created volume successfully. Jun 29 03:34:44 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-d810624f-6fd4-4141-94a6-294bf674d646 tempest-GroupsTest-656558624 None] Update group completed successfully. Jun 29 03:34:44 devstack sudo[107947]: pam_unix(sudo:session): session closed for user root Jun 29 03:34:44 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-3f31b64a-1f02-489b-b251-71dfef29c90e tempest-VolumesGetTest-1078145542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-17d4fff0-227d-4b48-a1a5-64f7bbce8b23 1073741824" returned: 0 in 1.170s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:34:44 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-3f31b64a-1f02-489b-b251-71dfef29c90e tempest-VolumesGetTest-1078145542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-17d4fff0-227d-4b48-a1a5-64f7bbce8b23 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:34:44 devstack sudo[107954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-17d4fff0-227d-4b48-a1a5-64f7bbce8b23 Jun 29 03:34:44 devstack sudo[107954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:34:45 devstack sudo[107954]: pam_unix(sudo:session): session closed for user root Jun 29 03:34:45 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-3f31b64a-1f02-489b-b251-71dfef29c90e tempest-VolumesGetTest-1078145542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-17d4fff0-227d-4b48-a1a5-64f7bbce8b23" returned: 0 in 0.979s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:34:45 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-3f31b64a-1f02-489b-b251-71dfef29c90e tempest-VolumesGetTest-1078145542 None] <== create_volume: return (2242ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:34:45 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-3f31b64a-1f02-489b-b251-71dfef29c90e tempest-VolumesGetTest-1078145542 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.248s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:34:45 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-3f31b64a-1f02-489b-b251-71dfef29c90e tempest-VolumesGetTest-1078145542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (694cd9bd-654b-465d-8b8b-75f5149f6561) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17d4fff0-227d-4b48-a1a5-64f7bbce8b23', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:34:45 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-3f31b64a-1f02-489b-b251-71dfef29c90e tempest-VolumesGetTest-1078145542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd9e543f-9ca4-4c75-a93d-8291042c8516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:34:46 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-3f31b64a-1f02-489b-b251-71dfef29c90e tempest-VolumesGetTest-1078145542 None] Volume volume-17d4fff0-227d-4b48-a1a5-64f7bbce8b23 (17d4fff0-227d-4b48-a1a5-64f7bbce8b23): created successfully Jun 29 03:34:46 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-3f31b64a-1f02-489b-b251-71dfef29c90e tempest-VolumesGetTest-1078145542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd9e543f-9ca4-4c75-a93d-8291042c8516) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:34:46 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-3f31b64a-1f02-489b-b251-71dfef29c90e tempest-VolumesGetTest-1078145542 None] Flow 'volume_create_manager' (7b0c09a0-a802-438f-9bfb-9b4c9ff7e221) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:34:46 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-3f31b64a-1f02-489b-b251-71dfef29c90e tempest-VolumesGetTest-1078145542 None] Created volume successfully. Jun 29 03:34:46 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-bf4c3ef9-783c-42ff-94be-f4615b7b832c tempest-GroupsTest-656558624 None] Update group completed successfully. Jun 29 03:34:46 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-a9ddf5c2-b8be-48da-9376-c80887c2af0d tempest-VolumesGetTest-1078145542 None] Acquiring lock "cinder-17d4fff0-227d-4b48-a1a5-64f7bbce8b23-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:34:47 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-a9ddf5c2-b8be-48da-9376-c80887c2af0d tempest-VolumesGetTest-1078145542 None] Lock "cinder-17d4fff0-227d-4b48-a1a5-64f7bbce8b23-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:34:47 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-a9ddf5c2-b8be-48da-9376-c80887c2af0d tempest-VolumesGetTest-1078145542 None] Acquiring lock "cinder-quobyte-17d4fff0-227d-4b48-a1a5-64f7bbce8b23" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:34:47 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-a9ddf5c2-b8be-48da-9376-c80887c2af0d tempest-VolumesGetTest-1078145542 None] Lock "cinder-quobyte-17d4fff0-227d-4b48-a1a5-64f7bbce8b23" acquired by "delete_volume" :: waited 0.019s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:34:47 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1865182-2e45-4a9d-b2b7-e8e0918c90cf]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:34:47 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a9ddf5c2-b8be-48da-9376-c80887c2af0d tempest-VolumesGetTest-1078145542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-17d4fff0-227d-4b48-a1a5-64f7bbce8b23 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:34:47 devstack sudo[107976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-17d4fff0-227d-4b48-a1a5-64f7bbce8b23 Jun 29 03:34:47 devstack sudo[107976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:34:48 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-258aabf7-83b2-4953-9ca6-08b902d3c20d tempest-GroupsTest-656558624 None] Acquiring lock "cinder-quobyte-404b6c9f-866e-4fc2-81ef-304315502582" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:34:48 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-258aabf7-83b2-4953-9ca6-08b902d3c20d tempest-GroupsTest-656558624 None] Lock "cinder-quobyte-404b6c9f-866e-4fc2-81ef-304315502582" acquired by "delete_volume" :: waited 0.046s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:34:48 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d4d8d6a-fda0-426e-8296-2e41ab8750ff]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:34:48 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-258aabf7-83b2-4953-9ca6-08b902d3c20d tempest-GroupsTest-656558624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-404b6c9f-866e-4fc2-81ef-304315502582 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:34:48 devstack sudo[107981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-404b6c9f-866e-4fc2-81ef-304315502582 Jun 29 03:34:48 devstack sudo[107981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:34:48 devstack sudo[107976]: pam_unix(sudo:session): session closed for user root Jun 29 03:34:48 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a9ddf5c2-b8be-48da-9376-c80887c2af0d tempest-VolumesGetTest-1078145542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-17d4fff0-227d-4b48-a1a5-64f7bbce8b23" returned: 0 in 1.195s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:34:48 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a9ddf5c2-b8be-48da-9376-c80887c2af0d tempest-VolumesGetTest-1078145542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-17d4fff0-227d-4b48-a1a5-64f7bbce8b23 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:34:48 devstack sudo[107983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-17d4fff0-227d-4b48-a1a5-64f7bbce8b23 Jun 29 03:34:48 devstack sudo[107983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:34:49 devstack sudo[107981]: pam_unix(sudo:session): session closed for user root Jun 29 03:34:49 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-258aabf7-83b2-4953-9ca6-08b902d3c20d tempest-GroupsTest-656558624 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-404b6c9f-866e-4fc2-81ef-304315502582" returned: 0 in 1.067s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:34:49 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-258aabf7-83b2-4953-9ca6-08b902d3c20d tempest-GroupsTest-656558624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-404b6c9f-866e-4fc2-81ef-304315502582 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:34:49 devstack sudo[107989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-404b6c9f-866e-4fc2-81ef-304315502582 Jun 29 03:34:49 devstack sudo[107989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:34:49 devstack sudo[107983]: pam_unix(sudo:session): session closed for user root Jun 29 03:34:49 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a9ddf5c2-b8be-48da-9376-c80887c2af0d tempest-VolumesGetTest-1078145542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-17d4fff0-227d-4b48-a1a5-64f7bbce8b23" returned: 0 in 1.181s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:34:49 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-a9ddf5c2-b8be-48da-9376-c80887c2af0d tempest-VolumesGetTest-1078145542 None] Lock "cinder-quobyte-17d4fff0-227d-4b48-a1a5-64f7bbce8b23" released by "delete_volume" :: held 2.436s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:34:49 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-a9ddf5c2-b8be-48da-9376-c80887c2af0d tempest-VolumesGetTest-1078145542 None] Created reservations ['5b399777-5575-4ffe-bac5-979c91d09f9b', 'b742073e-576a-4fb6-b9ee-b73fccea5da5', 'f4e20a1b-2df5-4d2e-8a38-40c943c7afa4', 'd4d4c215-2f7b-4422-8137-8e3d8bb8e11d'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:34:49 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-a9ddf5c2-b8be-48da-9376-c80887c2af0d tempest-VolumesGetTest-1078145542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:34:49 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-a9ddf5c2-b8be-48da-9376-c80887c2af0d tempest-VolumesGetTest-1078145542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:34:49 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-a9ddf5c2-b8be-48da-9376-c80887c2af0d tempest-VolumesGetTest-1078145542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:34:49 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-a9ddf5c2-b8be-48da-9376-c80887c2af0d tempest-VolumesGetTest-1078145542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:34:49 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-a9ddf5c2-b8be-48da-9376-c80887c2af0d tempest-VolumesGetTest-1078145542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:34:49 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a9ddf5c2-b8be-48da-9376-c80887c2af0d tempest-VolumesGetTest-1078145542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:34:49 devstack sudo[107991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf Jun 29 03:34:49 devstack sudo[107991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:34:49 devstack sudo[107989]: pam_unix(sudo:session): session closed for user root Jun 29 03:34:49 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-258aabf7-83b2-4953-9ca6-08b902d3c20d tempest-GroupsTest-656558624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-404b6c9f-866e-4fc2-81ef-304315502582" returned: 0 in 0.741s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:34:49 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-258aabf7-83b2-4953-9ca6-08b902d3c20d tempest-GroupsTest-656558624 None] Lock "cinder-quobyte-404b6c9f-866e-4fc2-81ef-304315502582" released by "delete_volume" :: held 1.863s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:34:49 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-258aabf7-83b2-4953-9ca6-08b902d3c20d tempest-GroupsTest-656558624 None] Acquiring lock "cinder-quobyte-c71abd3e-84a4-4909-a35d-b61785e4ab3a" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:34:50 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-258aabf7-83b2-4953-9ca6-08b902d3c20d tempest-GroupsTest-656558624 None] Lock "cinder-quobyte-c71abd3e-84a4-4909-a35d-b61785e4ab3a" acquired by "delete_volume" :: waited 0.017s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:34:50 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[04b6c391-af91-4f40-b519-ba8d998e4cbb]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:34:50 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-258aabf7-83b2-4953-9ca6-08b902d3c20d tempest-GroupsTest-656558624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-c71abd3e-84a4-4909-a35d-b61785e4ab3a {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:34:50 devstack sudo[107994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-c71abd3e-84a4-4909-a35d-b61785e4ab3a Jun 29 03:34:50 devstack sudo[107994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:34:50 devstack sudo[107991]: pam_unix(sudo:session): session closed for user root Jun 29 03:34:50 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a9ddf5c2-b8be-48da-9376-c80887c2af0d tempest-VolumesGetTest-1078145542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf" returned: 0 in 0.994s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:34:50 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-a9ddf5c2-b8be-48da-9376-c80887c2af0d tempest-VolumesGetTest-1078145542 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:34:50 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-a9ddf5c2-b8be-48da-9376-c80887c2af0d tempest-VolumesGetTest-1078145542 None] Deleted volume successfully. Jun 29 03:34:50 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-1a0fff8a-8684-4358-9e07-0f6d6387f89c tempest-VolumesGetTest-1078145542 None] Acquiring lock "cinder-69d5fa60-e59f-4e22-be42-ee6cc9c7293e-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:34:50 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-a9ddf5c2-b8be-48da-9376-c80887c2af0d tempest-VolumesGetTest-1078145542 None] Lock "cinder-17d4fff0-227d-4b48-a1a5-64f7bbce8b23-delete_volume" released by "delete_volume" :: held 3.715s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:34:50 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-1a0fff8a-8684-4358-9e07-0f6d6387f89c tempest-VolumesGetTest-1078145542 None] Lock "cinder-69d5fa60-e59f-4e22-be42-ee6cc9c7293e-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:34:50 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-1a0fff8a-8684-4358-9e07-0f6d6387f89c tempest-VolumesGetTest-1078145542 None] Acquiring lock "cinder-quobyte-69d5fa60-e59f-4e22-be42-ee6cc9c7293e" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:34:50 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-1a0fff8a-8684-4358-9e07-0f6d6387f89c tempest-VolumesGetTest-1078145542 None] Lock "cinder-quobyte-69d5fa60-e59f-4e22-be42-ee6cc9c7293e" acquired by "delete_volume" :: waited 0.034s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:34:50 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9358b65-c509-4c76-ab0b-12c007b0079c]: (4, 'raw') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:34:50 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-1a0fff8a-8684-4358-9e07-0f6d6387f89c tempest-VolumesGetTest-1078145542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-69d5fa60-e59f-4e22-be42-ee6cc9c7293e {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:34:51 devstack sudo[108001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-69d5fa60-e59f-4e22-be42-ee6cc9c7293e Jun 29 03:34:51 devstack sudo[108001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:34:51 devstack sudo[107994]: pam_unix(sudo:session): session closed for user root Jun 29 03:34:51 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-258aabf7-83b2-4953-9ca6-08b902d3c20d tempest-GroupsTest-656558624 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-c71abd3e-84a4-4909-a35d-b61785e4ab3a" returned: 0 in 1.172s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:34:51 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-258aabf7-83b2-4953-9ca6-08b902d3c20d tempest-GroupsTest-656558624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-c71abd3e-84a4-4909-a35d-b61785e4ab3a {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:34:51 devstack sudo[108007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-c71abd3e-84a4-4909-a35d-b61785e4ab3a Jun 29 03:34:51 devstack sudo[108007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:34:51 devstack sudo[108001]: pam_unix(sudo:session): session closed for user root Jun 29 03:34:51 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-1a0fff8a-8684-4358-9e07-0f6d6387f89c tempest-VolumesGetTest-1078145542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-69d5fa60-e59f-4e22-be42-ee6cc9c7293e" returned: 0 in 0.913s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:34:51 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-1a0fff8a-8684-4358-9e07-0f6d6387f89c tempest-VolumesGetTest-1078145542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-69d5fa60-e59f-4e22-be42-ee6cc9c7293e {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:34:52 devstack sudo[108012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-69d5fa60-e59f-4e22-be42-ee6cc9c7293e Jun 29 03:34:52 devstack sudo[108012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:34:52 devstack sudo[108007]: pam_unix(sudo:session): session closed for user root Jun 29 03:34:52 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-258aabf7-83b2-4953-9ca6-08b902d3c20d tempest-GroupsTest-656558624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-c71abd3e-84a4-4909-a35d-b61785e4ab3a" returned: 0 in 0.807s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:34:52 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-258aabf7-83b2-4953-9ca6-08b902d3c20d tempest-GroupsTest-656558624 None] Lock "cinder-quobyte-c71abd3e-84a4-4909-a35d-b61785e4ab3a" released by "delete_volume" :: held 2.067s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:34:52 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-258aabf7-83b2-4953-9ca6-08b902d3c20d tempest-GroupsTest-656558624 None] Created reservations ['f7846be8-2b03-4045-b856-11f852444440'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:34:52 devstack cinder-volume[93468]: WARNING cinder.quota [None req-258aabf7-83b2-4953-9ca6-08b902d3c20d tempest-GroupsTest-656558624 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1116975366 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1116975366, it is now deprecated. Please use the default quota class for default quota. Jun 29 03:34:52 devstack cinder-volume[93468]: WARNING cinder.quota [None req-258aabf7-83b2-4953-9ca6-08b902d3c20d tempest-GroupsTest-656558624 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1116975366 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1116975366, it is now deprecated. Please use the default quota class for default quota. Jun 29 03:34:52 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-258aabf7-83b2-4953-9ca6-08b902d3c20d tempest-GroupsTest-656558624 None] Created reservations ['ba638758-a640-465b-8531-5bf62ce38bf7', '2f03def6-1ec6-4426-b8f9-39659c5492e5', 'bfe3721f-1f0c-4649-a0b3-e897f43dd693', 'ddd98b29-b398-4ed8-b864-fbea5dd72a52'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:34:52 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-258aabf7-83b2-4953-9ca6-08b902d3c20d tempest-GroupsTest-656558624 None] Created reservations ['58a87147-1477-4d43-9bd9-9e45bd100486', '4193e1a4-eab1-4ff5-9c55-879afb87bc0b', '098b8b27-9eb2-4bdf-96b6-a0ec8460a150', 'fcc0d828-1e00-400d-b2f6-4c92253f5f30'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:34:52 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-258aabf7-83b2-4953-9ca6-08b902d3c20d tempest-GroupsTest-656558624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:34:52 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-258aabf7-83b2-4953-9ca6-08b902d3c20d tempest-GroupsTest-656558624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:34:52 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-258aabf7-83b2-4953-9ca6-08b902d3c20d tempest-GroupsTest-656558624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:34:52 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-258aabf7-83b2-4953-9ca6-08b902d3c20d tempest-GroupsTest-656558624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:34:52 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-258aabf7-83b2-4953-9ca6-08b902d3c20d tempest-GroupsTest-656558624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:34:52 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-258aabf7-83b2-4953-9ca6-08b902d3c20d tempest-GroupsTest-656558624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:34:52 devstack sudo[108018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf Jun 29 03:34:52 devstack sudo[108018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:34:52 devstack sudo[108012]: pam_unix(sudo:session): session closed for user root Jun 29 03:34:52 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-1a0fff8a-8684-4358-9e07-0f6d6387f89c tempest-VolumesGetTest-1078145542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-69d5fa60-e59f-4e22-be42-ee6cc9c7293e" returned: 1 in 0.967s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:34:52 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-1a0fff8a-8684-4358-9e07-0f6d6387f89c tempest-VolumesGetTest-1078145542 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-69d5fa60-e59f-4e22-be42-ee6cc9c7293e' failed. Not Retrying. {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 29 03:34:52 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-1a0fff8a-8684-4358-9e07-0f6d6387f89c tempest-VolumesGetTest-1078145542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-69d5fa60-e59f-4e22-be42-ee6cc9c7293e {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:34:52 devstack sudo[108030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-69d5fa60-e59f-4e22-be42-ee6cc9c7293e Jun 29 03:34:52 devstack sudo[108030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:34:53 devstack sudo[108018]: pam_unix(sudo:session): session closed for user root Jun 29 03:34:53 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-258aabf7-83b2-4953-9ca6-08b902d3c20d tempest-GroupsTest-656558624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf" returned: 0 in 1.112s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:34:53 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-258aabf7-83b2-4953-9ca6-08b902d3c20d tempest-GroupsTest-656558624 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:34:53 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-258aabf7-83b2-4953-9ca6-08b902d3c20d tempest-GroupsTest-656558624 None] Delete group completed successfully. Jun 29 03:34:53 devstack sudo[108030]: pam_unix(sudo:session): session closed for user root Jun 29 03:34:53 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-1a0fff8a-8684-4358-9e07-0f6d6387f89c tempest-VolumesGetTest-1078145542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-69d5fa60-e59f-4e22-be42-ee6cc9c7293e" returned: 0 in 1.144s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:34:54 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-1a0fff8a-8684-4358-9e07-0f6d6387f89c tempest-VolumesGetTest-1078145542 None] Lock "cinder-quobyte-69d5fa60-e59f-4e22-be42-ee6cc9c7293e" released by "delete_volume" :: held 3.145s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:34:54 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-1a0fff8a-8684-4358-9e07-0f6d6387f89c tempest-VolumesGetTest-1078145542 None] Created reservations ['64d98118-f215-4383-9630-1dd5c455577b', 'd87b001d-1f44-41cf-aeed-bb449f3c4ab3', '575d64ee-0654-4c46-9f4a-08af395b6026', '424273e0-82f4-4b3d-bf28-934569810cc4'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:34:54 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-1a0fff8a-8684-4358-9e07-0f6d6387f89c tempest-VolumesGetTest-1078145542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:34:54 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-1a0fff8a-8684-4358-9e07-0f6d6387f89c tempest-VolumesGetTest-1078145542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:34:54 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-1a0fff8a-8684-4358-9e07-0f6d6387f89c tempest-VolumesGetTest-1078145542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:34:54 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-1a0fff8a-8684-4358-9e07-0f6d6387f89c tempest-VolumesGetTest-1078145542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:34:54 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-1a0fff8a-8684-4358-9e07-0f6d6387f89c tempest-VolumesGetTest-1078145542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:34:54 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-1a0fff8a-8684-4358-9e07-0f6d6387f89c tempest-VolumesGetTest-1078145542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:34:54 devstack sudo[108099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf Jun 29 03:34:54 devstack sudo[108099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:34:55 devstack sudo[108099]: pam_unix(sudo:session): session closed for user root Jun 29 03:34:55 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-1a0fff8a-8684-4358-9e07-0f6d6387f89c tempest-VolumesGetTest-1078145542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf" returned: 0 in 1.055s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:34:55 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-1a0fff8a-8684-4358-9e07-0f6d6387f89c tempest-VolumesGetTest-1078145542 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:34:55 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-1a0fff8a-8684-4358-9e07-0f6d6387f89c tempest-VolumesGetTest-1078145542 None] Deleted volume successfully. Jun 29 03:34:55 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-1a0fff8a-8684-4358-9e07-0f6d6387f89c tempest-VolumesGetTest-1078145542 None] Lock "cinder-69d5fa60-e59f-4e22-be42-ee6cc9c7293e-delete_volume" released by "delete_volume" :: held 4.634s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:34:59 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-a224fe4f-0cde-469e-abb2-24dc2391e5de tempest-CreateVolumesFromImageTest-1898747794 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:34:59 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-a224fe4f-0cde-469e-abb2-24dc2391e5de tempest-CreateVolumesFromImageTest-1898747794 None] Flow 'volume_create_manager' (24a72a87-94b3-4573-aed4-fd15791a7ad2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:34:59 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-a224fe4f-0cde-469e-abb2-24dc2391e5de tempest-CreateVolumesFromImageTest-1898747794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd83174e-76ab-4b19-b6be-3c8168ab3786) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:34:59 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-a224fe4f-0cde-469e-abb2-24dc2391e5de tempest-CreateVolumesFromImageTest-1898747794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd83174e-76ab-4b19-b6be-3c8168ab3786) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:34:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1560343488',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57e5927c-ad60-4e2a-8642-42c2bb732828,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f796fa5c8344d0da2da1f443dee5895',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:35:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:35:00Z,use_quota=True,user_id='a7734e160b794077b0d3215c7fe5a9cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:34:59 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-a224fe4f-0cde-469e-abb2-24dc2391e5de tempest-CreateVolumesFromImageTest-1898747794 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53aa7341-0e17-45c2-87d9-7090fc469a38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:34:59 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-a224fe4f-0cde-469e-abb2-24dc2391e5de tempest-CreateVolumesFromImageTest-1898747794 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53aa7341-0e17-45c2-87d9-7090fc469a38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:34:59 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-a224fe4f-0cde-469e-abb2-24dc2391e5de tempest-CreateVolumesFromImageTest-1898747794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b654a596-d478-4845-948f-fb84bba22225) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:34:59 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-a224fe4f-0cde-469e-abb2-24dc2391e5de tempest-CreateVolumesFromImageTest-1898747794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b654a596-d478-4845-948f-fb84bba22225) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '57e5927c-ad60-4e2a-8642-42c2bb732828', 'volume_name': 'volume-57e5927c-ad60-4e2a-8642-42c2bb732828', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:34:59 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-a224fe4f-0cde-469e-abb2-24dc2391e5de tempest-CreateVolumesFromImageTest-1898747794 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5e0edd5-9486-4940-9ccf-707dd800ab1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:34:59 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-a224fe4f-0cde-469e-abb2-24dc2391e5de tempest-CreateVolumesFromImageTest-1898747794 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5e0edd5-9486-4940-9ccf-707dd800ab1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:34:59 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-a224fe4f-0cde-469e-abb2-24dc2391e5de tempest-CreateVolumesFromImageTest-1898747794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1483c983-980e-4ce8-a1b2-c8a17d63f313) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:34:59 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-a224fe4f-0cde-469e-abb2-24dc2391e5de tempest-CreateVolumesFromImageTest-1898747794 None] Volume 57e5927c-ad60-4e2a-8642-42c2bb732828: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-57e5927c-ad60-4e2a-8642-42c2bb732828', 'volume_size': 1} Jun 29 03:34:59 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-a224fe4f-0cde-469e-abb2-24dc2391e5de tempest-CreateVolumesFromImageTest-1898747794 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:34:59 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-a224fe4f-0cde-469e-abb2-24dc2391e5de tempest-CreateVolumesFromImageTest-1898747794 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:34:59 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-a224fe4f-0cde-469e-abb2-24dc2391e5de tempest-CreateVolumesFromImageTest-1898747794 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:34:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1560343488',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57e5927c-ad60-4e2a-8642-42c2bb732828,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f796fa5c8344d0da2da1f443dee5895',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:35:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:35:00Z,use_quota=True,user_id='a7734e160b794077b0d3215c7fe5a9cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:34:59 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-a224fe4f-0cde-469e-abb2-24dc2391e5de tempest-CreateVolumesFromImageTest-1898747794 None] Creating volume 57e5927c-ad60-4e2a-8642-42c2bb732828 {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:34:59 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-a224fe4f-0cde-469e-abb2-24dc2391e5de tempest-CreateVolumesFromImageTest-1898747794 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:34:59 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-a224fe4f-0cde-469e-abb2-24dc2391e5de tempest-CreateVolumesFromImageTest-1898747794 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:34:59 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-a224fe4f-0cde-469e-abb2-24dc2391e5de tempest-CreateVolumesFromImageTest-1898747794 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:34:59 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-a224fe4f-0cde-469e-abb2-24dc2391e5de tempest-CreateVolumesFromImageTest-1898747794 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:34:59 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-a224fe4f-0cde-469e-abb2-24dc2391e5de tempest-CreateVolumesFromImageTest-1898747794 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:34:59 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-a224fe4f-0cde-469e-abb2-24dc2391e5de tempest-CreateVolumesFromImageTest-1898747794 None] Selected osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:34:59 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-a224fe4f-0cde-469e-abb2-24dc2391e5de tempest-CreateVolumesFromImageTest-1898747794 None] casted to osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f Jun 29 03:34:59 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a224fe4f-0cde-469e-abb2-24dc2391e5de tempest-CreateVolumesFromImageTest-1898747794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-57e5927c-ad60-4e2a-8642-42c2bb732828 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:34:59 devstack sudo[108109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-57e5927c-ad60-4e2a-8642-42c2bb732828 1073741824 Jun 29 03:34:59 devstack sudo[108109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:35:00 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2282f08-131c-4614-8fa4-32130af1c495 tempest-CreateVolumesFromImageTest-1898747794 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:35:00 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-b2282f08-131c-4614-8fa4-32130af1c495 tempest-CreateVolumesFromImageTest-1898747794 None] Flow 'volume_create_manager' (12802604-5b27-422c-b4f5-4c48c1f49d66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:35:00 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-b2282f08-131c-4614-8fa4-32130af1c495 tempest-CreateVolumesFromImageTest-1898747794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9ac16cf-ba98-439e-9ccb-b819725e2cdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:35:00 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-b2282f08-131c-4614-8fa4-32130af1c495 tempest-CreateVolumesFromImageTest-1898747794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9ac16cf-ba98-439e-9ccb-b819725e2cdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:35:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1619733147',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98439cc7-fe60-4ebe-b9f9-8cae6521e385,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f796fa5c8344d0da2da1f443dee5895',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:35:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:35:00Z,use_quota=True,user_id='a7734e160b794077b0d3215c7fe5a9cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:35:00 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-b2282f08-131c-4614-8fa4-32130af1c495 tempest-CreateVolumesFromImageTest-1898747794 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (094f15eb-15ff-46dd-8ae0-55f286e406b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:35:00 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-b2282f08-131c-4614-8fa4-32130af1c495 tempest-CreateVolumesFromImageTest-1898747794 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (094f15eb-15ff-46dd-8ae0-55f286e406b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:35:00 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-b2282f08-131c-4614-8fa4-32130af1c495 tempest-CreateVolumesFromImageTest-1898747794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9dba824-ac6b-4b79-b554-2f483d275d99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:35:00 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-b2282f08-131c-4614-8fa4-32130af1c495 tempest-CreateVolumesFromImageTest-1898747794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9dba824-ac6b-4b79-b554-2f483d275d99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '98439cc7-fe60-4ebe-b9f9-8cae6521e385', 'volume_name': 'volume-98439cc7-fe60-4ebe-b9f9-8cae6521e385', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:35:00 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-b2282f08-131c-4614-8fa4-32130af1c495 tempest-CreateVolumesFromImageTest-1898747794 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3f9be1f-fe9d-4234-9500-228b615ccf1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:35:00 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-b2282f08-131c-4614-8fa4-32130af1c495 tempest-CreateVolumesFromImageTest-1898747794 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3f9be1f-fe9d-4234-9500-228b615ccf1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:35:00 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-b2282f08-131c-4614-8fa4-32130af1c495 tempest-CreateVolumesFromImageTest-1898747794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2863b84-05e0-4fb2-8424-dbcad8ead793) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:35:00 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-b2282f08-131c-4614-8fa4-32130af1c495 tempest-CreateVolumesFromImageTest-1898747794 None] Volume 98439cc7-fe60-4ebe-b9f9-8cae6521e385: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-98439cc7-fe60-4ebe-b9f9-8cae6521e385', 'volume_size': 1} Jun 29 03:35:00 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-b2282f08-131c-4614-8fa4-32130af1c495 tempest-CreateVolumesFromImageTest-1898747794 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:35:01 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1c4f02f-3c0b-4df4-b203-96a108b2614f tempest-CreateVolumesFromImageTest-1898747794 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:35:01 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-b1c4f02f-3c0b-4df4-b203-96a108b2614f tempest-CreateVolumesFromImageTest-1898747794 None] Flow 'volume_create_manager' (75ca3d84-6efd-4fd7-8358-52c6f64652cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:35:01 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-b1c4f02f-3c0b-4df4-b203-96a108b2614f tempest-CreateVolumesFromImageTest-1898747794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fbc89d2-d771-4aa5-a0ec-ad08c48f9d5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:35:01 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-b1c4f02f-3c0b-4df4-b203-96a108b2614f tempest-CreateVolumesFromImageTest-1898747794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fbc89d2-d771-4aa5-a0ec-ad08c48f9d5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:35:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-262719683',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ed27ab0-ef4e-4cb1-bb3e-ce1735ad5e61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f796fa5c8344d0da2da1f443dee5895',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:35:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:35:02Z,use_quota=True,user_id='a7734e160b794077b0d3215c7fe5a9cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:35:01 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-b1c4f02f-3c0b-4df4-b203-96a108b2614f tempest-CreateVolumesFromImageTest-1898747794 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c086f1ae-42b4-4bf5-88e7-8d8b4267cd86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:35:02 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-b1c4f02f-3c0b-4df4-b203-96a108b2614f tempest-CreateVolumesFromImageTest-1898747794 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c086f1ae-42b4-4bf5-88e7-8d8b4267cd86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:35:02 devstack sudo[108109]: pam_unix(sudo:session): session closed for user root Jun 29 03:35:02 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-b1c4f02f-3c0b-4df4-b203-96a108b2614f tempest-CreateVolumesFromImageTest-1898747794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e0a6fe6-4fa7-41a8-902f-ad1c54e20ce2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:35:02 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-b1c4f02f-3c0b-4df4-b203-96a108b2614f tempest-CreateVolumesFromImageTest-1898747794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e0a6fe6-4fa7-41a8-902f-ad1c54e20ce2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ed27ab0-ef4e-4cb1-bb3e-ce1735ad5e61', 'volume_name': 'volume-7ed27ab0-ef4e-4cb1-bb3e-ce1735ad5e61', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:35:02 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-b1c4f02f-3c0b-4df4-b203-96a108b2614f tempest-CreateVolumesFromImageTest-1898747794 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f74dcf14-05eb-49e0-b03a-26fce492aeb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:35:02 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-b1c4f02f-3c0b-4df4-b203-96a108b2614f tempest-CreateVolumesFromImageTest-1898747794 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f74dcf14-05eb-49e0-b03a-26fce492aeb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:35:02 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-b1c4f02f-3c0b-4df4-b203-96a108b2614f tempest-CreateVolumesFromImageTest-1898747794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0394587-8862-4ddf-8347-7dbb33a9af5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:35:02 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-b1c4f02f-3c0b-4df4-b203-96a108b2614f tempest-CreateVolumesFromImageTest-1898747794 None] Volume 7ed27ab0-ef4e-4cb1-bb3e-ce1735ad5e61: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ed27ab0-ef4e-4cb1-bb3e-ce1735ad5e61', 'volume_size': 1} Jun 29 03:35:02 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-b1c4f02f-3c0b-4df4-b203-96a108b2614f tempest-CreateVolumesFromImageTest-1898747794 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:35:02 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a224fe4f-0cde-469e-abb2-24dc2391e5de tempest-CreateVolumesFromImageTest-1898747794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-57e5927c-ad60-4e2a-8642-42c2bb732828 1073741824" returned: 0 in 2.311s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:35:02 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a224fe4f-0cde-469e-abb2-24dc2391e5de tempest-CreateVolumesFromImageTest-1898747794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-57e5927c-ad60-4e2a-8642-42c2bb732828 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:35:02 devstack sudo[108120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-57e5927c-ad60-4e2a-8642-42c2bb732828 Jun 29 03:35:02 devstack sudo[108120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:35:02 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-7cc240c2-346c-432f-baf5-194495e86cc7 tempest-CreateVolumesFromImageTest-1898747794 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:35:02 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-7cc240c2-346c-432f-baf5-194495e86cc7 tempest-CreateVolumesFromImageTest-1898747794 None] Flow 'volume_create_manager' (36155d40-a472-4853-ab9b-d8eb4aa16b2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:35:02 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-7cc240c2-346c-432f-baf5-194495e86cc7 tempest-CreateVolumesFromImageTest-1898747794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (781702eb-d739-4c1d-b649-6caf21f4544c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:35:02 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-7cc240c2-346c-432f-baf5-194495e86cc7 tempest-CreateVolumesFromImageTest-1898747794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (781702eb-d739-4c1d-b649-6caf21f4544c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:35:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-771305211',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b87376b-cfc5-4943-942f-157ad3d83b5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f796fa5c8344d0da2da1f443dee5895',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:35:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:35:03Z,use_quota=True,user_id='a7734e160b794077b0d3215c7fe5a9cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:35:03 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-7cc240c2-346c-432f-baf5-194495e86cc7 tempest-CreateVolumesFromImageTest-1898747794 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83cfab41-1de8-4445-8ebd-cd9e557c5598) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:35:03 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-7cc240c2-346c-432f-baf5-194495e86cc7 tempest-CreateVolumesFromImageTest-1898747794 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83cfab41-1de8-4445-8ebd-cd9e557c5598) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:35:03 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-7cc240c2-346c-432f-baf5-194495e86cc7 tempest-CreateVolumesFromImageTest-1898747794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (815bcded-eb1f-4f68-9f9e-321373c0feeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:35:03 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-7cc240c2-346c-432f-baf5-194495e86cc7 tempest-CreateVolumesFromImageTest-1898747794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (815bcded-eb1f-4f68-9f9e-321373c0feeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b87376b-cfc5-4943-942f-157ad3d83b5b', 'volume_name': 'volume-1b87376b-cfc5-4943-942f-157ad3d83b5b', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:35:03 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-7cc240c2-346c-432f-baf5-194495e86cc7 tempest-CreateVolumesFromImageTest-1898747794 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a88bda0-32d1-43e1-af16-0290be6b33d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:35:03 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-7cc240c2-346c-432f-baf5-194495e86cc7 tempest-CreateVolumesFromImageTest-1898747794 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a88bda0-32d1-43e1-af16-0290be6b33d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:35:03 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-7cc240c2-346c-432f-baf5-194495e86cc7 tempest-CreateVolumesFromImageTest-1898747794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5fe63ef-4c93-4cd9-8434-c3d6227818b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:35:03 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-7cc240c2-346c-432f-baf5-194495e86cc7 tempest-CreateVolumesFromImageTest-1898747794 None] Volume 1b87376b-cfc5-4943-942f-157ad3d83b5b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b87376b-cfc5-4943-942f-157ad3d83b5b', 'volume_size': 1} Jun 29 03:35:03 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-7cc240c2-346c-432f-baf5-194495e86cc7 tempest-CreateVolumesFromImageTest-1898747794 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:35:03 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2e37959-fdfb-4393-a20f-38669bb42207 tempest-CreateVolumesFromImageTest-1898747794 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:35:03 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-f2e37959-fdfb-4393-a20f-38669bb42207 tempest-CreateVolumesFromImageTest-1898747794 None] Flow 'volume_create_manager' (e758dce1-fb75-4cb1-8dd8-2cac36d4d0c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:35:03 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-f2e37959-fdfb-4393-a20f-38669bb42207 tempest-CreateVolumesFromImageTest-1898747794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed190267-e762-4894-9bb7-772efb7e0409) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:35:03 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-f2e37959-fdfb-4393-a20f-38669bb42207 tempest-CreateVolumesFromImageTest-1898747794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed190267-e762-4894-9bb7-772efb7e0409) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:35:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1952576170',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c08955b9-6508-41d9-ae36-a864cfccfe9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f796fa5c8344d0da2da1f443dee5895',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:35:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:35:03Z,use_quota=True,user_id='a7734e160b794077b0d3215c7fe5a9cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:35:03 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-f2e37959-fdfb-4393-a20f-38669bb42207 tempest-CreateVolumesFromImageTest-1898747794 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (197ec7a1-3f8b-41bc-9e83-87227f599636) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:35:03 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-f2e37959-fdfb-4393-a20f-38669bb42207 tempest-CreateVolumesFromImageTest-1898747794 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (197ec7a1-3f8b-41bc-9e83-87227f599636) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:35:03 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-f2e37959-fdfb-4393-a20f-38669bb42207 tempest-CreateVolumesFromImageTest-1898747794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a756f19e-5996-4f0b-ac6a-488e42ea732e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:35:03 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-f2e37959-fdfb-4393-a20f-38669bb42207 tempest-CreateVolumesFromImageTest-1898747794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a756f19e-5996-4f0b-ac6a-488e42ea732e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c08955b9-6508-41d9-ae36-a864cfccfe9a', 'volume_name': 'volume-c08955b9-6508-41d9-ae36-a864cfccfe9a', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:35:03 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-f2e37959-fdfb-4393-a20f-38669bb42207 tempest-CreateVolumesFromImageTest-1898747794 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56188517-9e77-43e1-a81a-1d977439f677) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:35:03 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-f2e37959-fdfb-4393-a20f-38669bb42207 tempest-CreateVolumesFromImageTest-1898747794 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56188517-9e77-43e1-a81a-1d977439f677) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:35:03 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-f2e37959-fdfb-4393-a20f-38669bb42207 tempest-CreateVolumesFromImageTest-1898747794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84d88b7e-cdea-40c2-a2ad-dc5188205a9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:35:03 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-f2e37959-fdfb-4393-a20f-38669bb42207 tempest-CreateVolumesFromImageTest-1898747794 None] Volume c08955b9-6508-41d9-ae36-a864cfccfe9a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c08955b9-6508-41d9-ae36-a864cfccfe9a', 'volume_size': 1} Jun 29 03:35:03 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-f2e37959-fdfb-4393-a20f-38669bb42207 tempest-CreateVolumesFromImageTest-1898747794 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:35:03 devstack sudo[108120]: pam_unix(sudo:session): session closed for user root Jun 29 03:35:03 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a224fe4f-0cde-469e-abb2-24dc2391e5de tempest-CreateVolumesFromImageTest-1898747794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-57e5927c-ad60-4e2a-8642-42c2bb732828" returned: 0 in 1.532s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:35:03 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-a224fe4f-0cde-469e-abb2-24dc2391e5de tempest-CreateVolumesFromImageTest-1898747794 None] <== create_volume: return (3933ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:35:03 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-a224fe4f-0cde-469e-abb2-24dc2391e5de tempest-CreateVolumesFromImageTest-1898747794 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.936s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:35:03 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-b2282f08-131c-4614-8fa4-32130af1c495 tempest-CreateVolumesFromImageTest-1898747794 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.824s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:35:03 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-b2282f08-131c-4614-8fa4-32130af1c495 tempest-CreateVolumesFromImageTest-1898747794 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:35:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1619733147',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98439cc7-fe60-4ebe-b9f9-8cae6521e385,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f796fa5c8344d0da2da1f443dee5895',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:35:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:35:00Z,use_quota=True,user_id='a7734e160b794077b0d3215c7fe5a9cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:35:03 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-b2282f08-131c-4614-8fa4-32130af1c495 tempest-CreateVolumesFromImageTest-1898747794 None] Creating volume 98439cc7-fe60-4ebe-b9f9-8cae6521e385 {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:35:03 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-b2282f08-131c-4614-8fa4-32130af1c495 tempest-CreateVolumesFromImageTest-1898747794 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:35:03 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-b2282f08-131c-4614-8fa4-32130af1c495 tempest-CreateVolumesFromImageTest-1898747794 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:35:03 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-b2282f08-131c-4614-8fa4-32130af1c495 tempest-CreateVolumesFromImageTest-1898747794 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:35:03 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-b2282f08-131c-4614-8fa4-32130af1c495 tempest-CreateVolumesFromImageTest-1898747794 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:35:03 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-b2282f08-131c-4614-8fa4-32130af1c495 tempest-CreateVolumesFromImageTest-1898747794 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:35:03 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-b2282f08-131c-4614-8fa4-32130af1c495 tempest-CreateVolumesFromImageTest-1898747794 None] Selected osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:35:03 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-b2282f08-131c-4614-8fa4-32130af1c495 tempest-CreateVolumesFromImageTest-1898747794 None] casted to osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f Jun 29 03:35:03 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b2282f08-131c-4614-8fa4-32130af1c495 tempest-CreateVolumesFromImageTest-1898747794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-98439cc7-fe60-4ebe-b9f9-8cae6521e385 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:35:03 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-a224fe4f-0cde-469e-abb2-24dc2391e5de tempest-CreateVolumesFromImageTest-1898747794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1483c983-980e-4ce8-a1b2-c8a17d63f313) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57e5927c-ad60-4e2a-8642-42c2bb732828', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:35:03 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-a224fe4f-0cde-469e-abb2-24dc2391e5de tempest-CreateVolumesFromImageTest-1898747794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bede843f-774e-4266-b9d7-140d9a0e5f27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:35:03 devstack sudo[108123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-98439cc7-fe60-4ebe-b9f9-8cae6521e385 1073741824 Jun 29 03:35:03 devstack sudo[108123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:35:03 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-a224fe4f-0cde-469e-abb2-24dc2391e5de tempest-CreateVolumesFromImageTest-1898747794 None] Volume volume-57e5927c-ad60-4e2a-8642-42c2bb732828 (57e5927c-ad60-4e2a-8642-42c2bb732828): created successfully Jun 29 03:35:03 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-a224fe4f-0cde-469e-abb2-24dc2391e5de tempest-CreateVolumesFromImageTest-1898747794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bede843f-774e-4266-b9d7-140d9a0e5f27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:35:03 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-a224fe4f-0cde-469e-abb2-24dc2391e5de tempest-CreateVolumesFromImageTest-1898747794 None] Flow 'volume_create_manager' (24a72a87-94b3-4573-aed4-fd15791a7ad2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:35:03 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-a224fe4f-0cde-469e-abb2-24dc2391e5de tempest-CreateVolumesFromImageTest-1898747794 None] Created volume successfully. Jun 29 03:35:05 devstack sudo[108123]: pam_unix(sudo:session): session closed for user root Jun 29 03:35:05 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b2282f08-131c-4614-8fa4-32130af1c495 tempest-CreateVolumesFromImageTest-1898747794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-98439cc7-fe60-4ebe-b9f9-8cae6521e385 1073741824" returned: 0 in 1.759s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:35:05 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b2282f08-131c-4614-8fa4-32130af1c495 tempest-CreateVolumesFromImageTest-1898747794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-98439cc7-fe60-4ebe-b9f9-8cae6521e385 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:35:05 devstack sudo[108130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-98439cc7-fe60-4ebe-b9f9-8cae6521e385 Jun 29 03:35:05 devstack sudo[108130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:35:05 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-3c401177-991d-4228-96bf-95d300821957 tempest-GroupsV320Test-1288682539 None] Group tempest-GroupsV320Test-Group-2073092909: creating Jun 29 03:35:05 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-3c401177-991d-4228-96bf-95d300821957 tempest-GroupsV320Test-1288682539 None] Group tempest-GroupsV320Test-Group-2073092909: created successfully Jun 29 03:35:05 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-3c401177-991d-4228-96bf-95d300821957 tempest-GroupsV320Test-1288682539 None] Create group completed successfully. Jun 29 03:35:06 devstack sudo[108130]: pam_unix(sudo:session): session closed for user root Jun 29 03:35:06 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b2282f08-131c-4614-8fa4-32130af1c495 tempest-CreateVolumesFromImageTest-1898747794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-98439cc7-fe60-4ebe-b9f9-8cae6521e385" returned: 0 in 1.016s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:35:06 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-b2282f08-131c-4614-8fa4-32130af1c495 tempest-CreateVolumesFromImageTest-1898747794 None] <== create_volume: return (2855ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:35:06 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-b2282f08-131c-4614-8fa4-32130af1c495 tempest-CreateVolumesFromImageTest-1898747794 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.858s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:35:06 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-b1c4f02f-3c0b-4df4-b203-96a108b2614f tempest-CreateVolumesFromImageTest-1898747794 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.459s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:35:06 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-b1c4f02f-3c0b-4df4-b203-96a108b2614f tempest-CreateVolumesFromImageTest-1898747794 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:35:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-262719683',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ed27ab0-ef4e-4cb1-bb3e-ce1735ad5e61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f796fa5c8344d0da2da1f443dee5895',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:35:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:35:02Z,use_quota=True,user_id='a7734e160b794077b0d3215c7fe5a9cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:35:06 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-b1c4f02f-3c0b-4df4-b203-96a108b2614f tempest-CreateVolumesFromImageTest-1898747794 None] Creating volume 7ed27ab0-ef4e-4cb1-bb3e-ce1735ad5e61 {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:35:06 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-b1c4f02f-3c0b-4df4-b203-96a108b2614f tempest-CreateVolumesFromImageTest-1898747794 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:35:06 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-b1c4f02f-3c0b-4df4-b203-96a108b2614f tempest-CreateVolumesFromImageTest-1898747794 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:35:06 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-b1c4f02f-3c0b-4df4-b203-96a108b2614f tempest-CreateVolumesFromImageTest-1898747794 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:35:06 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-b1c4f02f-3c0b-4df4-b203-96a108b2614f tempest-CreateVolumesFromImageTest-1898747794 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:35:06 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-b1c4f02f-3c0b-4df4-b203-96a108b2614f tempest-CreateVolumesFromImageTest-1898747794 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:35:06 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-b1c4f02f-3c0b-4df4-b203-96a108b2614f tempest-CreateVolumesFromImageTest-1898747794 None] Selected osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:35:06 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-b1c4f02f-3c0b-4df4-b203-96a108b2614f tempest-CreateVolumesFromImageTest-1898747794 None] casted to osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f Jun 29 03:35:06 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b1c4f02f-3c0b-4df4-b203-96a108b2614f tempest-CreateVolumesFromImageTest-1898747794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-7ed27ab0-ef4e-4cb1-bb3e-ce1735ad5e61 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:35:06 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-b2282f08-131c-4614-8fa4-32130af1c495 tempest-CreateVolumesFromImageTest-1898747794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2863b84-05e0-4fb2-8424-dbcad8ead793) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-98439cc7-fe60-4ebe-b9f9-8cae6521e385', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:35:06 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-b2282f08-131c-4614-8fa4-32130af1c495 tempest-CreateVolumesFromImageTest-1898747794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff43d524-1d21-44c8-98f2-a33481dcf8c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:35:06 devstack sudo[108133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-7ed27ab0-ef4e-4cb1-bb3e-ce1735ad5e61 1073741824 Jun 29 03:35:06 devstack sudo[108133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:35:06 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-b2282f08-131c-4614-8fa4-32130af1c495 tempest-CreateVolumesFromImageTest-1898747794 None] Volume volume-98439cc7-fe60-4ebe-b9f9-8cae6521e385 (98439cc7-fe60-4ebe-b9f9-8cae6521e385): created successfully Jun 29 03:35:06 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-b2282f08-131c-4614-8fa4-32130af1c495 tempest-CreateVolumesFromImageTest-1898747794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff43d524-1d21-44c8-98f2-a33481dcf8c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:35:06 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-b2282f08-131c-4614-8fa4-32130af1c495 tempest-CreateVolumesFromImageTest-1898747794 None] Flow 'volume_create_manager' (12802604-5b27-422c-b4f5-4c48c1f49d66) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:35:06 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-b2282f08-131c-4614-8fa4-32130af1c495 tempest-CreateVolumesFromImageTest-1898747794 None] Created volume successfully. Jun 29 03:35:07 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-f1d8d57b-5d03-48f7-890b-d4688a8e2736 tempest-GroupsV320Test-1288682539 None] Created reservations ['69e9758e-7479-4ee6-b24c-3c6d429396ae'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:35:07 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-f1d8d57b-5d03-48f7-890b-d4688a8e2736 tempest-GroupsV320Test-1288682539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:35:07 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-f1d8d57b-5d03-48f7-890b-d4688a8e2736 tempest-GroupsV320Test-1288682539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:35:07 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-f1d8d57b-5d03-48f7-890b-d4688a8e2736 tempest-GroupsV320Test-1288682539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:35:07 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-f1d8d57b-5d03-48f7-890b-d4688a8e2736 tempest-GroupsV320Test-1288682539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:35:07 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-f1d8d57b-5d03-48f7-890b-d4688a8e2736 tempest-GroupsV320Test-1288682539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:35:07 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-f1d8d57b-5d03-48f7-890b-d4688a8e2736 tempest-GroupsV320Test-1288682539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:35:07 devstack sudo[108170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf Jun 29 03:35:07 devstack sudo[108170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:35:07 devstack sudo[108133]: pam_unix(sudo:session): session closed for user root Jun 29 03:35:07 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b1c4f02f-3c0b-4df4-b203-96a108b2614f tempest-CreateVolumesFromImageTest-1898747794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-7ed27ab0-ef4e-4cb1-bb3e-ce1735ad5e61 1073741824" returned: 0 in 1.300s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:35:07 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b1c4f02f-3c0b-4df4-b203-96a108b2614f tempest-CreateVolumesFromImageTest-1898747794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-7ed27ab0-ef4e-4cb1-bb3e-ce1735ad5e61 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:35:07 devstack sudo[108172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-7ed27ab0-ef4e-4cb1-bb3e-ce1735ad5e61 Jun 29 03:35:07 devstack sudo[108172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:35:08 devstack sudo[108170]: pam_unix(sudo:session): session closed for user root Jun 29 03:35:08 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-f1d8d57b-5d03-48f7-890b-d4688a8e2736 tempest-GroupsV320Test-1288682539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf" returned: 0 in 0.717s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:35:08 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-f1d8d57b-5d03-48f7-890b-d4688a8e2736 tempest-GroupsV320Test-1288682539 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:35:08 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-f1d8d57b-5d03-48f7-890b-d4688a8e2736 tempest-GroupsV320Test-1288682539 None] Delete group completed successfully. Jun 29 03:35:08 devstack sudo[108172]: pam_unix(sudo:session): session closed for user root Jun 29 03:35:08 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b1c4f02f-3c0b-4df4-b203-96a108b2614f tempest-CreateVolumesFromImageTest-1898747794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-7ed27ab0-ef4e-4cb1-bb3e-ce1735ad5e61" returned: 0 in 0.724s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:35:08 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-b1c4f02f-3c0b-4df4-b203-96a108b2614f tempest-CreateVolumesFromImageTest-1898747794 None] <== create_volume: return (2076ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:35:08 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-b1c4f02f-3c0b-4df4-b203-96a108b2614f tempest-CreateVolumesFromImageTest-1898747794 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.080s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:35:08 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-7cc240c2-346c-432f-baf5-194495e86cc7 tempest-CreateVolumesFromImageTest-1898747794 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.482s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:35:08 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-7cc240c2-346c-432f-baf5-194495e86cc7 tempest-CreateVolumesFromImageTest-1898747794 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:35:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-771305211',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b87376b-cfc5-4943-942f-157ad3d83b5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f796fa5c8344d0da2da1f443dee5895',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:35:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:35:03Z,use_quota=True,user_id='a7734e160b794077b0d3215c7fe5a9cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:35:08 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-7cc240c2-346c-432f-baf5-194495e86cc7 tempest-CreateVolumesFromImageTest-1898747794 None] Creating volume 1b87376b-cfc5-4943-942f-157ad3d83b5b {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:35:08 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-7cc240c2-346c-432f-baf5-194495e86cc7 tempest-CreateVolumesFromImageTest-1898747794 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:35:08 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-7cc240c2-346c-432f-baf5-194495e86cc7 tempest-CreateVolumesFromImageTest-1898747794 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:35:08 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-7cc240c2-346c-432f-baf5-194495e86cc7 tempest-CreateVolumesFromImageTest-1898747794 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:35:08 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-7cc240c2-346c-432f-baf5-194495e86cc7 tempest-CreateVolumesFromImageTest-1898747794 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:35:08 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-7cc240c2-346c-432f-baf5-194495e86cc7 tempest-CreateVolumesFromImageTest-1898747794 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:35:08 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-7cc240c2-346c-432f-baf5-194495e86cc7 tempest-CreateVolumesFromImageTest-1898747794 None] Selected osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:35:08 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-7cc240c2-346c-432f-baf5-194495e86cc7 tempest-CreateVolumesFromImageTest-1898747794 None] casted to osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f Jun 29 03:35:08 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-7cc240c2-346c-432f-baf5-194495e86cc7 tempest-CreateVolumesFromImageTest-1898747794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-1b87376b-cfc5-4943-942f-157ad3d83b5b 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:35:08 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-b1c4f02f-3c0b-4df4-b203-96a108b2614f tempest-CreateVolumesFromImageTest-1898747794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0394587-8862-4ddf-8347-7dbb33a9af5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ed27ab0-ef4e-4cb1-bb3e-ce1735ad5e61', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:35:08 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-b1c4f02f-3c0b-4df4-b203-96a108b2614f tempest-CreateVolumesFromImageTest-1898747794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01f57813-52c2-440c-ac40-a5074f2e3373) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:35:08 devstack sudo[108176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-1b87376b-cfc5-4943-942f-157ad3d83b5b 1073741824 Jun 29 03:35:08 devstack sudo[108176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:35:08 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-b1c4f02f-3c0b-4df4-b203-96a108b2614f tempest-CreateVolumesFromImageTest-1898747794 None] Volume volume-7ed27ab0-ef4e-4cb1-bb3e-ce1735ad5e61 (7ed27ab0-ef4e-4cb1-bb3e-ce1735ad5e61): created successfully Jun 29 03:35:08 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-b1c4f02f-3c0b-4df4-b203-96a108b2614f tempest-CreateVolumesFromImageTest-1898747794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01f57813-52c2-440c-ac40-a5074f2e3373) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:35:08 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-b1c4f02f-3c0b-4df4-b203-96a108b2614f tempest-CreateVolumesFromImageTest-1898747794 None] Flow 'volume_create_manager' (75ca3d84-6efd-4fd7-8358-52c6f64652cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:35:08 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-b1c4f02f-3c0b-4df4-b203-96a108b2614f tempest-CreateVolumesFromImageTest-1898747794 None] Created volume successfully. Jun 29 03:35:09 devstack sudo[108176]: pam_unix(sudo:session): session closed for user root Jun 29 03:35:09 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-7cc240c2-346c-432f-baf5-194495e86cc7 tempest-CreateVolumesFromImageTest-1898747794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-1b87376b-cfc5-4943-942f-157ad3d83b5b 1073741824" returned: 0 in 1.060s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:35:09 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-7cc240c2-346c-432f-baf5-194495e86cc7 tempest-CreateVolumesFromImageTest-1898747794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-1b87376b-cfc5-4943-942f-157ad3d83b5b {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:35:09 devstack sudo[108182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-1b87376b-cfc5-4943-942f-157ad3d83b5b Jun 29 03:35:09 devstack sudo[108182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:35:10 devstack sudo[108182]: pam_unix(sudo:session): session closed for user root Jun 29 03:35:10 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-7cc240c2-346c-432f-baf5-194495e86cc7 tempest-CreateVolumesFromImageTest-1898747794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-1b87376b-cfc5-4943-942f-157ad3d83b5b" returned: 0 in 0.872s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:35:10 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-7cc240c2-346c-432f-baf5-194495e86cc7 tempest-CreateVolumesFromImageTest-1898747794 None] <== create_volume: return (2010ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:35:10 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-7cc240c2-346c-432f-baf5-194495e86cc7 tempest-CreateVolumesFromImageTest-1898747794 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.014s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:35:10 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-f2e37959-fdfb-4393-a20f-38669bb42207 tempest-CreateVolumesFromImageTest-1898747794 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.104s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:35:10 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-f2e37959-fdfb-4393-a20f-38669bb42207 tempest-CreateVolumesFromImageTest-1898747794 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:35:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1952576170',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c08955b9-6508-41d9-ae36-a864cfccfe9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f796fa5c8344d0da2da1f443dee5895',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:35:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:35:03Z,use_quota=True,user_id='a7734e160b794077b0d3215c7fe5a9cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:35:10 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-f2e37959-fdfb-4393-a20f-38669bb42207 tempest-CreateVolumesFromImageTest-1898747794 None] Creating volume c08955b9-6508-41d9-ae36-a864cfccfe9a {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:35:10 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-f2e37959-fdfb-4393-a20f-38669bb42207 tempest-CreateVolumesFromImageTest-1898747794 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:35:10 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-f2e37959-fdfb-4393-a20f-38669bb42207 tempest-CreateVolumesFromImageTest-1898747794 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:35:10 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-f2e37959-fdfb-4393-a20f-38669bb42207 tempest-CreateVolumesFromImageTest-1898747794 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:35:10 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-f2e37959-fdfb-4393-a20f-38669bb42207 tempest-CreateVolumesFromImageTest-1898747794 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:35:10 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-f2e37959-fdfb-4393-a20f-38669bb42207 tempest-CreateVolumesFromImageTest-1898747794 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:35:10 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-f2e37959-fdfb-4393-a20f-38669bb42207 tempest-CreateVolumesFromImageTest-1898747794 None] Selected osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:35:10 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-f2e37959-fdfb-4393-a20f-38669bb42207 tempest-CreateVolumesFromImageTest-1898747794 None] casted to osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f Jun 29 03:35:10 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-f2e37959-fdfb-4393-a20f-38669bb42207 tempest-CreateVolumesFromImageTest-1898747794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-c08955b9-6508-41d9-ae36-a864cfccfe9a 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:35:10 devstack sudo[108186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-c08955b9-6508-41d9-ae36-a864cfccfe9a 1073741824 Jun 29 03:35:10 devstack sudo[108186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:35:10 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-7cc240c2-346c-432f-baf5-194495e86cc7 tempest-CreateVolumesFromImageTest-1898747794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5fe63ef-4c93-4cd9-8434-c3d6227818b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b87376b-cfc5-4943-942f-157ad3d83b5b', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:35:10 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-7cc240c2-346c-432f-baf5-194495e86cc7 tempest-CreateVolumesFromImageTest-1898747794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db9cfb53-ac53-40c8-8b5c-cf11bea5e638) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:35:10 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-7cc240c2-346c-432f-baf5-194495e86cc7 tempest-CreateVolumesFromImageTest-1898747794 None] Volume volume-1b87376b-cfc5-4943-942f-157ad3d83b5b (1b87376b-cfc5-4943-942f-157ad3d83b5b): created successfully Jun 29 03:35:10 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-7cc240c2-346c-432f-baf5-194495e86cc7 tempest-CreateVolumesFromImageTest-1898747794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db9cfb53-ac53-40c8-8b5c-cf11bea5e638) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:35:10 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-7cc240c2-346c-432f-baf5-194495e86cc7 tempest-CreateVolumesFromImageTest-1898747794 None] Flow 'volume_create_manager' (36155d40-a472-4853-ab9b-d8eb4aa16b2d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:35:10 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-7cc240c2-346c-432f-baf5-194495e86cc7 tempest-CreateVolumesFromImageTest-1898747794 None] Created volume successfully. Jun 29 03:35:11 devstack sudo[108186]: pam_unix(sudo:session): session closed for user root Jun 29 03:35:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-f2e37959-fdfb-4393-a20f-38669bb42207 tempest-CreateVolumesFromImageTest-1898747794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-c08955b9-6508-41d9-ae36-a864cfccfe9a 1073741824" returned: 0 in 1.150s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:35:11 devstack cinder-volume[93468]: DEBUG oslo_service.periodic_task [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93468) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 29 03:35:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:35:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:35:11 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:35:11 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:35:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:35:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:35:11 devstack sudo[108194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf Jun 29 03:35:11 devstack sudo[108194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:35:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-f2e37959-fdfb-4393-a20f-38669bb42207 tempest-CreateVolumesFromImageTest-1898747794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-c08955b9-6508-41d9-ae36-a864cfccfe9a {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:35:11 devstack sudo[108202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-c08955b9-6508-41d9-ae36-a864cfccfe9a Jun 29 03:35:11 devstack sudo[108202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:35:12 devstack sudo[108194]: pam_unix(sudo:session): session closed for user root Jun 29 03:35:12 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf" returned: 0 in 1.102s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:35:12 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:35:12 devstack cinder-volume[93468]: DEBUG oslo_service.periodic_task [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Running periodic task VolumeManager._thread_info {{(pid=93468) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 29 03:35:12 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] thread count: 28 {{(pid=93468) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 29 03:35:12 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] thread info: [<_MainThread(MainThread, started 132331377287296)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93468) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 29 03:35:13 devstack sudo[108202]: pam_unix(sudo:session): session closed for user root Jun 29 03:35:13 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-f2e37959-fdfb-4393-a20f-38669bb42207 tempest-CreateVolumesFromImageTest-1898747794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-c08955b9-6508-41d9-ae36-a864cfccfe9a" returned: 0 in 1.090s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:35:13 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-f2e37959-fdfb-4393-a20f-38669bb42207 tempest-CreateVolumesFromImageTest-1898747794 None] <== create_volume: return (2344ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:35:13 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-f2e37959-fdfb-4393-a20f-38669bb42207 tempest-CreateVolumesFromImageTest-1898747794 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.348s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:35:13 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-f2e37959-fdfb-4393-a20f-38669bb42207 tempest-CreateVolumesFromImageTest-1898747794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84d88b7e-cdea-40c2-a2ad-dc5188205a9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c08955b9-6508-41d9-ae36-a864cfccfe9a', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:35:13 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-f2e37959-fdfb-4393-a20f-38669bb42207 tempest-CreateVolumesFromImageTest-1898747794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae5fa6b4-7de5-493d-829f-685cb3751815) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:35:13 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-f2e37959-fdfb-4393-a20f-38669bb42207 tempest-CreateVolumesFromImageTest-1898747794 None] Volume volume-c08955b9-6508-41d9-ae36-a864cfccfe9a (c08955b9-6508-41d9-ae36-a864cfccfe9a): created successfully Jun 29 03:35:13 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-f2e37959-fdfb-4393-a20f-38669bb42207 tempest-CreateVolumesFromImageTest-1898747794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae5fa6b4-7de5-493d-829f-685cb3751815) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:35:13 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-f2e37959-fdfb-4393-a20f-38669bb42207 tempest-CreateVolumesFromImageTest-1898747794 None] Flow 'volume_create_manager' (e758dce1-fb75-4cb1-8dd8-2cac36d4d0c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:35:13 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-f2e37959-fdfb-4393-a20f-38669bb42207 tempest-CreateVolumesFromImageTest-1898747794 None] Created volume successfully. Jun 29 03:35:13 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-f7a25665-c146-4149-a0a3-9df10452339c tempest-CreateVolumesFromImageTest-1898747794 None] Acquiring lock "cinder-c08955b9-6508-41d9-ae36-a864cfccfe9a-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:35:13 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-f7a25665-c146-4149-a0a3-9df10452339c tempest-CreateVolumesFromImageTest-1898747794 None] Lock "cinder-c08955b9-6508-41d9-ae36-a864cfccfe9a-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:35:13 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-f7a25665-c146-4149-a0a3-9df10452339c tempest-CreateVolumesFromImageTest-1898747794 None] Acquiring lock "cinder-quobyte-c08955b9-6508-41d9-ae36-a864cfccfe9a" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:35:13 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-f7a25665-c146-4149-a0a3-9df10452339c tempest-CreateVolumesFromImageTest-1898747794 None] Lock "cinder-quobyte-c08955b9-6508-41d9-ae36-a864cfccfe9a" acquired by "delete_volume" :: waited 0.026s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:35:13 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7f33ca1-6ff1-44ef-bd59-a8a31f742c61]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:35:13 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-f7a25665-c146-4149-a0a3-9df10452339c tempest-CreateVolumesFromImageTest-1898747794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-c08955b9-6508-41d9-ae36-a864cfccfe9a {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:35:13 devstack sudo[108210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-c08955b9-6508-41d9-ae36-a864cfccfe9a Jun 29 03:35:13 devstack sudo[108210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:35:14 devstack sudo[108210]: pam_unix(sudo:session): session closed for user root Jun 29 03:35:14 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-f7a25665-c146-4149-a0a3-9df10452339c tempest-CreateVolumesFromImageTest-1898747794 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-c08955b9-6508-41d9-ae36-a864cfccfe9a" returned: 0 in 0.902s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:35:14 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-f7a25665-c146-4149-a0a3-9df10452339c tempest-CreateVolumesFromImageTest-1898747794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-c08955b9-6508-41d9-ae36-a864cfccfe9a {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:35:14 devstack sudo[108216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-c08955b9-6508-41d9-ae36-a864cfccfe9a Jun 29 03:35:14 devstack sudo[108216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:35:15 devstack sudo[108216]: pam_unix(sudo:session): session closed for user root Jun 29 03:35:15 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-f7a25665-c146-4149-a0a3-9df10452339c tempest-CreateVolumesFromImageTest-1898747794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-c08955b9-6508-41d9-ae36-a864cfccfe9a" returned: 0 in 0.820s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:35:15 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-f7a25665-c146-4149-a0a3-9df10452339c tempest-CreateVolumesFromImageTest-1898747794 None] Lock "cinder-quobyte-c08955b9-6508-41d9-ae36-a864cfccfe9a" released by "delete_volume" :: held 1.781s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:35:15 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-f7a25665-c146-4149-a0a3-9df10452339c tempest-CreateVolumesFromImageTest-1898747794 None] Created reservations ['f8a7e6ee-4247-4ed9-b1cd-440a3e7ee4fc', '8614a2e6-be4f-494a-83a2-05eb8bf2b7b9', '7bc9c51a-cdbf-495f-abff-8318d36932d9', '1de887fc-ea2a-462d-a92b-f5b3b23a4feb'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:35:15 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-f7a25665-c146-4149-a0a3-9df10452339c tempest-CreateVolumesFromImageTest-1898747794 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:35:15 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-f7a25665-c146-4149-a0a3-9df10452339c tempest-CreateVolumesFromImageTest-1898747794 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:35:15 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-f7a25665-c146-4149-a0a3-9df10452339c tempest-CreateVolumesFromImageTest-1898747794 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:35:15 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-f7a25665-c146-4149-a0a3-9df10452339c tempest-CreateVolumesFromImageTest-1898747794 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:35:15 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-f7a25665-c146-4149-a0a3-9df10452339c tempest-CreateVolumesFromImageTest-1898747794 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:35:15 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-f7a25665-c146-4149-a0a3-9df10452339c tempest-CreateVolumesFromImageTest-1898747794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:35:15 devstack sudo[108222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf Jun 29 03:35:15 devstack sudo[108222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:35:15 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-cad44350-c512-4733-a35a-7359a835ff61 tempest-CreateVolumesFromImageTest-1898747794 None] Acquiring lock "cinder-1b87376b-cfc5-4943-942f-157ad3d83b5b-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:35:15 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-cad44350-c512-4733-a35a-7359a835ff61 tempest-CreateVolumesFromImageTest-1898747794 None] Lock "cinder-1b87376b-cfc5-4943-942f-157ad3d83b5b-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:35:15 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-cad44350-c512-4733-a35a-7359a835ff61 tempest-CreateVolumesFromImageTest-1898747794 None] Acquiring lock "cinder-quobyte-1b87376b-cfc5-4943-942f-157ad3d83b5b" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:35:15 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-cad44350-c512-4733-a35a-7359a835ff61 tempest-CreateVolumesFromImageTest-1898747794 None] Lock "cinder-quobyte-1b87376b-cfc5-4943-942f-157ad3d83b5b" acquired by "delete_volume" :: waited 0.020s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:35:15 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a015dae-5936-4b48-a389-eb0f07ced663]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:35:15 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-cad44350-c512-4733-a35a-7359a835ff61 tempest-CreateVolumesFromImageTest-1898747794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-1b87376b-cfc5-4943-942f-157ad3d83b5b {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:35:16 devstack sudo[108224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-1b87376b-cfc5-4943-942f-157ad3d83b5b Jun 29 03:35:16 devstack sudo[108224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:35:16 devstack sudo[108222]: pam_unix(sudo:session): session closed for user root Jun 29 03:35:16 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-f7a25665-c146-4149-a0a3-9df10452339c tempest-CreateVolumesFromImageTest-1898747794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf" returned: 0 in 1.214s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:35:16 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-f7a25665-c146-4149-a0a3-9df10452339c tempest-CreateVolumesFromImageTest-1898747794 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:35:16 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-f7a25665-c146-4149-a0a3-9df10452339c tempest-CreateVolumesFromImageTest-1898747794 None] Deleted volume successfully. Jun 29 03:35:16 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-f7a25665-c146-4149-a0a3-9df10452339c tempest-CreateVolumesFromImageTest-1898747794 None] Lock "cinder-c08955b9-6508-41d9-ae36-a864cfccfe9a-delete_volume" released by "delete_volume" :: held 3.331s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:35:17 devstack sudo[108224]: pam_unix(sudo:session): session closed for user root Jun 29 03:35:17 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-cad44350-c512-4733-a35a-7359a835ff61 tempest-CreateVolumesFromImageTest-1898747794 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-1b87376b-cfc5-4943-942f-157ad3d83b5b" returned: 0 in 1.170s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:35:17 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-cad44350-c512-4733-a35a-7359a835ff61 tempest-CreateVolumesFromImageTest-1898747794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-1b87376b-cfc5-4943-942f-157ad3d83b5b {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:35:17 devstack sudo[108232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-1b87376b-cfc5-4943-942f-157ad3d83b5b Jun 29 03:35:17 devstack sudo[108232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:35:17 devstack sudo[108232]: pam_unix(sudo:session): session closed for user root Jun 29 03:35:17 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-cad44350-c512-4733-a35a-7359a835ff61 tempest-CreateVolumesFromImageTest-1898747794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-1b87376b-cfc5-4943-942f-157ad3d83b5b" returned: 0 in 0.808s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:35:17 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-cad44350-c512-4733-a35a-7359a835ff61 tempest-CreateVolumesFromImageTest-1898747794 None] Lock "cinder-quobyte-1b87376b-cfc5-4943-942f-157ad3d83b5b" released by "delete_volume" :: held 2.055s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:35:17 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-cad44350-c512-4733-a35a-7359a835ff61 tempest-CreateVolumesFromImageTest-1898747794 None] Created reservations ['813fc6e5-5b59-4806-857d-fc45d706e0a2', 'd729a7fa-3925-4f41-8d05-8f2c27022498', '7aaeb2e6-4b9a-4b71-ade3-adf01d4f1e8c', '3f777725-cbe1-4050-a6ba-3bf3ddb0a69c'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:35:18 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-cad44350-c512-4733-a35a-7359a835ff61 tempest-CreateVolumesFromImageTest-1898747794 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:35:18 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-cad44350-c512-4733-a35a-7359a835ff61 tempest-CreateVolumesFromImageTest-1898747794 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:35:18 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-cad44350-c512-4733-a35a-7359a835ff61 tempest-CreateVolumesFromImageTest-1898747794 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:35:18 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-cad44350-c512-4733-a35a-7359a835ff61 tempest-CreateVolumesFromImageTest-1898747794 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:35:18 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-cad44350-c512-4733-a35a-7359a835ff61 tempest-CreateVolumesFromImageTest-1898747794 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:35:18 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-cad44350-c512-4733-a35a-7359a835ff61 tempest-CreateVolumesFromImageTest-1898747794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:35:18 devstack sudo[108237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf Jun 29 03:35:18 devstack sudo[108237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:35:18 devstack sudo[108237]: pam_unix(sudo:session): session closed for user root Jun 29 03:35:18 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-cad44350-c512-4733-a35a-7359a835ff61 tempest-CreateVolumesFromImageTest-1898747794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf" returned: 0 in 0.719s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:35:18 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-cad44350-c512-4733-a35a-7359a835ff61 tempest-CreateVolumesFromImageTest-1898747794 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:35:18 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-cad44350-c512-4733-a35a-7359a835ff61 tempest-CreateVolumesFromImageTest-1898747794 None] Deleted volume successfully. Jun 29 03:35:18 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-cad44350-c512-4733-a35a-7359a835ff61 tempest-CreateVolumesFromImageTest-1898747794 None] Lock "cinder-1b87376b-cfc5-4943-942f-157ad3d83b5b-delete_volume" released by "delete_volume" :: held 3.122s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:35:19 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-c575ca1a-1996-4cc9-840a-6c4a52531e67 tempest-CreateVolumesFromImageTest-1898747794 None] Acquiring lock "cinder-7ed27ab0-ef4e-4cb1-bb3e-ce1735ad5e61-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:35:19 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-c575ca1a-1996-4cc9-840a-6c4a52531e67 tempest-CreateVolumesFromImageTest-1898747794 None] Lock "cinder-7ed27ab0-ef4e-4cb1-bb3e-ce1735ad5e61-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:35:19 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-c575ca1a-1996-4cc9-840a-6c4a52531e67 tempest-CreateVolumesFromImageTest-1898747794 None] Acquiring lock "cinder-quobyte-7ed27ab0-ef4e-4cb1-bb3e-ce1735ad5e61" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:35:19 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-c575ca1a-1996-4cc9-840a-6c4a52531e67 tempest-CreateVolumesFromImageTest-1898747794 None] Lock "cinder-quobyte-7ed27ab0-ef4e-4cb1-bb3e-ce1735ad5e61" acquired by "delete_volume" :: waited 0.016s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:35:19 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[73aee81f-f5cc-411d-86bc-8c79d1435d70]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:35:19 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c575ca1a-1996-4cc9-840a-6c4a52531e67 tempest-CreateVolumesFromImageTest-1898747794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-7ed27ab0-ef4e-4cb1-bb3e-ce1735ad5e61 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:35:19 devstack sudo[108243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-7ed27ab0-ef4e-4cb1-bb3e-ce1735ad5e61 Jun 29 03:35:19 devstack sudo[108243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:35:20 devstack sudo[108243]: pam_unix(sudo:session): session closed for user root Jun 29 03:35:20 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c575ca1a-1996-4cc9-840a-6c4a52531e67 tempest-CreateVolumesFromImageTest-1898747794 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-7ed27ab0-ef4e-4cb1-bb3e-ce1735ad5e61" returned: 0 in 0.921s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:35:20 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c575ca1a-1996-4cc9-840a-6c4a52531e67 tempest-CreateVolumesFromImageTest-1898747794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-7ed27ab0-ef4e-4cb1-bb3e-ce1735ad5e61 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:35:20 devstack sudo[108248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-7ed27ab0-ef4e-4cb1-bb3e-ce1735ad5e61 Jun 29 03:35:20 devstack sudo[108248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:35:21 devstack sudo[108248]: pam_unix(sudo:session): session closed for user root Jun 29 03:35:21 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c575ca1a-1996-4cc9-840a-6c4a52531e67 tempest-CreateVolumesFromImageTest-1898747794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-7ed27ab0-ef4e-4cb1-bb3e-ce1735ad5e61" returned: 0 in 0.904s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:35:21 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-c575ca1a-1996-4cc9-840a-6c4a52531e67 tempest-CreateVolumesFromImageTest-1898747794 None] Lock "cinder-quobyte-7ed27ab0-ef4e-4cb1-bb3e-ce1735ad5e61" released by "delete_volume" :: held 1.891s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:35:21 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-c575ca1a-1996-4cc9-840a-6c4a52531e67 tempest-CreateVolumesFromImageTest-1898747794 None] Created reservations ['3a4fe86b-0d50-474f-9066-47c85962d700', '08548cb2-17b6-47a6-badc-55ea85569ce7', '0b7da68a-5bb9-4901-8209-e7122ce60244', '2747b317-119d-4bb4-a07c-e94d6be820f3'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:35:21 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-c575ca1a-1996-4cc9-840a-6c4a52531e67 tempest-CreateVolumesFromImageTest-1898747794 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:35:21 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-c575ca1a-1996-4cc9-840a-6c4a52531e67 tempest-CreateVolumesFromImageTest-1898747794 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:35:21 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-c575ca1a-1996-4cc9-840a-6c4a52531e67 tempest-CreateVolumesFromImageTest-1898747794 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:35:21 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-c575ca1a-1996-4cc9-840a-6c4a52531e67 tempest-CreateVolumesFromImageTest-1898747794 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:35:21 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-c575ca1a-1996-4cc9-840a-6c4a52531e67 tempest-CreateVolumesFromImageTest-1898747794 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:35:21 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c575ca1a-1996-4cc9-840a-6c4a52531e67 tempest-CreateVolumesFromImageTest-1898747794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:35:21 devstack sudo[108251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf Jun 29 03:35:21 devstack sudo[108251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:35:21 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-f5fa2e04-312c-4c58-8e54-538f36dd3138 tempest-CreateVolumesFromImageTest-1898747794 None] Acquiring lock "cinder-98439cc7-fe60-4ebe-b9f9-8cae6521e385-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:35:21 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-f5fa2e04-312c-4c58-8e54-538f36dd3138 tempest-CreateVolumesFromImageTest-1898747794 None] Lock "cinder-98439cc7-fe60-4ebe-b9f9-8cae6521e385-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:35:21 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-f5fa2e04-312c-4c58-8e54-538f36dd3138 tempest-CreateVolumesFromImageTest-1898747794 None] Acquiring lock "cinder-quobyte-98439cc7-fe60-4ebe-b9f9-8cae6521e385" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:35:21 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-f5fa2e04-312c-4c58-8e54-538f36dd3138 tempest-CreateVolumesFromImageTest-1898747794 None] Lock "cinder-quobyte-98439cc7-fe60-4ebe-b9f9-8cae6521e385" acquired by "delete_volume" :: waited 0.034s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:35:21 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[2253cab7-6b67-42c3-a68d-6f4104797977]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:35:21 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-f5fa2e04-312c-4c58-8e54-538f36dd3138 tempest-CreateVolumesFromImageTest-1898747794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-98439cc7-fe60-4ebe-b9f9-8cae6521e385 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:35:21 devstack sudo[108254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-98439cc7-fe60-4ebe-b9f9-8cae6521e385 Jun 29 03:35:21 devstack sudo[108254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:35:22 devstack sudo[108251]: pam_unix(sudo:session): session closed for user root Jun 29 03:35:22 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c575ca1a-1996-4cc9-840a-6c4a52531e67 tempest-CreateVolumesFromImageTest-1898747794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf" returned: 0 in 1.017s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:35:22 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-c575ca1a-1996-4cc9-840a-6c4a52531e67 tempest-CreateVolumesFromImageTest-1898747794 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:35:22 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-c575ca1a-1996-4cc9-840a-6c4a52531e67 tempest-CreateVolumesFromImageTest-1898747794 None] Deleted volume successfully. Jun 29 03:35:22 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [req-2487fc8e-af0f-4d02-9521-5961eb123bcc req-d79e38a0-6644-4d25-a2aa-6973c2381bab tempest-TestServerVolumeAttachmentScenario-226006195 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:35:22 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [req-2487fc8e-af0f-4d02-9521-5961eb123bcc req-d79e38a0-6644-4d25-a2aa-6973c2381bab tempest-TestServerVolumeAttachmentScenario-226006195 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:35:22 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-c575ca1a-1996-4cc9-840a-6c4a52531e67 tempest-CreateVolumesFromImageTest-1898747794 None] Lock "cinder-7ed27ab0-ef4e-4cb1-bb3e-ce1735ad5e61-delete_volume" released by "delete_volume" :: held 3.274s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:35:22 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[5acb2d78-673a-4200-ac63-b39aee28b751]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:35:22 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [req-2487fc8e-af0f-4d02-9521-5961eb123bcc req-d79e38a0-6644-4d25-a2aa-6973c2381bab tempest-TestServerVolumeAttachmentScenario-226006195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-0b36bdc7-f9a1-482b-9c27-f362183e0d66 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:35:22 devstack sudo[108271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-0b36bdc7-f9a1-482b-9c27-f362183e0d66 Jun 29 03:35:22 devstack sudo[108271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:35:22 devstack sudo[108254]: pam_unix(sudo:session): session closed for user root Jun 29 03:35:22 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-f5fa2e04-312c-4c58-8e54-538f36dd3138 tempest-CreateVolumesFromImageTest-1898747794 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-98439cc7-fe60-4ebe-b9f9-8cae6521e385" returned: 0 in 1.228s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:35:22 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-f5fa2e04-312c-4c58-8e54-538f36dd3138 tempest-CreateVolumesFromImageTest-1898747794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-98439cc7-fe60-4ebe-b9f9-8cae6521e385 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:35:22 devstack sudo[108280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-98439cc7-fe60-4ebe-b9f9-8cae6521e385 Jun 29 03:35:22 devstack sudo[108280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:35:23 devstack sudo[108271]: pam_unix(sudo:session): session closed for user root Jun 29 03:35:23 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [req-2487fc8e-af0f-4d02-9521-5961eb123bcc req-d79e38a0-6644-4d25-a2aa-6973c2381bab tempest-TestServerVolumeAttachmentScenario-226006195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-0b36bdc7-f9a1-482b-9c27-f362183e0d66" returned: 0 in 1.118s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:35:23 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [req-2487fc8e-af0f-4d02-9521-5961eb123bcc req-d79e38a0-6644-4d25-a2aa-6973c2381bab tempest-TestServerVolumeAttachmentScenario-226006195 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.159s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:35:23 devstack sudo[108280]: pam_unix(sudo:session): session closed for user root Jun 29 03:35:23 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-f5fa2e04-312c-4c58-8e54-538f36dd3138 tempest-CreateVolumesFromImageTest-1898747794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-98439cc7-fe60-4ebe-b9f9-8cae6521e385" returned: 0 in 0.816s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:35:23 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-f5fa2e04-312c-4c58-8e54-538f36dd3138 tempest-CreateVolumesFromImageTest-1898747794 None] Lock "cinder-quobyte-98439cc7-fe60-4ebe-b9f9-8cae6521e385" released by "delete_volume" :: held 2.098s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:35:23 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [req-2487fc8e-af0f-4d02-9521-5961eb123bcc req-d79e38a0-6644-4d25-a2aa-6973c2381bab tempest-TestServerVolumeAttachmentScenario-226006195 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f', 'name': 'volume-0b36bdc7-f9a1-482b-9c27-f362183e0d66', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ac9f0f79-9aa9-4411-9954-4ea0fbb2256a', 'enforce_multipath': True} {{(pid=93468) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 29 03:35:23 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-f5fa2e04-312c-4c58-8e54-538f36dd3138 tempest-CreateVolumesFromImageTest-1898747794 None] Created reservations ['d6451b9d-e58d-4c52-9890-ed4f71a5a463', '22bc2435-6589-4469-a698-5819ecfbd8ab', 'efa54657-79bb-4b7e-b9ec-df8d651725b6', '06f7fddb-2032-4c6b-b0f1-f1433d7cbaae'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:35:23 devstack cinder-volume[93468]: INFO cinder.volume.manager [req-2487fc8e-af0f-4d02-9521-5961eb123bcc req-d79e38a0-6644-4d25-a2aa-6973c2381bab tempest-TestServerVolumeAttachmentScenario-226006195 None] attachment_update completed successfully. Jun 29 03:35:23 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-f5fa2e04-312c-4c58-8e54-538f36dd3138 tempest-CreateVolumesFromImageTest-1898747794 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:35:23 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-f5fa2e04-312c-4c58-8e54-538f36dd3138 tempest-CreateVolumesFromImageTest-1898747794 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:35:23 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-f5fa2e04-312c-4c58-8e54-538f36dd3138 tempest-CreateVolumesFromImageTest-1898747794 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:35:23 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-f5fa2e04-312c-4c58-8e54-538f36dd3138 tempest-CreateVolumesFromImageTest-1898747794 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:35:23 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-f5fa2e04-312c-4c58-8e54-538f36dd3138 tempest-CreateVolumesFromImageTest-1898747794 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:35:23 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-f5fa2e04-312c-4c58-8e54-538f36dd3138 tempest-CreateVolumesFromImageTest-1898747794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:35:23 devstack sudo[108293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf Jun 29 03:35:23 devstack sudo[108293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:35:24 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-c02c3dd4-634f-4828-8c57-08a5456c6ff6 tempest-CreateVolumesFromImageTest-1898747794 None] Acquiring lock "cinder-57e5927c-ad60-4e2a-8642-42c2bb732828-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:35:24 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-c02c3dd4-634f-4828-8c57-08a5456c6ff6 tempest-CreateVolumesFromImageTest-1898747794 None] Lock "cinder-57e5927c-ad60-4e2a-8642-42c2bb732828-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:35:24 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-c02c3dd4-634f-4828-8c57-08a5456c6ff6 tempest-CreateVolumesFromImageTest-1898747794 None] Acquiring lock "cinder-quobyte-57e5927c-ad60-4e2a-8642-42c2bb732828" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:35:24 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-c02c3dd4-634f-4828-8c57-08a5456c6ff6 tempest-CreateVolumesFromImageTest-1898747794 None] Lock "cinder-quobyte-57e5927c-ad60-4e2a-8642-42c2bb732828" acquired by "delete_volume" :: waited 0.052s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:35:24 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[022cd85d-7cf2-4d6a-b476-b2bcef9f093e]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:35:24 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c02c3dd4-634f-4828-8c57-08a5456c6ff6 tempest-CreateVolumesFromImageTest-1898747794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-57e5927c-ad60-4e2a-8642-42c2bb732828 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:35:24 devstack sudo[108362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-57e5927c-ad60-4e2a-8642-42c2bb732828 Jun 29 03:35:24 devstack sudo[108362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:35:24 devstack sudo[108293]: pam_unix(sudo:session): session closed for user root Jun 29 03:35:24 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-f5fa2e04-312c-4c58-8e54-538f36dd3138 tempest-CreateVolumesFromImageTest-1898747794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf" returned: 0 in 0.914s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:35:24 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-f5fa2e04-312c-4c58-8e54-538f36dd3138 tempest-CreateVolumesFromImageTest-1898747794 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:35:24 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-f5fa2e04-312c-4c58-8e54-538f36dd3138 tempest-CreateVolumesFromImageTest-1898747794 None] Deleted volume successfully. Jun 29 03:35:24 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-f5fa2e04-312c-4c58-8e54-538f36dd3138 tempest-CreateVolumesFromImageTest-1898747794 None] Lock "cinder-98439cc7-fe60-4ebe-b9f9-8cae6521e385-delete_volume" released by "delete_volume" :: held 3.344s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:35:25 devstack sudo[108362]: pam_unix(sudo:session): session closed for user root Jun 29 03:35:25 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c02c3dd4-634f-4828-8c57-08a5456c6ff6 tempest-CreateVolumesFromImageTest-1898747794 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-57e5927c-ad60-4e2a-8642-42c2bb732828" returned: 0 in 1.017s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:35:25 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c02c3dd4-634f-4828-8c57-08a5456c6ff6 tempest-CreateVolumesFromImageTest-1898747794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-57e5927c-ad60-4e2a-8642-42c2bb732828 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:35:25 devstack sudo[108689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-57e5927c-ad60-4e2a-8642-42c2bb732828 Jun 29 03:35:25 devstack sudo[108689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:35:26 devstack sudo[108689]: pam_unix(sudo:session): session closed for user root Jun 29 03:35:26 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c02c3dd4-634f-4828-8c57-08a5456c6ff6 tempest-CreateVolumesFromImageTest-1898747794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-57e5927c-ad60-4e2a-8642-42c2bb732828" returned: 0 in 0.762s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:35:26 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-c02c3dd4-634f-4828-8c57-08a5456c6ff6 tempest-CreateVolumesFromImageTest-1898747794 None] Lock "cinder-quobyte-57e5927c-ad60-4e2a-8642-42c2bb732828" released by "delete_volume" :: held 1.841s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:35:26 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-c02c3dd4-634f-4828-8c57-08a5456c6ff6 tempest-CreateVolumesFromImageTest-1898747794 None] Created reservations ['16d5dc06-cc59-4e71-a2e9-aa8fcc3523a2', 'adf0a646-35a7-4016-b696-50cf4475f75d', '6d97c5f5-5076-497e-b23b-b85132eabfb4', '470ee0c4-573a-45a2-83fd-66b6b507ac40'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:35:26 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-c02c3dd4-634f-4828-8c57-08a5456c6ff6 tempest-CreateVolumesFromImageTest-1898747794 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:35:26 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-c02c3dd4-634f-4828-8c57-08a5456c6ff6 tempest-CreateVolumesFromImageTest-1898747794 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:35:26 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-c02c3dd4-634f-4828-8c57-08a5456c6ff6 tempest-CreateVolumesFromImageTest-1898747794 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:35:26 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-c02c3dd4-634f-4828-8c57-08a5456c6ff6 tempest-CreateVolumesFromImageTest-1898747794 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:35:26 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-c02c3dd4-634f-4828-8c57-08a5456c6ff6 tempest-CreateVolumesFromImageTest-1898747794 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:35:26 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c02c3dd4-634f-4828-8c57-08a5456c6ff6 tempest-CreateVolumesFromImageTest-1898747794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:35:26 devstack sudo[108698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf Jun 29 03:35:26 devstack sudo[108698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:35:26 devstack sudo[108698]: pam_unix(sudo:session): session closed for user root Jun 29 03:35:26 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c02c3dd4-634f-4828-8c57-08a5456c6ff6 tempest-CreateVolumesFromImageTest-1898747794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf" returned: 0 in 0.762s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:35:26 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-c02c3dd4-634f-4828-8c57-08a5456c6ff6 tempest-CreateVolumesFromImageTest-1898747794 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:35:26 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-c02c3dd4-634f-4828-8c57-08a5456c6ff6 tempest-CreateVolumesFromImageTest-1898747794 None] Deleted volume successfully. Jun 29 03:35:27 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-c02c3dd4-634f-4828-8c57-08a5456c6ff6 tempest-CreateVolumesFromImageTest-1898747794 None] Lock "cinder-57e5927c-ad60-4e2a-8642-42c2bb732828-delete_volume" released by "delete_volume" :: held 2.961s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:35:32 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-560b6c6b-b992-4feb-9155-35ac67fe3bd8 tempest-CreateVolumesFromSnapshotTest-327247759 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:35:32 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-560b6c6b-b992-4feb-9155-35ac67fe3bd8 tempest-CreateVolumesFromSnapshotTest-327247759 None] Flow 'volume_create_manager' (1db3866f-dad5-4abc-8558-922bd1a4844c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:35:32 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-560b6c6b-b992-4feb-9155-35ac67fe3bd8 tempest-CreateVolumesFromSnapshotTest-327247759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e465c98d-a4c2-435c-b45e-70197830ed5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:35:32 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-560b6c6b-b992-4feb-9155-35ac67fe3bd8 tempest-CreateVolumesFromSnapshotTest-327247759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e465c98d-a4c2-435c-b45e-70197830ed5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:35:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-226576600',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9896adc-0675-4a21-9cc6-29402635e151,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e34b668f89d4f0faede82772950ef36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:35:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:35:32Z,use_quota=True,user_id='12c7d042fa1d4582b42038a657a96026',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:35:32 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-560b6c6b-b992-4feb-9155-35ac67fe3bd8 tempest-CreateVolumesFromSnapshotTest-327247759 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4cc5fa51-18a2-475b-a567-c893d8a5c1af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:35:32 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-560b6c6b-b992-4feb-9155-35ac67fe3bd8 tempest-CreateVolumesFromSnapshotTest-327247759 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4cc5fa51-18a2-475b-a567-c893d8a5c1af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:35:32 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-560b6c6b-b992-4feb-9155-35ac67fe3bd8 tempest-CreateVolumesFromSnapshotTest-327247759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c2c5eca-8088-46b6-935d-426cc41a4f68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:35:32 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-560b6c6b-b992-4feb-9155-35ac67fe3bd8 tempest-CreateVolumesFromSnapshotTest-327247759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c2c5eca-8088-46b6-935d-426cc41a4f68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd9896adc-0675-4a21-9cc6-29402635e151', 'volume_name': 'volume-d9896adc-0675-4a21-9cc6-29402635e151', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:35:32 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-560b6c6b-b992-4feb-9155-35ac67fe3bd8 tempest-CreateVolumesFromSnapshotTest-327247759 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd5e25f9-f052-4deb-bb51-303ed3b25306) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:35:32 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-560b6c6b-b992-4feb-9155-35ac67fe3bd8 tempest-CreateVolumesFromSnapshotTest-327247759 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd5e25f9-f052-4deb-bb51-303ed3b25306) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:35:32 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-560b6c6b-b992-4feb-9155-35ac67fe3bd8 tempest-CreateVolumesFromSnapshotTest-327247759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff000f4a-0ce3-4fc2-8619-1eaf79ebaee9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:35:32 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-560b6c6b-b992-4feb-9155-35ac67fe3bd8 tempest-CreateVolumesFromSnapshotTest-327247759 None] Volume d9896adc-0675-4a21-9cc6-29402635e151: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d9896adc-0675-4a21-9cc6-29402635e151', 'volume_size': 1} Jun 29 03:35:32 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-560b6c6b-b992-4feb-9155-35ac67fe3bd8 tempest-CreateVolumesFromSnapshotTest-327247759 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:35:32 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-560b6c6b-b992-4feb-9155-35ac67fe3bd8 tempest-CreateVolumesFromSnapshotTest-327247759 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:35:32 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-560b6c6b-b992-4feb-9155-35ac67fe3bd8 tempest-CreateVolumesFromSnapshotTest-327247759 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:35:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-226576600',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9896adc-0675-4a21-9cc6-29402635e151,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e34b668f89d4f0faede82772950ef36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:35:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:35:32Z,use_quota=True,user_id='12c7d042fa1d4582b42038a657a96026',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:35:32 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-560b6c6b-b992-4feb-9155-35ac67fe3bd8 tempest-CreateVolumesFromSnapshotTest-327247759 None] Creating volume d9896adc-0675-4a21-9cc6-29402635e151 {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:35:32 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-560b6c6b-b992-4feb-9155-35ac67fe3bd8 tempest-CreateVolumesFromSnapshotTest-327247759 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:35:32 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-560b6c6b-b992-4feb-9155-35ac67fe3bd8 tempest-CreateVolumesFromSnapshotTest-327247759 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:35:32 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-560b6c6b-b992-4feb-9155-35ac67fe3bd8 tempest-CreateVolumesFromSnapshotTest-327247759 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:35:32 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-560b6c6b-b992-4feb-9155-35ac67fe3bd8 tempest-CreateVolumesFromSnapshotTest-327247759 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:35:32 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-560b6c6b-b992-4feb-9155-35ac67fe3bd8 tempest-CreateVolumesFromSnapshotTest-327247759 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:35:32 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-560b6c6b-b992-4feb-9155-35ac67fe3bd8 tempest-CreateVolumesFromSnapshotTest-327247759 None] Selected osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:35:32 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-560b6c6b-b992-4feb-9155-35ac67fe3bd8 tempest-CreateVolumesFromSnapshotTest-327247759 None] casted to osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f Jun 29 03:35:32 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-560b6c6b-b992-4feb-9155-35ac67fe3bd8 tempest-CreateVolumesFromSnapshotTest-327247759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-d9896adc-0675-4a21-9cc6-29402635e151 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:35:32 devstack sudo[108788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-d9896adc-0675-4a21-9cc6-29402635e151 1073741824 Jun 29 03:35:32 devstack sudo[108788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:35:33 devstack sudo[108788]: pam_unix(sudo:session): session closed for user root Jun 29 03:35:33 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-560b6c6b-b992-4feb-9155-35ac67fe3bd8 tempest-CreateVolumesFromSnapshotTest-327247759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-d9896adc-0675-4a21-9cc6-29402635e151 1073741824" returned: 0 in 1.463s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:35:33 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-560b6c6b-b992-4feb-9155-35ac67fe3bd8 tempest-CreateVolumesFromSnapshotTest-327247759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-d9896adc-0675-4a21-9cc6-29402635e151 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:35:34 devstack sudo[108797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-d9896adc-0675-4a21-9cc6-29402635e151 Jun 29 03:35:34 devstack sudo[108797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:35:34 devstack sudo[108797]: pam_unix(sudo:session): session closed for user root Jun 29 03:35:34 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-560b6c6b-b992-4feb-9155-35ac67fe3bd8 tempest-CreateVolumesFromSnapshotTest-327247759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-d9896adc-0675-4a21-9cc6-29402635e151" returned: 0 in 0.965s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:35:34 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-560b6c6b-b992-4feb-9155-35ac67fe3bd8 tempest-CreateVolumesFromSnapshotTest-327247759 None] <== create_volume: return (2495ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:35:34 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-560b6c6b-b992-4feb-9155-35ac67fe3bd8 tempest-CreateVolumesFromSnapshotTest-327247759 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.498s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:35:35 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-560b6c6b-b992-4feb-9155-35ac67fe3bd8 tempest-CreateVolumesFromSnapshotTest-327247759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff000f4a-0ce3-4fc2-8619-1eaf79ebaee9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9896adc-0675-4a21-9cc6-29402635e151', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:35:35 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-560b6c6b-b992-4feb-9155-35ac67fe3bd8 tempest-CreateVolumesFromSnapshotTest-327247759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (786b3555-b2da-45c0-a90a-60ec679721b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:35:35 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-560b6c6b-b992-4feb-9155-35ac67fe3bd8 tempest-CreateVolumesFromSnapshotTest-327247759 None] Volume volume-d9896adc-0675-4a21-9cc6-29402635e151 (d9896adc-0675-4a21-9cc6-29402635e151): created successfully Jun 29 03:35:35 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-560b6c6b-b992-4feb-9155-35ac67fe3bd8 tempest-CreateVolumesFromSnapshotTest-327247759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (786b3555-b2da-45c0-a90a-60ec679721b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:35:35 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-560b6c6b-b992-4feb-9155-35ac67fe3bd8 tempest-CreateVolumesFromSnapshotTest-327247759 None] Flow 'volume_create_manager' (1db3866f-dad5-4abc-8558-922bd1a4844c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:35:35 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-560b6c6b-b992-4feb-9155-35ac67fe3bd8 tempest-CreateVolumesFromSnapshotTest-327247759 None] Created volume successfully. Jun 29 03:35:35 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-2418a3eb-018e-4444-a8a6-b48196ed0e7b tempest-CreateVolumesFromSnapshotTest-327247759 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:35:35 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-2418a3eb-018e-4444-a8a6-b48196ed0e7b tempest-CreateVolumesFromSnapshotTest-327247759 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:35:35 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-2418a3eb-018e-4444-a8a6-b48196ed0e7b tempest-CreateVolumesFromSnapshotTest-327247759 None] Creating offline snapshot 93667134-ad82-4cce-9730-d260ce764dbf of volume d9896adc-0675-4a21-9cc6-29402635e151 {{(pid=93468) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 29 03:35:35 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[05a7abf1-5633-447d-b497-6b891901808d]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:35:35 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2418a3eb-018e-4444-a8a6-b48196ed0e7b tempest-CreateVolumesFromSnapshotTest-327247759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-d9896adc-0675-4a21-9cc6-29402635e151 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:35:35 devstack sudo[108803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-d9896adc-0675-4a21-9cc6-29402635e151 Jun 29 03:35:35 devstack sudo[108803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:35:37 devstack sudo[108803]: pam_unix(sudo:session): session closed for user root Jun 29 03:35:37 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2418a3eb-018e-4444-a8a6-b48196ed0e7b tempest-CreateVolumesFromSnapshotTest-327247759 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-d9896adc-0675-4a21-9cc6-29402635e151" returned: 0 in 1.201s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:35:37 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2418a3eb-018e-4444-a8a6-b48196ed0e7b tempest-CreateVolumesFromSnapshotTest-327247759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-d9896adc-0675-4a21-9cc6-29402635e151,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-d9896adc-0675-4a21-9cc6-29402635e151.93667134-ad82-4cce-9730-d260ce764dbf 1G {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:35:37 devstack sudo[108813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-d9896adc-0675-4a21-9cc6-29402635e151,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-d9896adc-0675-4a21-9cc6-29402635e151.93667134-ad82-4cce-9730-d260ce764dbf 1G Jun 29 03:35:37 devstack sudo[108813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:35:37 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [req-7c9281f6-3a69-4d12-b1a8-9c3f3a7035e6 req-ab17803c-76e5-491b-81ae-239fd24e1561 tempest-TestServerVolumeAttachmentScenario-226006195 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:35:38 devstack sudo[108813]: pam_unix(sudo:session): session closed for user root Jun 29 03:35:38 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2418a3eb-018e-4444-a8a6-b48196ed0e7b tempest-CreateVolumesFromSnapshotTest-327247759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-d9896adc-0675-4a21-9cc6-29402635e151,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-d9896adc-0675-4a21-9cc6-29402635e151.93667134-ad82-4cce-9730-d260ce764dbf 1G" returned: 0 in 1.027s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:35:38 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2418a3eb-018e-4444-a8a6-b48196ed0e7b tempest-CreateVolumesFromSnapshotTest-327247759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d9896adc-0675-4a21-9cc6-29402635e151 -F qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-d9896adc-0675-4a21-9cc6-29402635e151.93667134-ad82-4cce-9730-d260ce764dbf {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:35:38 devstack sudo[108822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d9896adc-0675-4a21-9cc6-29402635e151 -F qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-d9896adc-0675-4a21-9cc6-29402635e151.93667134-ad82-4cce-9730-d260ce764dbf Jun 29 03:35:38 devstack sudo[108822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:35:39 devstack sudo[108822]: pam_unix(sudo:session): session closed for user root Jun 29 03:35:39 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2418a3eb-018e-4444-a8a6-b48196ed0e7b tempest-CreateVolumesFromSnapshotTest-327247759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d9896adc-0675-4a21-9cc6-29402635e151 -F qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-d9896adc-0675-4a21-9cc6-29402635e151.93667134-ad82-4cce-9730-d260ce764dbf" returned: 0 in 1.001s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:35:39 devstack cinder-volume[93468]: WARNING cinder.volume.drivers.remotefs [None req-2418a3eb-018e-4444-a8a6-b48196ed0e7b tempest-CreateVolumesFromSnapshotTest-327247759 None] /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-d9896adc-0675-4a21-9cc6-29402635e151.93667134-ad82-4cce-9730-d260ce764dbf is being set with open permissions: ugo+rw Jun 29 03:35:39 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2418a3eb-018e-4444-a8a6-b48196ed0e7b tempest-CreateVolumesFromSnapshotTest-327247759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-d9896adc-0675-4a21-9cc6-29402635e151.93667134-ad82-4cce-9730-d260ce764dbf {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:35:39 devstack sudo[108827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-d9896adc-0675-4a21-9cc6-29402635e151.93667134-ad82-4cce-9730-d260ce764dbf Jun 29 03:35:39 devstack sudo[108827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:35:39 devstack sudo[108827]: pam_unix(sudo:session): session closed for user root Jun 29 03:35:39 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2418a3eb-018e-4444-a8a6-b48196ed0e7b tempest-CreateVolumesFromSnapshotTest-327247759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-d9896adc-0675-4a21-9cc6-29402635e151.93667134-ad82-4cce-9730-d260ce764dbf" returned: 0 in 0.716s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:35:39 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2418a3eb-018e-4444-a8a6-b48196ed0e7b tempest-CreateVolumesFromSnapshotTest-327247759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-d9896adc-0675-4a21-9cc6-29402635e151.info {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:35:39 devstack sudo[108830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-d9896adc-0675-4a21-9cc6-29402635e151.info Jun 29 03:35:39 devstack sudo[108830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:35:40 devstack sudo[108830]: pam_unix(sudo:session): session closed for user root Jun 29 03:35:40 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2418a3eb-018e-4444-a8a6-b48196ed0e7b tempest-CreateVolumesFromSnapshotTest-327247759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-d9896adc-0675-4a21-9cc6-29402635e151.info" returned: 0 in 0.711s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:35:40 devstack cinder-volume[93468]: WARNING cinder.volume.drivers.remotefs [None req-2418a3eb-018e-4444-a8a6-b48196ed0e7b tempest-CreateVolumesFromSnapshotTest-327247759 None] /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-d9896adc-0675-4a21-9cc6-29402635e151.info is being set with open permissions: ugo+rw Jun 29 03:35:40 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2418a3eb-018e-4444-a8a6-b48196ed0e7b tempest-CreateVolumesFromSnapshotTest-327247759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-d9896adc-0675-4a21-9cc6-29402635e151.info {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:35:40 devstack sudo[108833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-d9896adc-0675-4a21-9cc6-29402635e151.info Jun 29 03:35:40 devstack sudo[108833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:35:41 devstack sudo[108833]: pam_unix(sudo:session): session closed for user root Jun 29 03:35:41 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2418a3eb-018e-4444-a8a6-b48196ed0e7b tempest-CreateVolumesFromSnapshotTest-327247759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-d9896adc-0675-4a21-9cc6-29402635e151.info" returned: 0 in 0.810s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:35:41 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-2418a3eb-018e-4444-a8a6-b48196ed0e7b tempest-CreateVolumesFromSnapshotTest-327247759 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.600s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:35:41 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [req-7c9281f6-3a69-4d12-b1a8-9c3f3a7035e6 req-ab17803c-76e5-491b-81ae-239fd24e1561 tempest-TestServerVolumeAttachmentScenario-226006195 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 4.002s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:35:41 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[81354372-f94e-491f-91ad-62cef70de3ce]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:35:41 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [req-7c9281f6-3a69-4d12-b1a8-9c3f3a7035e6 req-ab17803c-76e5-491b-81ae-239fd24e1561 tempest-TestServerVolumeAttachmentScenario-226006195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-527d3e86-7acd-4086-8c2f-cee2a6fe66cd {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:35:41 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-2418a3eb-018e-4444-a8a6-b48196ed0e7b tempest-CreateVolumesFromSnapshotTest-327247759 None] Create snapshot completed successfully Jun 29 03:35:41 devstack sudo[108836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-527d3e86-7acd-4086-8c2f-cee2a6fe66cd Jun 29 03:35:41 devstack sudo[108836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:35:42 devstack sudo[108836]: pam_unix(sudo:session): session closed for user root Jun 29 03:35:42 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [req-7c9281f6-3a69-4d12-b1a8-9c3f3a7035e6 req-ab17803c-76e5-491b-81ae-239fd24e1561 tempest-TestServerVolumeAttachmentScenario-226006195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-527d3e86-7acd-4086-8c2f-cee2a6fe66cd" returned: 0 in 0.908s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:35:42 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [req-7c9281f6-3a69-4d12-b1a8-9c3f3a7035e6 req-ab17803c-76e5-491b-81ae-239fd24e1561 tempest-TestServerVolumeAttachmentScenario-226006195 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.943s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:35:42 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [req-7c9281f6-3a69-4d12-b1a8-9c3f3a7035e6 req-ab17803c-76e5-491b-81ae-239fd24e1561 tempest-TestServerVolumeAttachmentScenario-226006195 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f', 'name': 'volume-527d3e86-7acd-4086-8c2f-cee2a6fe66cd', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '80c88301-fadc-4710-9d5e-c486d1e5a513', 'enforce_multipath': True} {{(pid=93468) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 29 03:35:42 devstack cinder-volume[93468]: INFO cinder.volume.manager [req-7c9281f6-3a69-4d12-b1a8-9c3f3a7035e6 req-ab17803c-76e5-491b-81ae-239fd24e1561 tempest-TestServerVolumeAttachmentScenario-226006195 None] attachment_update completed successfully. Jun 29 03:35:43 devstack cinder-volume[93468]: DEBUG dbcounter [-] [93468] Writing DB stats cinder:SELECT=90,cinder:INSERT=25,cinder:UPDATE=105,cinder:DELETE=11 {{(pid=93468) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 29 03:35:43 devstack cinder-volume[93468]: DEBUG dbcounter [-] [93468] Writing DB stats cinder:SELECT=87,cinder:UPDATE=112,cinder:DELETE=5,cinder:INSERT=22 {{(pid=93468) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 29 03:35:43 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-49380fad-5278-426e-a6de-235ff073cdbc tempest-CreateVolumesFromSnapshotTest-327247759 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:35:43 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-49380fad-5278-426e-a6de-235ff073cdbc tempest-CreateVolumesFromSnapshotTest-327247759 None] Flow 'volume_create_manager' (00859c6e-822a-464d-922b-fa3b9fb9dbce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:35:43 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-49380fad-5278-426e-a6de-235ff073cdbc tempest-CreateVolumesFromSnapshotTest-327247759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffcb934a-d032-4558-b97f-54dc70e55141) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:35:43 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-49380fad-5278-426e-a6de-235ff073cdbc tempest-CreateVolumesFromSnapshotTest-327247759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffcb934a-d032-4558-b97f-54dc70e55141) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:35:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-846889580',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4af5e047-d147-4c53-9f0d-d40422624148,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e34b668f89d4f0faede82772950ef36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:35:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:35:43Z,use_quota=True,user_id='12c7d042fa1d4582b42038a657a96026',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:35:43 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-49380fad-5278-426e-a6de-235ff073cdbc tempest-CreateVolumesFromSnapshotTest-327247759 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8109259e-b65e-4b00-a6f5-3dec0b8752ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:35:43 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-49380fad-5278-426e-a6de-235ff073cdbc tempest-CreateVolumesFromSnapshotTest-327247759 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8109259e-b65e-4b00-a6f5-3dec0b8752ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:35:43 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-49380fad-5278-426e-a6de-235ff073cdbc tempest-CreateVolumesFromSnapshotTest-327247759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcc0310b-3934-417d-b8d0-c684ef01a30d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:35:43 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-49380fad-5278-426e-a6de-235ff073cdbc tempest-CreateVolumesFromSnapshotTest-327247759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcc0310b-3934-417d-b8d0-c684ef01a30d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4af5e047-d147-4c53-9f0d-d40422624148', 'volume_name': 'volume-4af5e047-d147-4c53-9f0d-d40422624148', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:35:43 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-49380fad-5278-426e-a6de-235ff073cdbc tempest-CreateVolumesFromSnapshotTest-327247759 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9660da5-8eee-49c4-be23-29a4c6f76b2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:35:43 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-49380fad-5278-426e-a6de-235ff073cdbc tempest-CreateVolumesFromSnapshotTest-327247759 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9660da5-8eee-49c4-be23-29a4c6f76b2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:35:43 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-49380fad-5278-426e-a6de-235ff073cdbc tempest-CreateVolumesFromSnapshotTest-327247759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6767d5a2-9e1e-4fc7-82eb-10fa52cbe408) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:35:43 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-49380fad-5278-426e-a6de-235ff073cdbc tempest-CreateVolumesFromSnapshotTest-327247759 None] Volume 4af5e047-d147-4c53-9f0d-d40422624148: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4af5e047-d147-4c53-9f0d-d40422624148', 'volume_size': 1} Jun 29 03:35:43 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-49380fad-5278-426e-a6de-235ff073cdbc tempest-CreateVolumesFromSnapshotTest-327247759 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:35:43 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-49380fad-5278-426e-a6de-235ff073cdbc tempest-CreateVolumesFromSnapshotTest-327247759 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:35:43 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-49380fad-5278-426e-a6de-235ff073cdbc tempest-CreateVolumesFromSnapshotTest-327247759 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:35:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-846889580',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4af5e047-d147-4c53-9f0d-d40422624148,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e34b668f89d4f0faede82772950ef36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:35:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:35:43Z,use_quota=True,user_id='12c7d042fa1d4582b42038a657a96026',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:35:43 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-49380fad-5278-426e-a6de-235ff073cdbc tempest-CreateVolumesFromSnapshotTest-327247759 None] Creating volume 4af5e047-d147-4c53-9f0d-d40422624148 {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:35:43 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-49380fad-5278-426e-a6de-235ff073cdbc tempest-CreateVolumesFromSnapshotTest-327247759 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:35:43 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-49380fad-5278-426e-a6de-235ff073cdbc tempest-CreateVolumesFromSnapshotTest-327247759 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:35:43 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-49380fad-5278-426e-a6de-235ff073cdbc tempest-CreateVolumesFromSnapshotTest-327247759 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:35:43 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-49380fad-5278-426e-a6de-235ff073cdbc tempest-CreateVolumesFromSnapshotTest-327247759 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:35:43 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-49380fad-5278-426e-a6de-235ff073cdbc tempest-CreateVolumesFromSnapshotTest-327247759 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:35:43 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-49380fad-5278-426e-a6de-235ff073cdbc tempest-CreateVolumesFromSnapshotTest-327247759 None] Selected osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:35:43 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-49380fad-5278-426e-a6de-235ff073cdbc tempest-CreateVolumesFromSnapshotTest-327247759 None] casted to osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f Jun 29 03:35:43 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-49380fad-5278-426e-a6de-235ff073cdbc tempest-CreateVolumesFromSnapshotTest-327247759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-4af5e047-d147-4c53-9f0d-d40422624148 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:35:43 devstack sudo[108890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-4af5e047-d147-4c53-9f0d-d40422624148 1073741824 Jun 29 03:35:43 devstack sudo[108890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:35:43 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6961f3b-3613-4eaf-bdb1-88d89b4e2c35 tempest-CreateVolumesFromSnapshotTest-327247759 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:35:43 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-f6961f3b-3613-4eaf-bdb1-88d89b4e2c35 tempest-CreateVolumesFromSnapshotTest-327247759 None] Flow 'volume_create_manager' (f5e4b59b-dede-4f58-8d0a-674845100093) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:35:43 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-f6961f3b-3613-4eaf-bdb1-88d89b4e2c35 tempest-CreateVolumesFromSnapshotTest-327247759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ac074c4-a241-4842-93e1-fe1f5d617898) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:35:43 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-f6961f3b-3613-4eaf-bdb1-88d89b4e2c35 tempest-CreateVolumesFromSnapshotTest-327247759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ac074c4-a241-4842-93e1-fe1f5d617898) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:35:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-635053841',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eeb0ba2f-c4c8-4fcd-a408-56ffe3c4b1f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e34b668f89d4f0faede82772950ef36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:35:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:35:44Z,use_quota=True,user_id='12c7d042fa1d4582b42038a657a96026',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:35:43 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-f6961f3b-3613-4eaf-bdb1-88d89b4e2c35 tempest-CreateVolumesFromSnapshotTest-327247759 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b12223e-c82b-48bb-a7c0-f5d0ad14b04d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:35:43 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-f6961f3b-3613-4eaf-bdb1-88d89b4e2c35 tempest-CreateVolumesFromSnapshotTest-327247759 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b12223e-c82b-48bb-a7c0-f5d0ad14b04d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:35:43 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-f6961f3b-3613-4eaf-bdb1-88d89b4e2c35 tempest-CreateVolumesFromSnapshotTest-327247759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34e56bee-40d3-46bc-ac48-b036864f2c39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:35:43 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-f6961f3b-3613-4eaf-bdb1-88d89b4e2c35 tempest-CreateVolumesFromSnapshotTest-327247759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34e56bee-40d3-46bc-ac48-b036864f2c39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eeb0ba2f-c4c8-4fcd-a408-56ffe3c4b1f6', 'volume_name': 'volume-eeb0ba2f-c4c8-4fcd-a408-56ffe3c4b1f6', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:35:43 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-f6961f3b-3613-4eaf-bdb1-88d89b4e2c35 tempest-CreateVolumesFromSnapshotTest-327247759 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d230f702-8bf7-4d44-8194-e48e311f1007) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:35:43 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-f6961f3b-3613-4eaf-bdb1-88d89b4e2c35 tempest-CreateVolumesFromSnapshotTest-327247759 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d230f702-8bf7-4d44-8194-e48e311f1007) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:35:43 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-f6961f3b-3613-4eaf-bdb1-88d89b4e2c35 tempest-CreateVolumesFromSnapshotTest-327247759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cb5cf8a-1ad9-4400-8cd7-3abd27d0d850) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:35:43 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-f6961f3b-3613-4eaf-bdb1-88d89b4e2c35 tempest-CreateVolumesFromSnapshotTest-327247759 None] Volume eeb0ba2f-c4c8-4fcd-a408-56ffe3c4b1f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eeb0ba2f-c4c8-4fcd-a408-56ffe3c4b1f6', 'volume_size': 1} Jun 29 03:35:43 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-f6961f3b-3613-4eaf-bdb1-88d89b4e2c35 tempest-CreateVolumesFromSnapshotTest-327247759 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:35:44 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-240ea57c-ce4c-44ba-a262-910d81c51be0 tempest-CreateVolumesFromSnapshotTest-327247759 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:35:44 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-240ea57c-ce4c-44ba-a262-910d81c51be0 tempest-CreateVolumesFromSnapshotTest-327247759 None] Flow 'volume_create_manager' (87fcb9dd-e834-4da6-b0fc-eeab1f3d6a55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:35:44 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-240ea57c-ce4c-44ba-a262-910d81c51be0 tempest-CreateVolumesFromSnapshotTest-327247759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (823529c8-f0fd-468d-90ef-639a391e21b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:35:44 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-240ea57c-ce4c-44ba-a262-910d81c51be0 tempest-CreateVolumesFromSnapshotTest-327247759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (823529c8-f0fd-468d-90ef-639a391e21b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:35:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1405340346',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ffa8a87-6bfc-48ef-8434-65672c742eee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e34b668f89d4f0faede82772950ef36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:35:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:35:44Z,use_quota=True,user_id='12c7d042fa1d4582b42038a657a96026',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:35:44 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-240ea57c-ce4c-44ba-a262-910d81c51be0 tempest-CreateVolumesFromSnapshotTest-327247759 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55f139dd-1fd7-4777-98e6-d25f563e4aeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:35:44 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-240ea57c-ce4c-44ba-a262-910d81c51be0 tempest-CreateVolumesFromSnapshotTest-327247759 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55f139dd-1fd7-4777-98e6-d25f563e4aeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:35:44 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-240ea57c-ce4c-44ba-a262-910d81c51be0 tempest-CreateVolumesFromSnapshotTest-327247759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc4d2036-5851-4618-a2e9-04d7745e8334) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:35:44 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-240ea57c-ce4c-44ba-a262-910d81c51be0 tempest-CreateVolumesFromSnapshotTest-327247759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc4d2036-5851-4618-a2e9-04d7745e8334) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ffa8a87-6bfc-48ef-8434-65672c742eee', 'volume_name': 'volume-4ffa8a87-6bfc-48ef-8434-65672c742eee', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:35:44 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-240ea57c-ce4c-44ba-a262-910d81c51be0 tempest-CreateVolumesFromSnapshotTest-327247759 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96a324a3-482c-45e7-8918-847e7dbe8f39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:35:44 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-240ea57c-ce4c-44ba-a262-910d81c51be0 tempest-CreateVolumesFromSnapshotTest-327247759 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96a324a3-482c-45e7-8918-847e7dbe8f39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:35:44 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-240ea57c-ce4c-44ba-a262-910d81c51be0 tempest-CreateVolumesFromSnapshotTest-327247759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4734a885-10d3-49b7-b9e0-a2a9939a814f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:35:44 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-240ea57c-ce4c-44ba-a262-910d81c51be0 tempest-CreateVolumesFromSnapshotTest-327247759 None] Volume 4ffa8a87-6bfc-48ef-8434-65672c742eee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ffa8a87-6bfc-48ef-8434-65672c742eee', 'volume_size': 1} Jun 29 03:35:44 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-240ea57c-ce4c-44ba-a262-910d81c51be0 tempest-CreateVolumesFromSnapshotTest-327247759 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:35:44 devstack sudo[108890]: pam_unix(sudo:session): session closed for user root Jun 29 03:35:44 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-49380fad-5278-426e-a6de-235ff073cdbc tempest-CreateVolumesFromSnapshotTest-327247759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-4af5e047-d147-4c53-9f0d-d40422624148 1073741824" returned: 0 in 1.407s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:35:44 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-49380fad-5278-426e-a6de-235ff073cdbc tempest-CreateVolumesFromSnapshotTest-327247759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-4af5e047-d147-4c53-9f0d-d40422624148 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:35:44 devstack sudo[108928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-4af5e047-d147-4c53-9f0d-d40422624148 Jun 29 03:35:44 devstack sudo[108928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:35:44 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-19d57171-558a-4297-9fda-3dd21185171e tempest-CreateVolumesFromSnapshotTest-327247759 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:35:44 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-19d57171-558a-4297-9fda-3dd21185171e tempest-CreateVolumesFromSnapshotTest-327247759 None] Flow 'volume_create_manager' (48aa63ab-80ca-4357-b9c7-ea4a412e892d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:35:44 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-19d57171-558a-4297-9fda-3dd21185171e tempest-CreateVolumesFromSnapshotTest-327247759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73782fc0-fcf9-4d3f-ab7c-52aeb431dea0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:35:44 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-19d57171-558a-4297-9fda-3dd21185171e tempest-CreateVolumesFromSnapshotTest-327247759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73782fc0-fcf9-4d3f-ab7c-52aeb431dea0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:35:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1485709140',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05e69dfe-9a52-49b5-b924-7644f5a29e23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e34b668f89d4f0faede82772950ef36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:35:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:35:45Z,use_quota=True,user_id='12c7d042fa1d4582b42038a657a96026',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:35:44 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-19d57171-558a-4297-9fda-3dd21185171e tempest-CreateVolumesFromSnapshotTest-327247759 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8cd780bf-8252-4c9d-8ef4-3b0d6170e7be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:35:44 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-19d57171-558a-4297-9fda-3dd21185171e tempest-CreateVolumesFromSnapshotTest-327247759 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8cd780bf-8252-4c9d-8ef4-3b0d6170e7be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:35:44 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-19d57171-558a-4297-9fda-3dd21185171e tempest-CreateVolumesFromSnapshotTest-327247759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4bace0b-4bad-457e-8b7f-ab17e35debf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:35:44 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-19d57171-558a-4297-9fda-3dd21185171e tempest-CreateVolumesFromSnapshotTest-327247759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4bace0b-4bad-457e-8b7f-ab17e35debf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05e69dfe-9a52-49b5-b924-7644f5a29e23', 'volume_name': 'volume-05e69dfe-9a52-49b5-b924-7644f5a29e23', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:35:44 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-19d57171-558a-4297-9fda-3dd21185171e tempest-CreateVolumesFromSnapshotTest-327247759 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8108a8e-2fb5-42f7-afb1-0d6c648e988a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:35:44 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-19d57171-558a-4297-9fda-3dd21185171e tempest-CreateVolumesFromSnapshotTest-327247759 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8108a8e-2fb5-42f7-afb1-0d6c648e988a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:35:44 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-19d57171-558a-4297-9fda-3dd21185171e tempest-CreateVolumesFromSnapshotTest-327247759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aef11c12-b76a-40e2-ab5f-5b11943ad2a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:35:44 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-19d57171-558a-4297-9fda-3dd21185171e tempest-CreateVolumesFromSnapshotTest-327247759 None] Volume 05e69dfe-9a52-49b5-b924-7644f5a29e23: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05e69dfe-9a52-49b5-b924-7644f5a29e23', 'volume_size': 1} Jun 29 03:35:44 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-19d57171-558a-4297-9fda-3dd21185171e tempest-CreateVolumesFromSnapshotTest-327247759 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:35:45 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-00c2b055-c16e-48f5-8d5c-6d3011152e26 tempest-CreateVolumesFromSnapshotTest-327247759 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:35:45 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-00c2b055-c16e-48f5-8d5c-6d3011152e26 tempest-CreateVolumesFromSnapshotTest-327247759 None] Flow 'volume_create_manager' (a0809a43-75f8-4cb1-b15d-f2e9aede0e8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:35:45 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-00c2b055-c16e-48f5-8d5c-6d3011152e26 tempest-CreateVolumesFromSnapshotTest-327247759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78d3e7cd-6fff-44ab-9749-7625d3214a6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:35:45 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-00c2b055-c16e-48f5-8d5c-6d3011152e26 tempest-CreateVolumesFromSnapshotTest-327247759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78d3e7cd-6fff-44ab-9749-7625d3214a6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:35:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-885023133',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c4a487f-e736-454a-88ee-e9c3eb27ed4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e34b668f89d4f0faede82772950ef36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:35:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:35:45Z,use_quota=True,user_id='12c7d042fa1d4582b42038a657a96026',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:35:45 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-00c2b055-c16e-48f5-8d5c-6d3011152e26 tempest-CreateVolumesFromSnapshotTest-327247759 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2ee3e74-b3f9-46bc-a1e0-28a3fdc55b55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:35:45 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-00c2b055-c16e-48f5-8d5c-6d3011152e26 tempest-CreateVolumesFromSnapshotTest-327247759 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2ee3e74-b3f9-46bc-a1e0-28a3fdc55b55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:35:45 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-00c2b055-c16e-48f5-8d5c-6d3011152e26 tempest-CreateVolumesFromSnapshotTest-327247759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69382699-7e67-4429-bad3-ee9bd7f0503b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:35:45 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-00c2b055-c16e-48f5-8d5c-6d3011152e26 tempest-CreateVolumesFromSnapshotTest-327247759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69382699-7e67-4429-bad3-ee9bd7f0503b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2c4a487f-e736-454a-88ee-e9c3eb27ed4a', 'volume_name': 'volume-2c4a487f-e736-454a-88ee-e9c3eb27ed4a', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:35:45 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-00c2b055-c16e-48f5-8d5c-6d3011152e26 tempest-CreateVolumesFromSnapshotTest-327247759 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd196795-5075-4c40-8a3f-06b7c41e7844) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:35:45 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-00c2b055-c16e-48f5-8d5c-6d3011152e26 tempest-CreateVolumesFromSnapshotTest-327247759 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd196795-5075-4c40-8a3f-06b7c41e7844) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:35:45 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-00c2b055-c16e-48f5-8d5c-6d3011152e26 tempest-CreateVolumesFromSnapshotTest-327247759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9074488f-638c-44d8-a73f-e466055ecd5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:35:45 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-00c2b055-c16e-48f5-8d5c-6d3011152e26 tempest-CreateVolumesFromSnapshotTest-327247759 None] Volume 2c4a487f-e736-454a-88ee-e9c3eb27ed4a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2c4a487f-e736-454a-88ee-e9c3eb27ed4a', 'volume_size': 1} Jun 29 03:35:45 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-00c2b055-c16e-48f5-8d5c-6d3011152e26 tempest-CreateVolumesFromSnapshotTest-327247759 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:35:45 devstack sudo[108928]: pam_unix(sudo:session): session closed for user root Jun 29 03:35:45 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-49380fad-5278-426e-a6de-235ff073cdbc tempest-CreateVolumesFromSnapshotTest-327247759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-4af5e047-d147-4c53-9f0d-d40422624148" returned: 0 in 0.978s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:35:45 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-49380fad-5278-426e-a6de-235ff073cdbc tempest-CreateVolumesFromSnapshotTest-327247759 None] <== create_volume: return (2444ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:35:45 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-49380fad-5278-426e-a6de-235ff073cdbc tempest-CreateVolumesFromSnapshotTest-327247759 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.448s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:35:45 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-f6961f3b-3613-4eaf-bdb1-88d89b4e2c35 tempest-CreateVolumesFromSnapshotTest-327247759 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.873s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:35:45 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-f6961f3b-3613-4eaf-bdb1-88d89b4e2c35 tempest-CreateVolumesFromSnapshotTest-327247759 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:35:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-635053841',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eeb0ba2f-c4c8-4fcd-a408-56ffe3c4b1f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e34b668f89d4f0faede82772950ef36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:35:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:35:44Z,use_quota=True,user_id='12c7d042fa1d4582b42038a657a96026',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:35:45 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-f6961f3b-3613-4eaf-bdb1-88d89b4e2c35 tempest-CreateVolumesFromSnapshotTest-327247759 None] Creating volume eeb0ba2f-c4c8-4fcd-a408-56ffe3c4b1f6 {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:35:45 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-f6961f3b-3613-4eaf-bdb1-88d89b4e2c35 tempest-CreateVolumesFromSnapshotTest-327247759 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:35:45 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-f6961f3b-3613-4eaf-bdb1-88d89b4e2c35 tempest-CreateVolumesFromSnapshotTest-327247759 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:35:45 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-f6961f3b-3613-4eaf-bdb1-88d89b4e2c35 tempest-CreateVolumesFromSnapshotTest-327247759 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:35:45 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-f6961f3b-3613-4eaf-bdb1-88d89b4e2c35 tempest-CreateVolumesFromSnapshotTest-327247759 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:35:45 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-f6961f3b-3613-4eaf-bdb1-88d89b4e2c35 tempest-CreateVolumesFromSnapshotTest-327247759 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:35:45 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-f6961f3b-3613-4eaf-bdb1-88d89b4e2c35 tempest-CreateVolumesFromSnapshotTest-327247759 None] Selected osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:35:45 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-f6961f3b-3613-4eaf-bdb1-88d89b4e2c35 tempest-CreateVolumesFromSnapshotTest-327247759 None] casted to osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f Jun 29 03:35:45 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-f6961f3b-3613-4eaf-bdb1-88d89b4e2c35 tempest-CreateVolumesFromSnapshotTest-327247759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-eeb0ba2f-c4c8-4fcd-a408-56ffe3c4b1f6 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:35:45 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-49380fad-5278-426e-a6de-235ff073cdbc tempest-CreateVolumesFromSnapshotTest-327247759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6767d5a2-9e1e-4fc7-82eb-10fa52cbe408) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4af5e047-d147-4c53-9f0d-d40422624148', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:35:45 devstack sudo[108931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-eeb0ba2f-c4c8-4fcd-a408-56ffe3c4b1f6 1073741824 Jun 29 03:35:45 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-49380fad-5278-426e-a6de-235ff073cdbc tempest-CreateVolumesFromSnapshotTest-327247759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31c4ddcc-c36a-4700-be72-ddb9738f4a85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:35:45 devstack sudo[108931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:35:45 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-49380fad-5278-426e-a6de-235ff073cdbc tempest-CreateVolumesFromSnapshotTest-327247759 None] Volume volume-4af5e047-d147-4c53-9f0d-d40422624148 (4af5e047-d147-4c53-9f0d-d40422624148): created successfully Jun 29 03:35:45 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-49380fad-5278-426e-a6de-235ff073cdbc tempest-CreateVolumesFromSnapshotTest-327247759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31c4ddcc-c36a-4700-be72-ddb9738f4a85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:35:45 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-49380fad-5278-426e-a6de-235ff073cdbc tempest-CreateVolumesFromSnapshotTest-327247759 None] Flow 'volume_create_manager' (00859c6e-822a-464d-922b-fa3b9fb9dbce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:35:45 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-49380fad-5278-426e-a6de-235ff073cdbc tempest-CreateVolumesFromSnapshotTest-327247759 None] Created volume successfully. Jun 29 03:35:46 devstack sudo[108931]: pam_unix(sudo:session): session closed for user root Jun 29 03:35:46 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-f6961f3b-3613-4eaf-bdb1-88d89b4e2c35 tempest-CreateVolumesFromSnapshotTest-327247759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-eeb0ba2f-c4c8-4fcd-a408-56ffe3c4b1f6 1073741824" returned: 0 in 0.891s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:35:46 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-f6961f3b-3613-4eaf-bdb1-88d89b4e2c35 tempest-CreateVolumesFromSnapshotTest-327247759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-eeb0ba2f-c4c8-4fcd-a408-56ffe3c4b1f6 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:35:46 devstack sudo[108937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-eeb0ba2f-c4c8-4fcd-a408-56ffe3c4b1f6 Jun 29 03:35:46 devstack sudo[108937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:35:47 devstack sudo[108937]: pam_unix(sudo:session): session closed for user root Jun 29 03:35:47 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-f6961f3b-3613-4eaf-bdb1-88d89b4e2c35 tempest-CreateVolumesFromSnapshotTest-327247759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-eeb0ba2f-c4c8-4fcd-a408-56ffe3c4b1f6" returned: 0 in 0.670s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:35:47 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-f6961f3b-3613-4eaf-bdb1-88d89b4e2c35 tempest-CreateVolumesFromSnapshotTest-327247759 None] <== create_volume: return (1604ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:35:47 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-f6961f3b-3613-4eaf-bdb1-88d89b4e2c35 tempest-CreateVolumesFromSnapshotTest-327247759 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.608s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:35:47 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-240ea57c-ce4c-44ba-a262-910d81c51be0 tempest-CreateVolumesFromSnapshotTest-327247759 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.720s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:35:47 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-240ea57c-ce4c-44ba-a262-910d81c51be0 tempest-CreateVolumesFromSnapshotTest-327247759 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:35:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1405340346',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ffa8a87-6bfc-48ef-8434-65672c742eee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e34b668f89d4f0faede82772950ef36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:35:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:35:44Z,use_quota=True,user_id='12c7d042fa1d4582b42038a657a96026',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:35:47 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-240ea57c-ce4c-44ba-a262-910d81c51be0 tempest-CreateVolumesFromSnapshotTest-327247759 None] Creating volume 4ffa8a87-6bfc-48ef-8434-65672c742eee {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:35:47 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-240ea57c-ce4c-44ba-a262-910d81c51be0 tempest-CreateVolumesFromSnapshotTest-327247759 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:35:47 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-240ea57c-ce4c-44ba-a262-910d81c51be0 tempest-CreateVolumesFromSnapshotTest-327247759 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:35:47 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-240ea57c-ce4c-44ba-a262-910d81c51be0 tempest-CreateVolumesFromSnapshotTest-327247759 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:35:47 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-240ea57c-ce4c-44ba-a262-910d81c51be0 tempest-CreateVolumesFromSnapshotTest-327247759 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:35:47 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-240ea57c-ce4c-44ba-a262-910d81c51be0 tempest-CreateVolumesFromSnapshotTest-327247759 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:35:47 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-240ea57c-ce4c-44ba-a262-910d81c51be0 tempest-CreateVolumesFromSnapshotTest-327247759 None] Selected osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:35:47 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-240ea57c-ce4c-44ba-a262-910d81c51be0 tempest-CreateVolumesFromSnapshotTest-327247759 None] casted to osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f Jun 29 03:35:47 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-240ea57c-ce4c-44ba-a262-910d81c51be0 tempest-CreateVolumesFromSnapshotTest-327247759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-4ffa8a87-6bfc-48ef-8434-65672c742eee 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:35:47 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-f6961f3b-3613-4eaf-bdb1-88d89b4e2c35 tempest-CreateVolumesFromSnapshotTest-327247759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cb5cf8a-1ad9-4400-8cd7-3abd27d0d850) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eeb0ba2f-c4c8-4fcd-a408-56ffe3c4b1f6', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:35:47 devstack sudo[108940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-4ffa8a87-6bfc-48ef-8434-65672c742eee 1073741824 Jun 29 03:35:47 devstack sudo[108940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:35:47 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-f6961f3b-3613-4eaf-bdb1-88d89b4e2c35 tempest-CreateVolumesFromSnapshotTest-327247759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80cb3173-f5a4-4ab5-9e21-65a3095602b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:35:47 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-f6961f3b-3613-4eaf-bdb1-88d89b4e2c35 tempest-CreateVolumesFromSnapshotTest-327247759 None] Volume volume-eeb0ba2f-c4c8-4fcd-a408-56ffe3c4b1f6 (eeb0ba2f-c4c8-4fcd-a408-56ffe3c4b1f6): created successfully Jun 29 03:35:47 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-f6961f3b-3613-4eaf-bdb1-88d89b4e2c35 tempest-CreateVolumesFromSnapshotTest-327247759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80cb3173-f5a4-4ab5-9e21-65a3095602b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:35:47 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-f6961f3b-3613-4eaf-bdb1-88d89b4e2c35 tempest-CreateVolumesFromSnapshotTest-327247759 None] Flow 'volume_create_manager' (f5e4b59b-dede-4f58-8d0a-674845100093) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:35:47 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-f6961f3b-3613-4eaf-bdb1-88d89b4e2c35 tempest-CreateVolumesFromSnapshotTest-327247759 None] Created volume successfully. Jun 29 03:35:48 devstack sudo[108940]: pam_unix(sudo:session): session closed for user root Jun 29 03:35:48 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-240ea57c-ce4c-44ba-a262-910d81c51be0 tempest-CreateVolumesFromSnapshotTest-327247759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-4ffa8a87-6bfc-48ef-8434-65672c742eee 1073741824" returned: 0 in 1.015s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:35:48 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-240ea57c-ce4c-44ba-a262-910d81c51be0 tempest-CreateVolumesFromSnapshotTest-327247759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-4ffa8a87-6bfc-48ef-8434-65672c742eee {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:35:48 devstack sudo[108945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-4ffa8a87-6bfc-48ef-8434-65672c742eee Jun 29 03:35:48 devstack sudo[108945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:35:49 devstack sudo[108945]: pam_unix(sudo:session): session closed for user root Jun 29 03:35:49 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-240ea57c-ce4c-44ba-a262-910d81c51be0 tempest-CreateVolumesFromSnapshotTest-327247759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-4ffa8a87-6bfc-48ef-8434-65672c742eee" returned: 0 in 0.824s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:35:49 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-240ea57c-ce4c-44ba-a262-910d81c51be0 tempest-CreateVolumesFromSnapshotTest-327247759 None] <== create_volume: return (1899ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:35:49 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-240ea57c-ce4c-44ba-a262-910d81c51be0 tempest-CreateVolumesFromSnapshotTest-327247759 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.905s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:35:49 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-19d57171-558a-4297-9fda-3dd21185171e tempest-CreateVolumesFromSnapshotTest-327247759 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.277s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:35:49 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-19d57171-558a-4297-9fda-3dd21185171e tempest-CreateVolumesFromSnapshotTest-327247759 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:35:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1485709140',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05e69dfe-9a52-49b5-b924-7644f5a29e23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e34b668f89d4f0faede82772950ef36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:35:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:35:45Z,use_quota=True,user_id='12c7d042fa1d4582b42038a657a96026',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:35:49 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-19d57171-558a-4297-9fda-3dd21185171e tempest-CreateVolumesFromSnapshotTest-327247759 None] Creating volume 05e69dfe-9a52-49b5-b924-7644f5a29e23 {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:35:49 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-19d57171-558a-4297-9fda-3dd21185171e tempest-CreateVolumesFromSnapshotTest-327247759 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:35:49 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-19d57171-558a-4297-9fda-3dd21185171e tempest-CreateVolumesFromSnapshotTest-327247759 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:35:49 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-19d57171-558a-4297-9fda-3dd21185171e tempest-CreateVolumesFromSnapshotTest-327247759 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:35:49 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-19d57171-558a-4297-9fda-3dd21185171e tempest-CreateVolumesFromSnapshotTest-327247759 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:35:49 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-19d57171-558a-4297-9fda-3dd21185171e tempest-CreateVolumesFromSnapshotTest-327247759 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:35:49 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-19d57171-558a-4297-9fda-3dd21185171e tempest-CreateVolumesFromSnapshotTest-327247759 None] Selected osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:35:49 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-19d57171-558a-4297-9fda-3dd21185171e tempest-CreateVolumesFromSnapshotTest-327247759 None] casted to osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f Jun 29 03:35:49 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-19d57171-558a-4297-9fda-3dd21185171e tempest-CreateVolumesFromSnapshotTest-327247759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-05e69dfe-9a52-49b5-b924-7644f5a29e23 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:35:49 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-240ea57c-ce4c-44ba-a262-910d81c51be0 tempest-CreateVolumesFromSnapshotTest-327247759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4734a885-10d3-49b7-b9e0-a2a9939a814f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ffa8a87-6bfc-48ef-8434-65672c742eee', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:35:49 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-240ea57c-ce4c-44ba-a262-910d81c51be0 tempest-CreateVolumesFromSnapshotTest-327247759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b87b9e9a-1010-4471-a962-38260f69c3b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:35:49 devstack sudo[108949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-05e69dfe-9a52-49b5-b924-7644f5a29e23 1073741824 Jun 29 03:35:49 devstack sudo[108949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:35:49 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-240ea57c-ce4c-44ba-a262-910d81c51be0 tempest-CreateVolumesFromSnapshotTest-327247759 None] Volume volume-4ffa8a87-6bfc-48ef-8434-65672c742eee (4ffa8a87-6bfc-48ef-8434-65672c742eee): created successfully Jun 29 03:35:49 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-240ea57c-ce4c-44ba-a262-910d81c51be0 tempest-CreateVolumesFromSnapshotTest-327247759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b87b9e9a-1010-4471-a962-38260f69c3b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:35:49 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-240ea57c-ce4c-44ba-a262-910d81c51be0 tempest-CreateVolumesFromSnapshotTest-327247759 None] Flow 'volume_create_manager' (87fcb9dd-e834-4da6-b0fc-eeab1f3d6a55) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:35:49 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-240ea57c-ce4c-44ba-a262-910d81c51be0 tempest-CreateVolumesFromSnapshotTest-327247759 None] Created volume successfully. Jun 29 03:35:49 devstack cinder-volume[93468]: INFO cinder.volume.manager [req-d84f76a9-386a-4d88-b57b-c55d42331cf8 req-c5121752-5f22-4de9-89c4-6ab74b6bdca0 tempest-TestServerVolumeAttachmentScenario-226006195 None] Terminate volume connection completed successfully. Jun 29 03:35:49 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [req-d84f76a9-386a-4d88-b57b-c55d42331cf8 req-c5121752-5f22-4de9-89c4-6ab74b6bdca0 tempest-TestServerVolumeAttachmentScenario-226006195 None] Deleting attachment 80c88301-fadc-4710-9d5e-c486d1e5a513. {{(pid=93468) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 29 03:35:50 devstack sudo[108949]: pam_unix(sudo:session): session closed for user root Jun 29 03:35:50 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-19d57171-558a-4297-9fda-3dd21185171e tempest-CreateVolumesFromSnapshotTest-327247759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-05e69dfe-9a52-49b5-b924-7644f5a29e23 1073741824" returned: 0 in 1.203s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:35:50 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-19d57171-558a-4297-9fda-3dd21185171e tempest-CreateVolumesFromSnapshotTest-327247759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-05e69dfe-9a52-49b5-b924-7644f5a29e23 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:35:50 devstack sudo[108960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-05e69dfe-9a52-49b5-b924-7644f5a29e23 Jun 29 03:35:50 devstack sudo[108960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:35:51 devstack sudo[108960]: pam_unix(sudo:session): session closed for user root Jun 29 03:35:51 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-19d57171-558a-4297-9fda-3dd21185171e tempest-CreateVolumesFromSnapshotTest-327247759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-05e69dfe-9a52-49b5-b924-7644f5a29e23" returned: 0 in 0.827s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:35:51 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-19d57171-558a-4297-9fda-3dd21185171e tempest-CreateVolumesFromSnapshotTest-327247759 None] <== create_volume: return (2096ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:35:51 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-19d57171-558a-4297-9fda-3dd21185171e tempest-CreateVolumesFromSnapshotTest-327247759 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.103s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:35:51 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-00c2b055-c16e-48f5-8d5c-6d3011152e26 tempest-CreateVolumesFromSnapshotTest-327247759 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.926s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:35:51 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-00c2b055-c16e-48f5-8d5c-6d3011152e26 tempest-CreateVolumesFromSnapshotTest-327247759 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:35:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-885023133',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c4a487f-e736-454a-88ee-e9c3eb27ed4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e34b668f89d4f0faede82772950ef36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:35:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:35:45Z,use_quota=True,user_id='12c7d042fa1d4582b42038a657a96026',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:35:51 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-00c2b055-c16e-48f5-8d5c-6d3011152e26 tempest-CreateVolumesFromSnapshotTest-327247759 None] Creating volume 2c4a487f-e736-454a-88ee-e9c3eb27ed4a {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:35:51 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-00c2b055-c16e-48f5-8d5c-6d3011152e26 tempest-CreateVolumesFromSnapshotTest-327247759 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:35:51 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-00c2b055-c16e-48f5-8d5c-6d3011152e26 tempest-CreateVolumesFromSnapshotTest-327247759 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:35:51 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-00c2b055-c16e-48f5-8d5c-6d3011152e26 tempest-CreateVolumesFromSnapshotTest-327247759 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:35:51 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-00c2b055-c16e-48f5-8d5c-6d3011152e26 tempest-CreateVolumesFromSnapshotTest-327247759 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:35:51 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-00c2b055-c16e-48f5-8d5c-6d3011152e26 tempest-CreateVolumesFromSnapshotTest-327247759 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:35:51 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-00c2b055-c16e-48f5-8d5c-6d3011152e26 tempest-CreateVolumesFromSnapshotTest-327247759 None] Selected osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:35:51 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-00c2b055-c16e-48f5-8d5c-6d3011152e26 tempest-CreateVolumesFromSnapshotTest-327247759 None] casted to osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f Jun 29 03:35:51 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-00c2b055-c16e-48f5-8d5c-6d3011152e26 tempest-CreateVolumesFromSnapshotTest-327247759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-2c4a487f-e736-454a-88ee-e9c3eb27ed4a 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:35:51 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-19d57171-558a-4297-9fda-3dd21185171e tempest-CreateVolumesFromSnapshotTest-327247759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aef11c12-b76a-40e2-ab5f-5b11943ad2a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05e69dfe-9a52-49b5-b924-7644f5a29e23', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:35:51 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-19d57171-558a-4297-9fda-3dd21185171e tempest-CreateVolumesFromSnapshotTest-327247759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32a4cc29-4da5-49b6-8b3b-d1bee9e6f5e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:35:51 devstack sudo[108963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-2c4a487f-e736-454a-88ee-e9c3eb27ed4a 1073741824 Jun 29 03:35:51 devstack sudo[108963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:35:51 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-19d57171-558a-4297-9fda-3dd21185171e tempest-CreateVolumesFromSnapshotTest-327247759 None] Volume volume-05e69dfe-9a52-49b5-b924-7644f5a29e23 (05e69dfe-9a52-49b5-b924-7644f5a29e23): created successfully Jun 29 03:35:51 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-19d57171-558a-4297-9fda-3dd21185171e tempest-CreateVolumesFromSnapshotTest-327247759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32a4cc29-4da5-49b6-8b3b-d1bee9e6f5e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:35:51 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-19d57171-558a-4297-9fda-3dd21185171e tempest-CreateVolumesFromSnapshotTest-327247759 None] Flow 'volume_create_manager' (48aa63ab-80ca-4357-b9c7-ea4a412e892d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:35:51 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-19d57171-558a-4297-9fda-3dd21185171e tempest-CreateVolumesFromSnapshotTest-327247759 None] Created volume successfully. Jun 29 03:35:52 devstack sudo[108963]: pam_unix(sudo:session): session closed for user root Jun 29 03:35:52 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-00c2b055-c16e-48f5-8d5c-6d3011152e26 tempest-CreateVolumesFromSnapshotTest-327247759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-2c4a487f-e736-454a-88ee-e9c3eb27ed4a 1073741824" returned: 0 in 1.264s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:35:52 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-00c2b055-c16e-48f5-8d5c-6d3011152e26 tempest-CreateVolumesFromSnapshotTest-327247759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-2c4a487f-e736-454a-88ee-e9c3eb27ed4a {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:35:52 devstack sudo[108970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-2c4a487f-e736-454a-88ee-e9c3eb27ed4a Jun 29 03:35:52 devstack sudo[108970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:35:53 devstack sudo[108970]: pam_unix(sudo:session): session closed for user root Jun 29 03:35:53 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-00c2b055-c16e-48f5-8d5c-6d3011152e26 tempest-CreateVolumesFromSnapshotTest-327247759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-2c4a487f-e736-454a-88ee-e9c3eb27ed4a" returned: 0 in 0.724s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:35:53 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-00c2b055-c16e-48f5-8d5c-6d3011152e26 tempest-CreateVolumesFromSnapshotTest-327247759 None] <== create_volume: return (2049ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:35:53 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-00c2b055-c16e-48f5-8d5c-6d3011152e26 tempest-CreateVolumesFromSnapshotTest-327247759 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.054s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:35:53 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-00c2b055-c16e-48f5-8d5c-6d3011152e26 tempest-CreateVolumesFromSnapshotTest-327247759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9074488f-638c-44d8-a73f-e466055ecd5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c4a487f-e736-454a-88ee-e9c3eb27ed4a', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:35:53 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-00c2b055-c16e-48f5-8d5c-6d3011152e26 tempest-CreateVolumesFromSnapshotTest-327247759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90ff7ac1-47dc-432f-8a67-db0e084b4f6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:35:53 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-00c2b055-c16e-48f5-8d5c-6d3011152e26 tempest-CreateVolumesFromSnapshotTest-327247759 None] Volume volume-2c4a487f-e736-454a-88ee-e9c3eb27ed4a (2c4a487f-e736-454a-88ee-e9c3eb27ed4a): created successfully Jun 29 03:35:53 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-00c2b055-c16e-48f5-8d5c-6d3011152e26 tempest-CreateVolumesFromSnapshotTest-327247759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90ff7ac1-47dc-432f-8a67-db0e084b4f6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:35:53 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-00c2b055-c16e-48f5-8d5c-6d3011152e26 tempest-CreateVolumesFromSnapshotTest-327247759 None] Flow 'volume_create_manager' (a0809a43-75f8-4cb1-b15d-f2e9aede0e8f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:35:53 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-00c2b055-c16e-48f5-8d5c-6d3011152e26 tempest-CreateVolumesFromSnapshotTest-327247759 None] Created volume successfully. Jun 29 03:35:53 devstack cinder-volume[93468]: INFO cinder.volume.manager [req-114bfe73-775e-4684-a36d-21a1f84a742f req-2352472c-8a71-4c9b-b674-f455f260384f tempest-TestServerVolumeAttachmentScenario-226006195 None] Terminate volume connection completed successfully. Jun 29 03:35:53 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [req-114bfe73-775e-4684-a36d-21a1f84a742f req-2352472c-8a71-4c9b-b674-f455f260384f tempest-TestServerVolumeAttachmentScenario-226006195 None] Deleting attachment ac9f0f79-9aa9-4411-9954-4ea0fbb2256a. {{(pid=93468) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 29 03:35:54 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-8e4d2882-3c71-4d93-93db-ac7a00a182a9 tempest-CreateVolumesFromSnapshotTest-327247759 None] Acquiring lock "cinder-2c4a487f-e736-454a-88ee-e9c3eb27ed4a-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:35:54 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-8e4d2882-3c71-4d93-93db-ac7a00a182a9 tempest-CreateVolumesFromSnapshotTest-327247759 None] Lock "cinder-2c4a487f-e736-454a-88ee-e9c3eb27ed4a-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:35:54 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-8e4d2882-3c71-4d93-93db-ac7a00a182a9 tempest-CreateVolumesFromSnapshotTest-327247759 None] Acquiring lock "cinder-quobyte-2c4a487f-e736-454a-88ee-e9c3eb27ed4a" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:35:54 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-8e4d2882-3c71-4d93-93db-ac7a00a182a9 tempest-CreateVolumesFromSnapshotTest-327247759 None] Lock "cinder-quobyte-2c4a487f-e736-454a-88ee-e9c3eb27ed4a" acquired by "delete_volume" :: waited 0.024s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:35:54 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e2fa402-eb23-4240-8df6-caac7d0c1cb4]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:35:54 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-8e4d2882-3c71-4d93-93db-ac7a00a182a9 tempest-CreateVolumesFromSnapshotTest-327247759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-2c4a487f-e736-454a-88ee-e9c3eb27ed4a {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:35:54 devstack sudo[108979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-2c4a487f-e736-454a-88ee-e9c3eb27ed4a Jun 29 03:35:54 devstack sudo[108979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:35:55 devstack sudo[108979]: pam_unix(sudo:session): session closed for user root Jun 29 03:35:55 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-8e4d2882-3c71-4d93-93db-ac7a00a182a9 tempest-CreateVolumesFromSnapshotTest-327247759 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-2c4a487f-e736-454a-88ee-e9c3eb27ed4a" returned: 0 in 0.904s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:35:55 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-8e4d2882-3c71-4d93-93db-ac7a00a182a9 tempest-CreateVolumesFromSnapshotTest-327247759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-2c4a487f-e736-454a-88ee-e9c3eb27ed4a {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:35:55 devstack sudo[108986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-2c4a487f-e736-454a-88ee-e9c3eb27ed4a Jun 29 03:35:55 devstack sudo[108986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:35:56 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e59d1e4-bf45-4aa3-be75-9b4b773b046d tempest-TestServerVolumeAttachScenarioOldVersion-1740801494 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:35:56 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-5e59d1e4-bf45-4aa3-be75-9b4b773b046d tempest-TestServerVolumeAttachScenarioOldVersion-1740801494 None] Flow 'volume_create_manager' (efbd434e-a1c5-4d10-91c4-f45b726f27b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:35:56 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-5e59d1e4-bf45-4aa3-be75-9b4b773b046d tempest-TestServerVolumeAttachScenarioOldVersion-1740801494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (482aba1e-a86d-4795-a891-2ee30b3ad1f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:35:56 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-5e59d1e4-bf45-4aa3-be75-9b4b773b046d tempest-TestServerVolumeAttachScenarioOldVersion-1740801494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (482aba1e-a86d-4795-a891-2ee30b3ad1f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:35:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1566848847',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f82aab9-c1bc-4e7a-af7c-2d1db533e89f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc694271ccd84bd9ad7808bcc98da8f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:35:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:35:56Z,use_quota=True,user_id='79229103a9a944808a8c7788f542adab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:35:56 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-5e59d1e4-bf45-4aa3-be75-9b4b773b046d tempest-TestServerVolumeAttachScenarioOldVersion-1740801494 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (989b15f9-b434-4a32-8991-1adaf6195be0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:35:56 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-5e59d1e4-bf45-4aa3-be75-9b4b773b046d tempest-TestServerVolumeAttachScenarioOldVersion-1740801494 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (989b15f9-b434-4a32-8991-1adaf6195be0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:35:56 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-5e59d1e4-bf45-4aa3-be75-9b4b773b046d tempest-TestServerVolumeAttachScenarioOldVersion-1740801494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (615884b0-85c5-48cc-9af1-4392e6f5c14a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:35:56 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-5e59d1e4-bf45-4aa3-be75-9b4b773b046d tempest-TestServerVolumeAttachScenarioOldVersion-1740801494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (615884b0-85c5-48cc-9af1-4392e6f5c14a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f82aab9-c1bc-4e7a-af7c-2d1db533e89f', 'volume_name': 'volume-9f82aab9-c1bc-4e7a-af7c-2d1db533e89f', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:35:56 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-5e59d1e4-bf45-4aa3-be75-9b4b773b046d tempest-TestServerVolumeAttachScenarioOldVersion-1740801494 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0742c132-4512-4a7c-b8f2-6327e1149dd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:35:56 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-5e59d1e4-bf45-4aa3-be75-9b4b773b046d tempest-TestServerVolumeAttachScenarioOldVersion-1740801494 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0742c132-4512-4a7c-b8f2-6327e1149dd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:35:56 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-5e59d1e4-bf45-4aa3-be75-9b4b773b046d tempest-TestServerVolumeAttachScenarioOldVersion-1740801494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f886d4b-9b32-4e6f-9a3d-039db5a95ea5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:35:56 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-5e59d1e4-bf45-4aa3-be75-9b4b773b046d tempest-TestServerVolumeAttachScenarioOldVersion-1740801494 None] Volume 9f82aab9-c1bc-4e7a-af7c-2d1db533e89f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f82aab9-c1bc-4e7a-af7c-2d1db533e89f', 'volume_size': 1} Jun 29 03:35:56 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-5e59d1e4-bf45-4aa3-be75-9b4b773b046d tempest-TestServerVolumeAttachScenarioOldVersion-1740801494 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:35:56 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-5e59d1e4-bf45-4aa3-be75-9b4b773b046d tempest-TestServerVolumeAttachScenarioOldVersion-1740801494 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:35:56 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-5e59d1e4-bf45-4aa3-be75-9b4b773b046d tempest-TestServerVolumeAttachScenarioOldVersion-1740801494 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:35:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1566848847',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f82aab9-c1bc-4e7a-af7c-2d1db533e89f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc694271ccd84bd9ad7808bcc98da8f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:35:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:35:56Z,use_quota=True,user_id='79229103a9a944808a8c7788f542adab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:35:56 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-5e59d1e4-bf45-4aa3-be75-9b4b773b046d tempest-TestServerVolumeAttachScenarioOldVersion-1740801494 None] Creating volume 9f82aab9-c1bc-4e7a-af7c-2d1db533e89f {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:35:56 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-5e59d1e4-bf45-4aa3-be75-9b4b773b046d tempest-TestServerVolumeAttachScenarioOldVersion-1740801494 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:35:56 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-5e59d1e4-bf45-4aa3-be75-9b4b773b046d tempest-TestServerVolumeAttachScenarioOldVersion-1740801494 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:35:56 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-5e59d1e4-bf45-4aa3-be75-9b4b773b046d tempest-TestServerVolumeAttachScenarioOldVersion-1740801494 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:35:56 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-5e59d1e4-bf45-4aa3-be75-9b4b773b046d tempest-TestServerVolumeAttachScenarioOldVersion-1740801494 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:35:56 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-5e59d1e4-bf45-4aa3-be75-9b4b773b046d tempest-TestServerVolumeAttachScenarioOldVersion-1740801494 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:35:56 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-5e59d1e4-bf45-4aa3-be75-9b4b773b046d tempest-TestServerVolumeAttachScenarioOldVersion-1740801494 None] Selected osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:35:56 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-5e59d1e4-bf45-4aa3-be75-9b4b773b046d tempest-TestServerVolumeAttachScenarioOldVersion-1740801494 None] casted to osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f Jun 29 03:35:56 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-5e59d1e4-bf45-4aa3-be75-9b4b773b046d tempest-TestServerVolumeAttachScenarioOldVersion-1740801494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9f82aab9-c1bc-4e7a-af7c-2d1db533e89f 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:35:56 devstack sudo[108988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9f82aab9-c1bc-4e7a-af7c-2d1db533e89f 1073741824 Jun 29 03:35:56 devstack sudo[108988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:35:56 devstack sudo[108986]: pam_unix(sudo:session): session closed for user root Jun 29 03:35:56 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-8e4d2882-3c71-4d93-93db-ac7a00a182a9 tempest-CreateVolumesFromSnapshotTest-327247759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-2c4a487f-e736-454a-88ee-e9c3eb27ed4a" returned: 0 in 1.120s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:35:56 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-8e4d2882-3c71-4d93-93db-ac7a00a182a9 tempest-CreateVolumesFromSnapshotTest-327247759 None] Lock "cinder-quobyte-2c4a487f-e736-454a-88ee-e9c3eb27ed4a" released by "delete_volume" :: held 2.085s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:35:56 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-8e4d2882-3c71-4d93-93db-ac7a00a182a9 tempest-CreateVolumesFromSnapshotTest-327247759 None] Created reservations ['dcb1f4ca-b03d-4e8c-b182-ec5451979c7f', 'f552866b-2b91-4154-aa8e-89bb0b9c80ba', 'b3f18e94-5904-4589-807e-54e252b57709', '4ec5f6af-14b4-4230-b6cc-b359bd06a99f'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:35:56 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-8e4d2882-3c71-4d93-93db-ac7a00a182a9 tempest-CreateVolumesFromSnapshotTest-327247759 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:35:56 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-8e4d2882-3c71-4d93-93db-ac7a00a182a9 tempest-CreateVolumesFromSnapshotTest-327247759 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:35:56 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-8e4d2882-3c71-4d93-93db-ac7a00a182a9 tempest-CreateVolumesFromSnapshotTest-327247759 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:35:56 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-8e4d2882-3c71-4d93-93db-ac7a00a182a9 tempest-CreateVolumesFromSnapshotTest-327247759 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:35:56 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-8e4d2882-3c71-4d93-93db-ac7a00a182a9 tempest-CreateVolumesFromSnapshotTest-327247759 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:35:56 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-8e4d2882-3c71-4d93-93db-ac7a00a182a9 tempest-CreateVolumesFromSnapshotTest-327247759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:35:56 devstack sudo[108991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf Jun 29 03:35:56 devstack sudo[108991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:35:56 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-c236d586-7cbd-4859-b481-ed3b2ad9358d tempest-CreateVolumesFromSnapshotTest-327247759 None] Acquiring lock "cinder-05e69dfe-9a52-49b5-b924-7644f5a29e23-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:35:56 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-c236d586-7cbd-4859-b481-ed3b2ad9358d tempest-CreateVolumesFromSnapshotTest-327247759 None] Lock "cinder-05e69dfe-9a52-49b5-b924-7644f5a29e23-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:35:57 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-c236d586-7cbd-4859-b481-ed3b2ad9358d tempest-CreateVolumesFromSnapshotTest-327247759 None] Acquiring lock "cinder-quobyte-05e69dfe-9a52-49b5-b924-7644f5a29e23" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:35:57 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-c236d586-7cbd-4859-b481-ed3b2ad9358d tempest-CreateVolumesFromSnapshotTest-327247759 None] Lock "cinder-quobyte-05e69dfe-9a52-49b5-b924-7644f5a29e23" acquired by "delete_volume" :: waited 0.034s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:35:57 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd2bad9f-c2fd-42f9-9f49-afc992cb662e]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:35:57 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c236d586-7cbd-4859-b481-ed3b2ad9358d tempest-CreateVolumesFromSnapshotTest-327247759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-05e69dfe-9a52-49b5-b924-7644f5a29e23 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:35:57 devstack sudo[108993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-05e69dfe-9a52-49b5-b924-7644f5a29e23 Jun 29 03:35:57 devstack sudo[108993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:35:57 devstack sudo[108988]: pam_unix(sudo:session): session closed for user root Jun 29 03:35:57 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-5e59d1e4-bf45-4aa3-be75-9b4b773b046d tempest-TestServerVolumeAttachScenarioOldVersion-1740801494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9f82aab9-c1bc-4e7a-af7c-2d1db533e89f 1073741824" returned: 0 in 1.433s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:35:57 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-5e59d1e4-bf45-4aa3-be75-9b4b773b046d tempest-TestServerVolumeAttachScenarioOldVersion-1740801494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9f82aab9-c1bc-4e7a-af7c-2d1db533e89f {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:35:57 devstack sudo[108991]: pam_unix(sudo:session): session closed for user root Jun 29 03:35:57 devstack sudo[109039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9f82aab9-c1bc-4e7a-af7c-2d1db533e89f Jun 29 03:35:57 devstack sudo[109039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:35:57 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-8e4d2882-3c71-4d93-93db-ac7a00a182a9 tempest-CreateVolumesFromSnapshotTest-327247759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf" returned: 0 in 1.106s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:35:57 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-8e4d2882-3c71-4d93-93db-ac7a00a182a9 tempest-CreateVolumesFromSnapshotTest-327247759 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:35:57 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-8e4d2882-3c71-4d93-93db-ac7a00a182a9 tempest-CreateVolumesFromSnapshotTest-327247759 None] Deleted volume successfully. Jun 29 03:35:57 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-8e4d2882-3c71-4d93-93db-ac7a00a182a9 tempest-CreateVolumesFromSnapshotTest-327247759 None] Lock "cinder-2c4a487f-e736-454a-88ee-e9c3eb27ed4a-delete_volume" released by "delete_volume" :: held 3.488s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:35:58 devstack sudo[108993]: pam_unix(sudo:session): session closed for user root Jun 29 03:35:58 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c236d586-7cbd-4859-b481-ed3b2ad9358d tempest-CreateVolumesFromSnapshotTest-327247759 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-05e69dfe-9a52-49b5-b924-7644f5a29e23" returned: 0 in 1.300s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:35:58 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c236d586-7cbd-4859-b481-ed3b2ad9358d tempest-CreateVolumesFromSnapshotTest-327247759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-05e69dfe-9a52-49b5-b924-7644f5a29e23 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:35:58 devstack sudo[109044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-05e69dfe-9a52-49b5-b924-7644f5a29e23 Jun 29 03:35:58 devstack sudo[109044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:35:58 devstack sudo[109039]: pam_unix(sudo:session): session closed for user root Jun 29 03:35:58 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-5e59d1e4-bf45-4aa3-be75-9b4b773b046d tempest-TestServerVolumeAttachScenarioOldVersion-1740801494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9f82aab9-c1bc-4e7a-af7c-2d1db533e89f" returned: 0 in 0.842s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:35:58 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-5e59d1e4-bf45-4aa3-be75-9b4b773b046d tempest-TestServerVolumeAttachScenarioOldVersion-1740801494 None] <== create_volume: return (2341ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:35:58 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-5e59d1e4-bf45-4aa3-be75-9b4b773b046d tempest-TestServerVolumeAttachScenarioOldVersion-1740801494 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.344s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:35:58 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-5e59d1e4-bf45-4aa3-be75-9b4b773b046d tempest-TestServerVolumeAttachScenarioOldVersion-1740801494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f886d4b-9b32-4e6f-9a3d-039db5a95ea5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f82aab9-c1bc-4e7a-af7c-2d1db533e89f', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:35:58 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-5e59d1e4-bf45-4aa3-be75-9b4b773b046d tempest-TestServerVolumeAttachScenarioOldVersion-1740801494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a320a394-ffc9-4d87-a6bf-4426ffaf9c2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:35:58 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-5e59d1e4-bf45-4aa3-be75-9b4b773b046d tempest-TestServerVolumeAttachScenarioOldVersion-1740801494 None] Volume volume-9f82aab9-c1bc-4e7a-af7c-2d1db533e89f (9f82aab9-c1bc-4e7a-af7c-2d1db533e89f): created successfully Jun 29 03:35:58 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-5e59d1e4-bf45-4aa3-be75-9b4b773b046d tempest-TestServerVolumeAttachScenarioOldVersion-1740801494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a320a394-ffc9-4d87-a6bf-4426ffaf9c2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:35:58 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-5e59d1e4-bf45-4aa3-be75-9b4b773b046d tempest-TestServerVolumeAttachScenarioOldVersion-1740801494 None] Flow 'volume_create_manager' (efbd434e-a1c5-4d10-91c4-f45b726f27b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:35:58 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-5e59d1e4-bf45-4aa3-be75-9b4b773b046d tempest-TestServerVolumeAttachScenarioOldVersion-1740801494 None] Created volume successfully. Jun 29 03:35:59 devstack sudo[109044]: pam_unix(sudo:session): session closed for user root Jun 29 03:35:59 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c236d586-7cbd-4859-b481-ed3b2ad9358d tempest-CreateVolumesFromSnapshotTest-327247759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-05e69dfe-9a52-49b5-b924-7644f5a29e23" returned: 0 in 0.759s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:35:59 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-c236d586-7cbd-4859-b481-ed3b2ad9358d tempest-CreateVolumesFromSnapshotTest-327247759 None] Lock "cinder-quobyte-05e69dfe-9a52-49b5-b924-7644f5a29e23" released by "delete_volume" :: held 2.129s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:35:59 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-c236d586-7cbd-4859-b481-ed3b2ad9358d tempest-CreateVolumesFromSnapshotTest-327247759 None] Created reservations ['05d599bf-d342-4715-835d-ec4aa92ba12c', 'bba28cf9-8118-4a25-8032-82b58ed2a58c', 'd1f9a4b0-d4dd-451b-b10a-c2374a155dfc', 'ae28ed08-28ee-45e1-a62e-7d07f6392833'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:35:59 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-c236d586-7cbd-4859-b481-ed3b2ad9358d tempest-CreateVolumesFromSnapshotTest-327247759 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:35:59 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-c236d586-7cbd-4859-b481-ed3b2ad9358d tempest-CreateVolumesFromSnapshotTest-327247759 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:35:59 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-c236d586-7cbd-4859-b481-ed3b2ad9358d tempest-CreateVolumesFromSnapshotTest-327247759 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:35:59 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-c236d586-7cbd-4859-b481-ed3b2ad9358d tempest-CreateVolumesFromSnapshotTest-327247759 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:35:59 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-c236d586-7cbd-4859-b481-ed3b2ad9358d tempest-CreateVolumesFromSnapshotTest-327247759 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:35:59 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c236d586-7cbd-4859-b481-ed3b2ad9358d tempest-CreateVolumesFromSnapshotTest-327247759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:35:59 devstack sudo[109052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf Jun 29 03:35:59 devstack sudo[109052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:36:00 devstack sudo[109052]: pam_unix(sudo:session): session closed for user root Jun 29 03:36:00 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c236d586-7cbd-4859-b481-ed3b2ad9358d tempest-CreateVolumesFromSnapshotTest-327247759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf" returned: 0 in 0.810s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:36:00 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-c236d586-7cbd-4859-b481-ed3b2ad9358d tempest-CreateVolumesFromSnapshotTest-327247759 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:36:00 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-c236d586-7cbd-4859-b481-ed3b2ad9358d tempest-CreateVolumesFromSnapshotTest-327247759 None] Deleted volume successfully. Jun 29 03:36:00 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-c236d586-7cbd-4859-b481-ed3b2ad9358d tempest-CreateVolumesFromSnapshotTest-327247759 None] Lock "cinder-05e69dfe-9a52-49b5-b924-7644f5a29e23-delete_volume" released by "delete_volume" :: held 3.329s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:36:00 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-c5222710-4fed-4541-87e4-0991fbdd4156 tempest-CreateVolumesFromSnapshotTest-327247759 None] Acquiring lock "cinder-4ffa8a87-6bfc-48ef-8434-65672c742eee-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:36:00 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-c5222710-4fed-4541-87e4-0991fbdd4156 tempest-CreateVolumesFromSnapshotTest-327247759 None] Lock "cinder-4ffa8a87-6bfc-48ef-8434-65672c742eee-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:36:00 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-c5222710-4fed-4541-87e4-0991fbdd4156 tempest-CreateVolumesFromSnapshotTest-327247759 None] Acquiring lock "cinder-quobyte-4ffa8a87-6bfc-48ef-8434-65672c742eee" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:36:00 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-c5222710-4fed-4541-87e4-0991fbdd4156 tempest-CreateVolumesFromSnapshotTest-327247759 None] Lock "cinder-quobyte-4ffa8a87-6bfc-48ef-8434-65672c742eee" acquired by "delete_volume" :: waited 0.016s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:36:00 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[50f08cba-5c5d-4546-8497-1e1233f8cece]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:36:00 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c5222710-4fed-4541-87e4-0991fbdd4156 tempest-CreateVolumesFromSnapshotTest-327247759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-4ffa8a87-6bfc-48ef-8434-65672c742eee {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:36:00 devstack sudo[109060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-4ffa8a87-6bfc-48ef-8434-65672c742eee Jun 29 03:36:00 devstack sudo[109060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:36:01 devstack sudo[109060]: pam_unix(sudo:session): session closed for user root Jun 29 03:36:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c5222710-4fed-4541-87e4-0991fbdd4156 tempest-CreateVolumesFromSnapshotTest-327247759 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-4ffa8a87-6bfc-48ef-8434-65672c742eee" returned: 0 in 0.801s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:36:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c5222710-4fed-4541-87e4-0991fbdd4156 tempest-CreateVolumesFromSnapshotTest-327247759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-4ffa8a87-6bfc-48ef-8434-65672c742eee {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:36:01 devstack sudo[109065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-4ffa8a87-6bfc-48ef-8434-65672c742eee Jun 29 03:36:01 devstack sudo[109065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:36:01 devstack sudo[109065]: pam_unix(sudo:session): session closed for user root Jun 29 03:36:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c5222710-4fed-4541-87e4-0991fbdd4156 tempest-CreateVolumesFromSnapshotTest-327247759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-4ffa8a87-6bfc-48ef-8434-65672c742eee" returned: 0 in 0.672s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:36:01 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-c5222710-4fed-4541-87e4-0991fbdd4156 tempest-CreateVolumesFromSnapshotTest-327247759 None] Lock "cinder-quobyte-4ffa8a87-6bfc-48ef-8434-65672c742eee" released by "delete_volume" :: held 1.519s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:36:02 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-c5222710-4fed-4541-87e4-0991fbdd4156 tempest-CreateVolumesFromSnapshotTest-327247759 None] Created reservations ['4ceae51e-7672-47c1-bc4e-0fcf34a52c1b', '4fd09262-5b07-4696-9522-b65aaef984ff', '932a5360-e8df-4957-b4af-654544f01f22', 'd1cf963b-3607-4083-aa58-be56665e08be'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:36:02 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-c5222710-4fed-4541-87e4-0991fbdd4156 tempest-CreateVolumesFromSnapshotTest-327247759 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:36:02 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-c5222710-4fed-4541-87e4-0991fbdd4156 tempest-CreateVolumesFromSnapshotTest-327247759 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:36:02 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-c5222710-4fed-4541-87e4-0991fbdd4156 tempest-CreateVolumesFromSnapshotTest-327247759 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:36:02 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-c5222710-4fed-4541-87e4-0991fbdd4156 tempest-CreateVolumesFromSnapshotTest-327247759 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:36:02 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-c5222710-4fed-4541-87e4-0991fbdd4156 tempest-CreateVolumesFromSnapshotTest-327247759 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:36:02 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c5222710-4fed-4541-87e4-0991fbdd4156 tempest-CreateVolumesFromSnapshotTest-327247759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:36:02 devstack sudo[109069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf Jun 29 03:36:02 devstack sudo[109069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:36:02 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-06a598db-4779-44f8-9f24-7d1db3deb1aa tempest-CreateVolumesFromSnapshotTest-327247759 None] Acquiring lock "cinder-eeb0ba2f-c4c8-4fcd-a408-56ffe3c4b1f6-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:36:02 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-06a598db-4779-44f8-9f24-7d1db3deb1aa tempest-CreateVolumesFromSnapshotTest-327247759 None] Lock "cinder-eeb0ba2f-c4c8-4fcd-a408-56ffe3c4b1f6-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:36:02 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-06a598db-4779-44f8-9f24-7d1db3deb1aa tempest-CreateVolumesFromSnapshotTest-327247759 None] Acquiring lock "cinder-quobyte-eeb0ba2f-c4c8-4fcd-a408-56ffe3c4b1f6" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:36:02 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-06a598db-4779-44f8-9f24-7d1db3deb1aa tempest-CreateVolumesFromSnapshotTest-327247759 None] Lock "cinder-quobyte-eeb0ba2f-c4c8-4fcd-a408-56ffe3c4b1f6" acquired by "delete_volume" :: waited 0.020s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:36:02 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec862610-e7e9-4ed8-900c-a5c236c62c91]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:36:02 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-06a598db-4779-44f8-9f24-7d1db3deb1aa tempest-CreateVolumesFromSnapshotTest-327247759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-eeb0ba2f-c4c8-4fcd-a408-56ffe3c4b1f6 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:36:02 devstack sudo[109069]: pam_unix(sudo:session): session closed for user root Jun 29 03:36:02 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c5222710-4fed-4541-87e4-0991fbdd4156 tempest-CreateVolumesFromSnapshotTest-327247759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf" returned: 0 in 0.750s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:36:02 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-c5222710-4fed-4541-87e4-0991fbdd4156 tempest-CreateVolumesFromSnapshotTest-327247759 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:36:02 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [req-7e66da17-1e28-405f-aeee-8ba020342690 req-9508ab6f-f89c-4fc7-9886-f210b16a4f76 tempest-TestServerVolumeAttachScenarioOldVersion-1740801494 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:36:02 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [req-7e66da17-1e28-405f-aeee-8ba020342690 req-9508ab6f-f89c-4fc7-9886-f210b16a4f76 tempest-TestServerVolumeAttachScenarioOldVersion-1740801494 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:36:02 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-c5222710-4fed-4541-87e4-0991fbdd4156 tempest-CreateVolumesFromSnapshotTest-327247759 None] Deleted volume successfully. Jun 29 03:36:02 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[47007e9c-3386-4574-a445-49aa317763f8]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:36:02 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [req-7e66da17-1e28-405f-aeee-8ba020342690 req-9508ab6f-f89c-4fc7-9886-f210b16a4f76 tempest-TestServerVolumeAttachScenarioOldVersion-1740801494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9f82aab9-c1bc-4e7a-af7c-2d1db533e89f {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:36:02 devstack sudo[109081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-eeb0ba2f-c4c8-4fcd-a408-56ffe3c4b1f6 Jun 29 03:36:02 devstack sudo[109081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:36:02 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-c5222710-4fed-4541-87e4-0991fbdd4156 tempest-CreateVolumesFromSnapshotTest-327247759 None] Lock "cinder-4ffa8a87-6bfc-48ef-8434-65672c742eee-delete_volume" released by "delete_volume" :: held 2.536s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:36:03 devstack sudo[109083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9f82aab9-c1bc-4e7a-af7c-2d1db533e89f Jun 29 03:36:03 devstack sudo[109083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:36:03 devstack sudo[109081]: pam_unix(sudo:session): session closed for user root Jun 29 03:36:03 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-06a598db-4779-44f8-9f24-7d1db3deb1aa tempest-CreateVolumesFromSnapshotTest-327247759 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-eeb0ba2f-c4c8-4fcd-a408-56ffe3c4b1f6" returned: 0 in 0.985s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:36:03 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-06a598db-4779-44f8-9f24-7d1db3deb1aa tempest-CreateVolumesFromSnapshotTest-327247759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-eeb0ba2f-c4c8-4fcd-a408-56ffe3c4b1f6 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:36:03 devstack sudo[109091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-eeb0ba2f-c4c8-4fcd-a408-56ffe3c4b1f6 Jun 29 03:36:03 devstack sudo[109091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:36:03 devstack sudo[109083]: pam_unix(sudo:session): session closed for user root Jun 29 03:36:03 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [req-7e66da17-1e28-405f-aeee-8ba020342690 req-9508ab6f-f89c-4fc7-9886-f210b16a4f76 tempest-TestServerVolumeAttachScenarioOldVersion-1740801494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9f82aab9-c1bc-4e7a-af7c-2d1db533e89f" returned: 0 in 0.910s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:36:03 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [req-7e66da17-1e28-405f-aeee-8ba020342690 req-9508ab6f-f89c-4fc7-9886-f210b16a4f76 tempest-TestServerVolumeAttachScenarioOldVersion-1740801494 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.958s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:36:03 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [req-7e66da17-1e28-405f-aeee-8ba020342690 req-9508ab6f-f89c-4fc7-9886-f210b16a4f76 tempest-TestServerVolumeAttachScenarioOldVersion-1740801494 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f', 'name': 'volume-9f82aab9-c1bc-4e7a-af7c-2d1db533e89f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4fb3c50b-6afe-40d9-b7db-95129fa79a81', 'enforce_multipath': True} {{(pid=93468) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 29 03:36:03 devstack cinder-volume[93468]: INFO cinder.volume.manager [req-7e66da17-1e28-405f-aeee-8ba020342690 req-9508ab6f-f89c-4fc7-9886-f210b16a4f76 tempest-TestServerVolumeAttachScenarioOldVersion-1740801494 None] attachment_update completed successfully. Jun 29 03:36:04 devstack sudo[109091]: pam_unix(sudo:session): session closed for user root Jun 29 03:36:04 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-06a598db-4779-44f8-9f24-7d1db3deb1aa tempest-CreateVolumesFromSnapshotTest-327247759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-eeb0ba2f-c4c8-4fcd-a408-56ffe3c4b1f6" returned: 0 in 0.849s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:36:04 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-06a598db-4779-44f8-9f24-7d1db3deb1aa tempest-CreateVolumesFromSnapshotTest-327247759 None] Lock "cinder-quobyte-eeb0ba2f-c4c8-4fcd-a408-56ffe3c4b1f6" released by "delete_volume" :: held 1.937s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:36:04 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-06a598db-4779-44f8-9f24-7d1db3deb1aa tempest-CreateVolumesFromSnapshotTest-327247759 None] Created reservations ['ae7af18e-2406-4b83-9a34-6a5aac197cba', '18c6a15a-07a9-4e0d-9e9e-f03eae271eec', 'b4272e07-41aa-40a9-9a40-8a77b30c59d5', 'b0a288a1-1dfb-474b-b61b-cfd28c4c0267'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:36:04 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-06a598db-4779-44f8-9f24-7d1db3deb1aa tempest-CreateVolumesFromSnapshotTest-327247759 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:36:04 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-06a598db-4779-44f8-9f24-7d1db3deb1aa tempest-CreateVolumesFromSnapshotTest-327247759 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:36:04 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-06a598db-4779-44f8-9f24-7d1db3deb1aa tempest-CreateVolumesFromSnapshotTest-327247759 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:36:04 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-06a598db-4779-44f8-9f24-7d1db3deb1aa tempest-CreateVolumesFromSnapshotTest-327247759 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:36:04 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-06a598db-4779-44f8-9f24-7d1db3deb1aa tempest-CreateVolumesFromSnapshotTest-327247759 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:36:04 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-06a598db-4779-44f8-9f24-7d1db3deb1aa tempest-CreateVolumesFromSnapshotTest-327247759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:36:04 devstack sudo[109161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf Jun 29 03:36:04 devstack sudo[109161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:36:04 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-490c7816-9521-483c-8c73-a4d19add1bd6 tempest-CreateVolumesFromSnapshotTest-327247759 None] Acquiring lock "cinder-4af5e047-d147-4c53-9f0d-d40422624148-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:36:04 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-490c7816-9521-483c-8c73-a4d19add1bd6 tempest-CreateVolumesFromSnapshotTest-327247759 None] Lock "cinder-4af5e047-d147-4c53-9f0d-d40422624148-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:36:04 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-490c7816-9521-483c-8c73-a4d19add1bd6 tempest-CreateVolumesFromSnapshotTest-327247759 None] Acquiring lock "cinder-quobyte-4af5e047-d147-4c53-9f0d-d40422624148" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:36:04 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-490c7816-9521-483c-8c73-a4d19add1bd6 tempest-CreateVolumesFromSnapshotTest-327247759 None] Lock "cinder-quobyte-4af5e047-d147-4c53-9f0d-d40422624148" acquired by "delete_volume" :: waited 0.018s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:36:04 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[c17c289c-9508-4684-a274-17d8da253db7]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:36:05 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-490c7816-9521-483c-8c73-a4d19add1bd6 tempest-CreateVolumesFromSnapshotTest-327247759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-4af5e047-d147-4c53-9f0d-d40422624148 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:36:05 devstack sudo[109163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-4af5e047-d147-4c53-9f0d-d40422624148 Jun 29 03:36:05 devstack sudo[109163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:36:05 devstack sudo[109161]: pam_unix(sudo:session): session closed for user root Jun 29 03:36:05 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-06a598db-4779-44f8-9f24-7d1db3deb1aa tempest-CreateVolumesFromSnapshotTest-327247759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf" returned: 0 in 0.966s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:36:05 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-06a598db-4779-44f8-9f24-7d1db3deb1aa tempest-CreateVolumesFromSnapshotTest-327247759 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:36:05 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-06a598db-4779-44f8-9f24-7d1db3deb1aa tempest-CreateVolumesFromSnapshotTest-327247759 None] Deleted volume successfully. Jun 29 03:36:05 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-06a598db-4779-44f8-9f24-7d1db3deb1aa tempest-CreateVolumesFromSnapshotTest-327247759 None] Lock "cinder-eeb0ba2f-c4c8-4fcd-a408-56ffe3c4b1f6-delete_volume" released by "delete_volume" :: held 3.219s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:36:06 devstack sudo[109163]: pam_unix(sudo:session): session closed for user root Jun 29 03:36:06 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-490c7816-9521-483c-8c73-a4d19add1bd6 tempest-CreateVolumesFromSnapshotTest-327247759 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-4af5e047-d147-4c53-9f0d-d40422624148" returned: 0 in 1.192s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:36:06 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-490c7816-9521-483c-8c73-a4d19add1bd6 tempest-CreateVolumesFromSnapshotTest-327247759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-4af5e047-d147-4c53-9f0d-d40422624148 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:36:06 devstack sudo[109505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-4af5e047-d147-4c53-9f0d-d40422624148 Jun 29 03:36:06 devstack sudo[109505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:36:06 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-f0594cfb-0dae-46eb-a252-6d7f6a623c58 tempest-TestServerVolumeAttachmentScenario-226006195 None] Acquiring lock "cinder-527d3e86-7acd-4086-8c2f-cee2a6fe66cd-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:36:06 devstack sudo[109505]: pam_unix(sudo:session): session closed for user root Jun 29 03:36:06 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-f0594cfb-0dae-46eb-a252-6d7f6a623c58 tempest-TestServerVolumeAttachmentScenario-226006195 None] Lock "cinder-527d3e86-7acd-4086-8c2f-cee2a6fe66cd-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:36:06 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-490c7816-9521-483c-8c73-a4d19add1bd6 tempest-CreateVolumesFromSnapshotTest-327247759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-4af5e047-d147-4c53-9f0d-d40422624148" returned: 0 in 0.693s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:36:06 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-490c7816-9521-483c-8c73-a4d19add1bd6 tempest-CreateVolumesFromSnapshotTest-327247759 None] Lock "cinder-quobyte-4af5e047-d147-4c53-9f0d-d40422624148" released by "delete_volume" :: held 1.940s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:36:06 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-f0594cfb-0dae-46eb-a252-6d7f6a623c58 tempest-TestServerVolumeAttachmentScenario-226006195 None] Acquiring lock "cinder-quobyte-527d3e86-7acd-4086-8c2f-cee2a6fe66cd" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:36:06 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-f0594cfb-0dae-46eb-a252-6d7f6a623c58 tempest-TestServerVolumeAttachmentScenario-226006195 None] Lock "cinder-quobyte-527d3e86-7acd-4086-8c2f-cee2a6fe66cd" acquired by "delete_volume" :: waited 0.026s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:36:06 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-490c7816-9521-483c-8c73-a4d19add1bd6 tempest-CreateVolumesFromSnapshotTest-327247759 None] Created reservations ['8519b06e-9e41-49f7-89f9-40736fbebd90', 'b8a1c54e-2559-485a-8c91-0b66fb7754f6', '54d3e34e-483e-4750-a95d-f412ff9c81f1', '23d97e0e-511a-43bd-9907-c35469d7b62f'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:36:06 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c3048e7-aae0-4e58-9589-2eaec0fd2c56]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:36:06 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-f0594cfb-0dae-46eb-a252-6d7f6a623c58 tempest-TestServerVolumeAttachmentScenario-226006195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-527d3e86-7acd-4086-8c2f-cee2a6fe66cd {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:36:07 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-490c7816-9521-483c-8c73-a4d19add1bd6 tempest-CreateVolumesFromSnapshotTest-327247759 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:36:07 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-490c7816-9521-483c-8c73-a4d19add1bd6 tempest-CreateVolumesFromSnapshotTest-327247759 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:36:07 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-490c7816-9521-483c-8c73-a4d19add1bd6 tempest-CreateVolumesFromSnapshotTest-327247759 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:36:07 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-490c7816-9521-483c-8c73-a4d19add1bd6 tempest-CreateVolumesFromSnapshotTest-327247759 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:36:07 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-490c7816-9521-483c-8c73-a4d19add1bd6 tempest-CreateVolumesFromSnapshotTest-327247759 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:36:07 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-490c7816-9521-483c-8c73-a4d19add1bd6 tempest-CreateVolumesFromSnapshotTest-327247759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:36:07 devstack sudo[109508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-527d3e86-7acd-4086-8c2f-cee2a6fe66cd Jun 29 03:36:07 devstack sudo[109508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:36:07 devstack sudo[109509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf Jun 29 03:36:07 devstack sudo[109509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:36:07 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-f900e9c8-6021-41c0-80a9-7b782eaf82ed tempest-CreateVolumesFromSnapshotTest-327247759 None] Acquiring lock "cinder-93667134-ad82-4cce-9730-d260ce764dbf-delete_snapshot" by "delete_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:36:07 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-f900e9c8-6021-41c0-80a9-7b782eaf82ed tempest-CreateVolumesFromSnapshotTest-327247759 None] Lock "cinder-93667134-ad82-4cce-9730-d260ce764dbf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:36:07 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-f900e9c8-6021-41c0-80a9-7b782eaf82ed tempest-CreateVolumesFromSnapshotTest-327247759 None] Acquiring lock "cinder-quobyte-d9896adc-0675-4a21-9cc6-29402635e151" by "delete_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:36:07 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-f900e9c8-6021-41c0-80a9-7b782eaf82ed tempest-CreateVolumesFromSnapshotTest-327247759 None] Lock "cinder-quobyte-d9896adc-0675-4a21-9cc6-29402635e151" acquired by "delete_snapshot" :: waited 0.020s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:36:07 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-f900e9c8-6021-41c0-80a9-7b782eaf82ed tempest-CreateVolumesFromSnapshotTest-327247759 None] Acquiring lock "cinder-quobyte-93667134-ad82-4cce-9730-d260ce764dbf" by "_delete_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:36:07 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-f900e9c8-6021-41c0-80a9-7b782eaf82ed tempest-CreateVolumesFromSnapshotTest-327247759 None] Lock "cinder-quobyte-93667134-ad82-4cce-9730-d260ce764dbf" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:36:07 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-f900e9c8-6021-41c0-80a9-7b782eaf82ed tempest-CreateVolumesFromSnapshotTest-327247759 None] Deleting offline snapshot 93667134-ad82-4cce-9730-d260ce764dbf of volume d9896adc-0675-4a21-9cc6-29402635e151 {{(pid=93468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 29 03:36:07 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-f900e9c8-6021-41c0-80a9-7b782eaf82ed tempest-CreateVolumesFromSnapshotTest-327247759 None] snapshot_file for this snap is: volume-d9896adc-0675-4a21-9cc6-29402635e151.93667134-ad82-4cce-9730-d260ce764dbf {{(pid=93468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 29 03:36:07 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3767bc0-7d57-4a2c-92c1-7b07f155c817]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:36:07 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-f900e9c8-6021-41c0-80a9-7b782eaf82ed tempest-CreateVolumesFromSnapshotTest-327247759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-d9896adc-0675-4a21-9cc6-29402635e151.93667134-ad82-4cce-9730-d260ce764dbf {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:36:07 devstack sudo[109512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-d9896adc-0675-4a21-9cc6-29402635e151.93667134-ad82-4cce-9730-d260ce764dbf Jun 29 03:36:07 devstack sudo[109512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:36:07 devstack sudo[109509]: pam_unix(sudo:session): session closed for user root Jun 29 03:36:07 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-490c7816-9521-483c-8c73-a4d19add1bd6 tempest-CreateVolumesFromSnapshotTest-327247759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf" returned: 0 in 0.725s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:36:07 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-490c7816-9521-483c-8c73-a4d19add1bd6 tempest-CreateVolumesFromSnapshotTest-327247759 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:36:07 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-490c7816-9521-483c-8c73-a4d19add1bd6 tempest-CreateVolumesFromSnapshotTest-327247759 None] Deleted volume successfully. Jun 29 03:36:07 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-490c7816-9521-483c-8c73-a4d19add1bd6 tempest-CreateVolumesFromSnapshotTest-327247759 None] Lock "cinder-4af5e047-d147-4c53-9f0d-d40422624148-delete_volume" released by "delete_volume" :: held 2.947s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:36:07 devstack sudo[109508]: pam_unix(sudo:session): session closed for user root Jun 29 03:36:07 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-f0594cfb-0dae-46eb-a252-6d7f6a623c58 tempest-TestServerVolumeAttachmentScenario-226006195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-527d3e86-7acd-4086-8c2f-cee2a6fe66cd" returned: 0 in 0.884s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:36:07 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-f0594cfb-0dae-46eb-a252-6d7f6a623c58 tempest-TestServerVolumeAttachmentScenario-226006195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-527d3e86-7acd-4086-8c2f-cee2a6fe66cd {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:36:07 devstack sudo[109518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-527d3e86-7acd-4086-8c2f-cee2a6fe66cd Jun 29 03:36:07 devstack sudo[109518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:36:08 devstack sudo[109512]: pam_unix(sudo:session): session closed for user root Jun 29 03:36:08 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-f900e9c8-6021-41c0-80a9-7b782eaf82ed tempest-CreateVolumesFromSnapshotTest-327247759 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-d9896adc-0675-4a21-9cc6-29402635e151.93667134-ad82-4cce-9730-d260ce764dbf" returned: 0 in 0.864s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:36:08 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-f900e9c8-6021-41c0-80a9-7b782eaf82ed tempest-CreateVolumesFromSnapshotTest-327247759 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d9896adc-0675-4a21-9cc6-29402635e151(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93468) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 29 03:36:08 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[9975ac97-ceca-4c97-b667-c18871fbfbe3]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:36:08 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-f900e9c8-6021-41c0-80a9-7b782eaf82ed tempest-CreateVolumesFromSnapshotTest-327247759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-d9896adc-0675-4a21-9cc6-29402635e151 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:36:08 devstack sudo[109524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-d9896adc-0675-4a21-9cc6-29402635e151 Jun 29 03:36:08 devstack sudo[109524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:36:08 devstack sudo[109518]: pam_unix(sudo:session): session closed for user root Jun 29 03:36:08 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-f0594cfb-0dae-46eb-a252-6d7f6a623c58 tempest-TestServerVolumeAttachmentScenario-226006195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-527d3e86-7acd-4086-8c2f-cee2a6fe66cd" returned: 0 in 0.712s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:36:08 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-f0594cfb-0dae-46eb-a252-6d7f6a623c58 tempest-TestServerVolumeAttachmentScenario-226006195 None] Lock "cinder-quobyte-527d3e86-7acd-4086-8c2f-cee2a6fe66cd" released by "delete_volume" :: held 1.642s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:36:08 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-f0594cfb-0dae-46eb-a252-6d7f6a623c58 tempest-TestServerVolumeAttachmentScenario-226006195 None] Created reservations ['f42a96e1-1eb1-445d-a40a-2a27a2d1bc44', 'd9a410f9-19d8-40d6-924f-2b758ae39048', 'b237d06e-b114-4774-88d5-615ef296f1d8', 'b8ccc459-6512-45e2-ab27-c49f3ffb8598'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:36:08 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-f0594cfb-0dae-46eb-a252-6d7f6a623c58 tempest-TestServerVolumeAttachmentScenario-226006195 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:36:08 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-f0594cfb-0dae-46eb-a252-6d7f6a623c58 tempest-TestServerVolumeAttachmentScenario-226006195 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:36:08 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-f0594cfb-0dae-46eb-a252-6d7f6a623c58 tempest-TestServerVolumeAttachmentScenario-226006195 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:36:08 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-f0594cfb-0dae-46eb-a252-6d7f6a623c58 tempest-TestServerVolumeAttachmentScenario-226006195 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:36:08 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-f0594cfb-0dae-46eb-a252-6d7f6a623c58 tempest-TestServerVolumeAttachmentScenario-226006195 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:36:08 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-f0594cfb-0dae-46eb-a252-6d7f6a623c58 tempest-TestServerVolumeAttachmentScenario-226006195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:36:08 devstack sudo[109527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf Jun 29 03:36:08 devstack sudo[109527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:36:09 devstack sudo[109524]: pam_unix(sudo:session): session closed for user root Jun 29 03:36:09 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-f900e9c8-6021-41c0-80a9-7b782eaf82ed tempest-CreateVolumesFromSnapshotTest-327247759 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-d9896adc-0675-4a21-9cc6-29402635e151" returned: 0 in 0.877s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:36:09 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-f900e9c8-6021-41c0-80a9-7b782eaf82ed tempest-CreateVolumesFromSnapshotTest-327247759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-d9896adc-0675-4a21-9cc6-29402635e151.93667134-ad82-4cce-9730-d260ce764dbf {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:36:09 devstack sudo[109533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-d9896adc-0675-4a21-9cc6-29402635e151.93667134-ad82-4cce-9730-d260ce764dbf Jun 29 03:36:09 devstack sudo[109533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:36:09 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-cf3341e9-cca4-442e-8f04-2a43b1c56155 tempest-TestServerVolumeAttachmentScenario-226006195 None] Acquiring lock "cinder-0b36bdc7-f9a1-482b-9c27-f362183e0d66-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:36:09 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-cf3341e9-cca4-442e-8f04-2a43b1c56155 tempest-TestServerVolumeAttachmentScenario-226006195 None] Lock "cinder-0b36bdc7-f9a1-482b-9c27-f362183e0d66-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:36:09 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-cf3341e9-cca4-442e-8f04-2a43b1c56155 tempest-TestServerVolumeAttachmentScenario-226006195 None] Acquiring lock "cinder-quobyte-0b36bdc7-f9a1-482b-9c27-f362183e0d66" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:36:09 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-cf3341e9-cca4-442e-8f04-2a43b1c56155 tempest-TestServerVolumeAttachmentScenario-226006195 None] Lock "cinder-quobyte-0b36bdc7-f9a1-482b-9c27-f362183e0d66" acquired by "delete_volume" :: waited 0.022s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:36:09 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[149ee2ee-e215-4f1f-a574-1525252d021c]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:36:09 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-cf3341e9-cca4-442e-8f04-2a43b1c56155 tempest-TestServerVolumeAttachmentScenario-226006195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-0b36bdc7-f9a1-482b-9c27-f362183e0d66 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:36:09 devstack sudo[109535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-0b36bdc7-f9a1-482b-9c27-f362183e0d66 Jun 29 03:36:09 devstack sudo[109535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:36:09 devstack sudo[109527]: pam_unix(sudo:session): session closed for user root Jun 29 03:36:09 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-f0594cfb-0dae-46eb-a252-6d7f6a623c58 tempest-TestServerVolumeAttachmentScenario-226006195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf" returned: 0 in 0.817s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:36:09 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-f0594cfb-0dae-46eb-a252-6d7f6a623c58 tempest-TestServerVolumeAttachmentScenario-226006195 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:36:09 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-f0594cfb-0dae-46eb-a252-6d7f6a623c58 tempest-TestServerVolumeAttachmentScenario-226006195 None] Deleted volume successfully. Jun 29 03:36:09 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-f0594cfb-0dae-46eb-a252-6d7f6a623c58 tempest-TestServerVolumeAttachmentScenario-226006195 None] Lock "cinder-527d3e86-7acd-4086-8c2f-cee2a6fe66cd-delete_volume" released by "delete_volume" :: held 2.730s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:36:09 devstack sudo[109533]: pam_unix(sudo:session): session closed for user root Jun 29 03:36:09 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-f900e9c8-6021-41c0-80a9-7b782eaf82ed tempest-CreateVolumesFromSnapshotTest-327247759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-d9896adc-0675-4a21-9cc6-29402635e151.93667134-ad82-4cce-9730-d260ce764dbf" returned: 0 in 0.946s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:36:09 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-f900e9c8-6021-41c0-80a9-7b782eaf82ed tempest-CreateVolumesFromSnapshotTest-327247759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-d9896adc-0675-4a21-9cc6-29402635e151.93667134-ad82-4cce-9730-d260ce764dbf {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:36:10 devstack sudo[109545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-d9896adc-0675-4a21-9cc6-29402635e151.93667134-ad82-4cce-9730-d260ce764dbf Jun 29 03:36:10 devstack sudo[109545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:36:10 devstack sudo[109535]: pam_unix(sudo:session): session closed for user root Jun 29 03:36:10 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-cf3341e9-cca4-442e-8f04-2a43b1c56155 tempest-TestServerVolumeAttachmentScenario-226006195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-0b36bdc7-f9a1-482b-9c27-f362183e0d66" returned: 0 in 0.967s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:36:10 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-cf3341e9-cca4-442e-8f04-2a43b1c56155 tempest-TestServerVolumeAttachmentScenario-226006195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-0b36bdc7-f9a1-482b-9c27-f362183e0d66 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:36:10 devstack sudo[109550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-0b36bdc7-f9a1-482b-9c27-f362183e0d66 Jun 29 03:36:10 devstack sudo[109550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:36:10 devstack sudo[109545]: pam_unix(sudo:session): session closed for user root Jun 29 03:36:10 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-f900e9c8-6021-41c0-80a9-7b782eaf82ed tempest-CreateVolumesFromSnapshotTest-327247759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-d9896adc-0675-4a21-9cc6-29402635e151.93667134-ad82-4cce-9730-d260ce764dbf" returned: 0 in 0.674s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:36:10 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-f900e9c8-6021-41c0-80a9-7b782eaf82ed tempest-CreateVolumesFromSnapshotTest-327247759 None] Lock "cinder-quobyte-93667134-ad82-4cce-9730-d260ce764dbf" released by "_delete_snapshot" :: held 3.467s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:36:10 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-f900e9c8-6021-41c0-80a9-7b782eaf82ed tempest-CreateVolumesFromSnapshotTest-327247759 None] Lock "cinder-quobyte-d9896adc-0675-4a21-9cc6-29402635e151" released by "delete_snapshot" :: held 3.491s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:36:10 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-f900e9c8-6021-41c0-80a9-7b782eaf82ed tempest-CreateVolumesFromSnapshotTest-327247759 None] Created reservations ['aec2e72c-948f-41ba-930c-97d9998c4ac7', '0709b2b3-d389-40f0-8a2e-f5d7ada281db', 'a87861bb-d7fe-4b07-9e73-f50c0864cb9d', '61c40390-975b-44fb-925b-73561b3b4831'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:36:10 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-f900e9c8-6021-41c0-80a9-7b782eaf82ed tempest-CreateVolumesFromSnapshotTest-327247759 None] Delete snapshot completed successfully. Jun 29 03:36:10 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-f900e9c8-6021-41c0-80a9-7b782eaf82ed tempest-CreateVolumesFromSnapshotTest-327247759 None] Lock "cinder-93667134-ad82-4cce-9730-d260ce764dbf-delete_snapshot" released by "delete_snapshot" :: held 3.630s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:36:10 devstack sudo[109550]: pam_unix(sudo:session): session closed for user root Jun 29 03:36:10 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-cf3341e9-cca4-442e-8f04-2a43b1c56155 tempest-TestServerVolumeAttachmentScenario-226006195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-0b36bdc7-f9a1-482b-9c27-f362183e0d66" returned: 0 in 0.677s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:36:10 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-cf3341e9-cca4-442e-8f04-2a43b1c56155 tempest-TestServerVolumeAttachmentScenario-226006195 None] Lock "cinder-quobyte-0b36bdc7-f9a1-482b-9c27-f362183e0d66" released by "delete_volume" :: held 1.694s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:36:11 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-cf3341e9-cca4-442e-8f04-2a43b1c56155 tempest-TestServerVolumeAttachmentScenario-226006195 None] Created reservations ['e1dce0e9-1611-4e6b-8252-34d300eef078', '13d974ea-7f72-419d-8250-96eb239b447a', '6db765a2-d7d3-4a27-ae6f-e33679d6b2b5', '16a0bc39-cbcd-4031-96e8-1e42c138d945'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:36:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-cf3341e9-cca4-442e-8f04-2a43b1c56155 tempest-TestServerVolumeAttachmentScenario-226006195 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:36:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-cf3341e9-cca4-442e-8f04-2a43b1c56155 tempest-TestServerVolumeAttachmentScenario-226006195 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:36:11 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-cf3341e9-cca4-442e-8f04-2a43b1c56155 tempest-TestServerVolumeAttachmentScenario-226006195 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:36:11 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-cf3341e9-cca4-442e-8f04-2a43b1c56155 tempest-TestServerVolumeAttachmentScenario-226006195 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:36:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-cf3341e9-cca4-442e-8f04-2a43b1c56155 tempest-TestServerVolumeAttachmentScenario-226006195 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:36:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-cf3341e9-cca4-442e-8f04-2a43b1c56155 tempest-TestServerVolumeAttachmentScenario-226006195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:36:11 devstack sudo[109557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf Jun 29 03:36:11 devstack sudo[109557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:36:11 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-3086f6ce-f56b-4cbf-b650-2dcacdcf272f tempest-CreateVolumesFromSnapshotTest-327247759 None] Acquiring lock "cinder-d9896adc-0675-4a21-9cc6-29402635e151-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:36:11 devstack cinder-volume[93468]: INFO cinder.volume.manager [req-9e70d26f-8883-48ce-8c80-0a3cc843004d req-54cc0f27-5deb-4afd-ab9a-af7bb8ea8989 tempest-TestServerVolumeAttachScenarioOldVersion-1740801494 None] Terminate volume connection completed successfully. Jun 29 03:36:11 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [req-9e70d26f-8883-48ce-8c80-0a3cc843004d req-54cc0f27-5deb-4afd-ab9a-af7bb8ea8989 tempest-TestServerVolumeAttachScenarioOldVersion-1740801494 None] Deleting attachment 4fb3c50b-6afe-40d9-b7db-95129fa79a81. {{(pid=93468) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 29 03:36:11 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-3086f6ce-f56b-4cbf-b650-2dcacdcf272f tempest-CreateVolumesFromSnapshotTest-327247759 None] Lock "cinder-d9896adc-0675-4a21-9cc6-29402635e151-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:36:11 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-3086f6ce-f56b-4cbf-b650-2dcacdcf272f tempest-CreateVolumesFromSnapshotTest-327247759 None] Acquiring lock "cinder-quobyte-d9896adc-0675-4a21-9cc6-29402635e151" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:36:11 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-3086f6ce-f56b-4cbf-b650-2dcacdcf272f tempest-CreateVolumesFromSnapshotTest-327247759 None] Lock "cinder-quobyte-d9896adc-0675-4a21-9cc6-29402635e151" acquired by "delete_volume" :: waited 0.032s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:36:11 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[97225e9e-8524-466f-97bc-b648a2e7b195]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:36:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-3086f6ce-f56b-4cbf-b650-2dcacdcf272f tempest-CreateVolumesFromSnapshotTest-327247759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-d9896adc-0675-4a21-9cc6-29402635e151 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:36:11 devstack cinder-volume[93468]: DEBUG oslo_service.periodic_task [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93468) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 29 03:36:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:36:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:36:11 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:36:11 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:36:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:36:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:36:11 devstack sudo[109597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-d9896adc-0675-4a21-9cc6-29402635e151 Jun 29 03:36:11 devstack sudo[109597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:36:11 devstack sudo[109603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf Jun 29 03:36:11 devstack sudo[109603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:36:12 devstack sudo[109557]: pam_unix(sudo:session): session closed for user root Jun 29 03:36:12 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-cf3341e9-cca4-442e-8f04-2a43b1c56155 tempest-TestServerVolumeAttachmentScenario-226006195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf" returned: 0 in 0.988s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:36:12 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-cf3341e9-cca4-442e-8f04-2a43b1c56155 tempest-TestServerVolumeAttachmentScenario-226006195 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:36:12 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-cf3341e9-cca4-442e-8f04-2a43b1c56155 tempest-TestServerVolumeAttachmentScenario-226006195 None] Deleted volume successfully. Jun 29 03:36:12 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-cf3341e9-cca4-442e-8f04-2a43b1c56155 tempest-TestServerVolumeAttachmentScenario-226006195 None] Lock "cinder-0b36bdc7-f9a1-482b-9c27-f362183e0d66-delete_volume" released by "delete_volume" :: held 2.971s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:36:13 devstack sudo[109597]: pam_unix(sudo:session): session closed for user root Jun 29 03:36:13 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-3086f6ce-f56b-4cbf-b650-2dcacdcf272f tempest-CreateVolumesFromSnapshotTest-327247759 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-d9896adc-0675-4a21-9cc6-29402635e151" returned: 0 in 1.711s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:36:13 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-3086f6ce-f56b-4cbf-b650-2dcacdcf272f tempest-CreateVolumesFromSnapshotTest-327247759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-d9896adc-0675-4a21-9cc6-29402635e151 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:36:13 devstack sudo[109674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-d9896adc-0675-4a21-9cc6-29402635e151 Jun 29 03:36:13 devstack sudo[109674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:36:13 devstack sudo[109603]: pam_unix(sudo:session): session closed for user root Jun 29 03:36:13 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf" returned: 0 in 1.756s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:36:13 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:36:13 devstack cinder-volume[93468]: DEBUG oslo_service.periodic_task [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Running periodic task VolumeManager._thread_info {{(pid=93468) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 29 03:36:13 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] thread count: 28 {{(pid=93468) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 29 03:36:13 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] thread info: [<_MainThread(MainThread, started 132331377287296)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93468) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 29 03:36:13 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-cd127587-ad11-4b29-9334-737a37fd8391 tempest-TestServerVolumeAttachScenarioOldVersion-1740801494 None] Acquiring lock "cinder-9f82aab9-c1bc-4e7a-af7c-2d1db533e89f-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:36:13 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-cd127587-ad11-4b29-9334-737a37fd8391 tempest-TestServerVolumeAttachScenarioOldVersion-1740801494 None] Lock "cinder-9f82aab9-c1bc-4e7a-af7c-2d1db533e89f-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:36:13 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-cd127587-ad11-4b29-9334-737a37fd8391 tempest-TestServerVolumeAttachScenarioOldVersion-1740801494 None] Acquiring lock "cinder-quobyte-9f82aab9-c1bc-4e7a-af7c-2d1db533e89f" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:36:14 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-cd127587-ad11-4b29-9334-737a37fd8391 tempest-TestServerVolumeAttachScenarioOldVersion-1740801494 None] Lock "cinder-quobyte-9f82aab9-c1bc-4e7a-af7c-2d1db533e89f" acquired by "delete_volume" :: waited 0.032s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:36:14 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3922e71-2ec0-459b-91d5-2f634aa5ef63]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:36:14 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-cd127587-ad11-4b29-9334-737a37fd8391 tempest-TestServerVolumeAttachScenarioOldVersion-1740801494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9f82aab9-c1bc-4e7a-af7c-2d1db533e89f {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:36:14 devstack sudo[109683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9f82aab9-c1bc-4e7a-af7c-2d1db533e89f Jun 29 03:36:14 devstack sudo[109683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:36:14 devstack sudo[109674]: pam_unix(sudo:session): session closed for user root Jun 29 03:36:14 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-3086f6ce-f56b-4cbf-b650-2dcacdcf272f tempest-CreateVolumesFromSnapshotTest-327247759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-d9896adc-0675-4a21-9cc6-29402635e151" returned: 0 in 0.979s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:36:14 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-3086f6ce-f56b-4cbf-b650-2dcacdcf272f tempest-CreateVolumesFromSnapshotTest-327247759 None] Lock "cinder-quobyte-d9896adc-0675-4a21-9cc6-29402635e151" released by "delete_volume" :: held 2.809s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:36:14 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-3086f6ce-f56b-4cbf-b650-2dcacdcf272f tempest-CreateVolumesFromSnapshotTest-327247759 None] Created reservations ['fdcfa862-cf97-4d74-b8cd-511433212ff2', '68aa6684-6dca-44ad-81c4-4a9a35895adc', '0660d24f-79f4-4dfa-85b0-785c71fddac7', '245fd45b-f3ad-4c38-9413-9c1ed18d90f6'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:36:14 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-3086f6ce-f56b-4cbf-b650-2dcacdcf272f tempest-CreateVolumesFromSnapshotTest-327247759 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:36:14 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-3086f6ce-f56b-4cbf-b650-2dcacdcf272f tempest-CreateVolumesFromSnapshotTest-327247759 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:36:14 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-3086f6ce-f56b-4cbf-b650-2dcacdcf272f tempest-CreateVolumesFromSnapshotTest-327247759 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:36:14 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-3086f6ce-f56b-4cbf-b650-2dcacdcf272f tempest-CreateVolumesFromSnapshotTest-327247759 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:36:14 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-3086f6ce-f56b-4cbf-b650-2dcacdcf272f tempest-CreateVolumesFromSnapshotTest-327247759 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:36:14 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-3086f6ce-f56b-4cbf-b650-2dcacdcf272f tempest-CreateVolumesFromSnapshotTest-327247759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:36:15 devstack sudo[109699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf Jun 29 03:36:15 devstack sudo[109699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:36:15 devstack sudo[109683]: pam_unix(sudo:session): session closed for user root Jun 29 03:36:15 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-cd127587-ad11-4b29-9334-737a37fd8391 tempest-TestServerVolumeAttachScenarioOldVersion-1740801494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9f82aab9-c1bc-4e7a-af7c-2d1db533e89f" returned: 0 in 1.601s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:36:15 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-cd127587-ad11-4b29-9334-737a37fd8391 tempest-TestServerVolumeAttachScenarioOldVersion-1740801494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9f82aab9-c1bc-4e7a-af7c-2d1db533e89f {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:36:15 devstack sudo[109707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9f82aab9-c1bc-4e7a-af7c-2d1db533e89f Jun 29 03:36:15 devstack sudo[109707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:36:16 devstack sudo[109699]: pam_unix(sudo:session): session closed for user root Jun 29 03:36:16 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-3086f6ce-f56b-4cbf-b650-2dcacdcf272f tempest-CreateVolumesFromSnapshotTest-327247759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf" returned: 0 in 1.405s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:36:16 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-3086f6ce-f56b-4cbf-b650-2dcacdcf272f tempest-CreateVolumesFromSnapshotTest-327247759 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:36:16 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-3086f6ce-f56b-4cbf-b650-2dcacdcf272f tempest-CreateVolumesFromSnapshotTest-327247759 None] Deleted volume successfully. Jun 29 03:36:16 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-3086f6ce-f56b-4cbf-b650-2dcacdcf272f tempest-CreateVolumesFromSnapshotTest-327247759 None] Lock "cinder-d9896adc-0675-4a21-9cc6-29402635e151-delete_volume" released by "delete_volume" :: held 4.866s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:36:17 devstack sudo[109707]: pam_unix(sudo:session): session closed for user root Jun 29 03:36:17 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-cd127587-ad11-4b29-9334-737a37fd8391 tempest-TestServerVolumeAttachScenarioOldVersion-1740801494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9f82aab9-c1bc-4e7a-af7c-2d1db533e89f" returned: 0 in 1.572s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:36:17 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-cd127587-ad11-4b29-9334-737a37fd8391 tempest-TestServerVolumeAttachScenarioOldVersion-1740801494 None] Lock "cinder-quobyte-9f82aab9-c1bc-4e7a-af7c-2d1db533e89f" released by "delete_volume" :: held 3.250s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:36:17 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-cd127587-ad11-4b29-9334-737a37fd8391 tempest-TestServerVolumeAttachScenarioOldVersion-1740801494 None] Created reservations ['73f86546-5f32-47d5-98b2-b0a49454f1b5', '5bec4249-94d9-4cb9-8171-9cc8a59627dc', '9bf004ea-8a0c-49ba-8cd0-459eb5035cf0', '6f2c83a4-5472-473e-aef2-708a9ab35d95'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:36:17 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-cd127587-ad11-4b29-9334-737a37fd8391 tempest-TestServerVolumeAttachScenarioOldVersion-1740801494 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:36:17 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-cd127587-ad11-4b29-9334-737a37fd8391 tempest-TestServerVolumeAttachScenarioOldVersion-1740801494 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:36:17 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-cd127587-ad11-4b29-9334-737a37fd8391 tempest-TestServerVolumeAttachScenarioOldVersion-1740801494 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:36:17 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-cd127587-ad11-4b29-9334-737a37fd8391 tempest-TestServerVolumeAttachScenarioOldVersion-1740801494 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:36:17 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-cd127587-ad11-4b29-9334-737a37fd8391 tempest-TestServerVolumeAttachScenarioOldVersion-1740801494 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:36:17 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-cd127587-ad11-4b29-9334-737a37fd8391 tempest-TestServerVolumeAttachScenarioOldVersion-1740801494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:36:17 devstack sudo[109713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf Jun 29 03:36:17 devstack sudo[109713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:36:18 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd28f394-c520-49e6-a393-b3f5467f9eb6 tempest-VolumesActionsTest-613223606 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:36:18 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-cd28f394-c520-49e6-a393-b3f5467f9eb6 tempest-VolumesActionsTest-613223606 None] Flow 'volume_create_manager' (5e5e4a5c-bf51-4c34-a695-5e23c1f11d46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:36:18 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-cd28f394-c520-49e6-a393-b3f5467f9eb6 tempest-VolumesActionsTest-613223606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a571310c-daf5-4674-82e0-a03cab33214f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:36:18 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-cd28f394-c520-49e6-a393-b3f5467f9eb6 tempest-VolumesActionsTest-613223606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a571310c-daf5-4674-82e0-a03cab33214f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:36:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1731329939',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e65c505-5170-4bfe-85a8-2952bb954ed1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1532758db6b54b66a2e5c4709e8cfdf7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:36:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:36:19Z,use_quota=True,user_id='b5900938aa1642a58d248cc9fd4c336a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:36:18 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-cd28f394-c520-49e6-a393-b3f5467f9eb6 tempest-VolumesActionsTest-613223606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c0f34f5-ab6d-4f6e-a155-2d0f5acd29f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:36:18 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-cd28f394-c520-49e6-a393-b3f5467f9eb6 tempest-VolumesActionsTest-613223606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c0f34f5-ab6d-4f6e-a155-2d0f5acd29f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:36:18 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-cd28f394-c520-49e6-a393-b3f5467f9eb6 tempest-VolumesActionsTest-613223606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36202647-7cf0-48b6-ac9a-5b55c729c45e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:36:18 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-cd28f394-c520-49e6-a393-b3f5467f9eb6 tempest-VolumesActionsTest-613223606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36202647-7cf0-48b6-ac9a-5b55c729c45e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e65c505-5170-4bfe-85a8-2952bb954ed1', 'volume_name': 'volume-5e65c505-5170-4bfe-85a8-2952bb954ed1', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:36:18 devstack sudo[109713]: pam_unix(sudo:session): session closed for user root Jun 29 03:36:18 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-cd28f394-c520-49e6-a393-b3f5467f9eb6 tempest-VolumesActionsTest-613223606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58a61cf6-c56f-4f1c-a792-b148ba5131a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:36:18 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-cd28f394-c520-49e6-a393-b3f5467f9eb6 tempest-VolumesActionsTest-613223606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58a61cf6-c56f-4f1c-a792-b148ba5131a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:36:18 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-cd28f394-c520-49e6-a393-b3f5467f9eb6 tempest-VolumesActionsTest-613223606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cacc462e-1665-41bd-a12d-4ff769f10388) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:36:18 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-cd28f394-c520-49e6-a393-b3f5467f9eb6 tempest-VolumesActionsTest-613223606 None] Volume 5e65c505-5170-4bfe-85a8-2952bb954ed1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e65c505-5170-4bfe-85a8-2952bb954ed1', 'volume_size': 1} Jun 29 03:36:18 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-cd28f394-c520-49e6-a393-b3f5467f9eb6 tempest-VolumesActionsTest-613223606 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:36:18 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-cd28f394-c520-49e6-a393-b3f5467f9eb6 tempest-VolumesActionsTest-613223606 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:36:18 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-cd28f394-c520-49e6-a393-b3f5467f9eb6 tempest-VolumesActionsTest-613223606 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:36:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1731329939',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e65c505-5170-4bfe-85a8-2952bb954ed1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1532758db6b54b66a2e5c4709e8cfdf7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:36:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:36:19Z,use_quota=True,user_id='b5900938aa1642a58d248cc9fd4c336a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:36:18 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-cd28f394-c520-49e6-a393-b3f5467f9eb6 tempest-VolumesActionsTest-613223606 None] Creating volume 5e65c505-5170-4bfe-85a8-2952bb954ed1 {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:36:18 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-cd28f394-c520-49e6-a393-b3f5467f9eb6 tempest-VolumesActionsTest-613223606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:36:18 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-cd28f394-c520-49e6-a393-b3f5467f9eb6 tempest-VolumesActionsTest-613223606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:36:18 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-cd28f394-c520-49e6-a393-b3f5467f9eb6 tempest-VolumesActionsTest-613223606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:36:18 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-cd28f394-c520-49e6-a393-b3f5467f9eb6 tempest-VolumesActionsTest-613223606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:36:18 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-cd28f394-c520-49e6-a393-b3f5467f9eb6 tempest-VolumesActionsTest-613223606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:36:18 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-cd28f394-c520-49e6-a393-b3f5467f9eb6 tempest-VolumesActionsTest-613223606 None] Selected osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:36:19 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-cd28f394-c520-49e6-a393-b3f5467f9eb6 tempest-VolumesActionsTest-613223606 None] casted to osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f Jun 29 03:36:19 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-cd28f394-c520-49e6-a393-b3f5467f9eb6 tempest-VolumesActionsTest-613223606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-5e65c505-5170-4bfe-85a8-2952bb954ed1 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:36:19 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-cd127587-ad11-4b29-9334-737a37fd8391 tempest-TestServerVolumeAttachScenarioOldVersion-1740801494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf" returned: 0 in 1.390s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:36:19 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-cd127587-ad11-4b29-9334-737a37fd8391 tempest-TestServerVolumeAttachScenarioOldVersion-1740801494 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:36:19 devstack sudo[109716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-5e65c505-5170-4bfe-85a8-2952bb954ed1 1073741824 Jun 29 03:36:19 devstack sudo[109716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:36:19 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-cd127587-ad11-4b29-9334-737a37fd8391 tempest-TestServerVolumeAttachScenarioOldVersion-1740801494 None] Deleted volume successfully. Jun 29 03:36:19 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-cd127587-ad11-4b29-9334-737a37fd8391 tempest-TestServerVolumeAttachScenarioOldVersion-1740801494 None] Lock "cinder-9f82aab9-c1bc-4e7a-af7c-2d1db533e89f-delete_volume" released by "delete_volume" :: held 5.294s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:36:20 devstack sudo[109716]: pam_unix(sudo:session): session closed for user root Jun 29 03:36:20 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-cd28f394-c520-49e6-a393-b3f5467f9eb6 tempest-VolumesActionsTest-613223606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-5e65c505-5170-4bfe-85a8-2952bb954ed1 1073741824" returned: 0 in 1.898s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:36:20 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7a06a6d-12fb-4e13-ba71-b36ee49f157c tempest-VolumeDependencyTests-1733539683 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:36:21 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-a7a06a6d-12fb-4e13-ba71-b36ee49f157c tempest-VolumeDependencyTests-1733539683 None] Flow 'volume_create_manager' (8c1895e7-5b67-419b-9b33-df46e5fb8bb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:36:21 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-a7a06a6d-12fb-4e13-ba71-b36ee49f157c tempest-VolumeDependencyTests-1733539683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a54fba78-9717-40cf-82da-8acebb2af9c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:36:21 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-cd28f394-c520-49e6-a393-b3f5467f9eb6 tempest-VolumesActionsTest-613223606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-5e65c505-5170-4bfe-85a8-2952bb954ed1 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:36:21 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-a7a06a6d-12fb-4e13-ba71-b36ee49f157c tempest-VolumeDependencyTests-1733539683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a54fba78-9717-40cf-82da-8acebb2af9c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:36:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-952824920',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b8cf38d-60ae-44a6-8b53-18a28ceddd88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a3f32611ff745e989667bec24d17a30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:36:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:36:21Z,use_quota=True,user_id='898654a3cb7147cabc25f1d2cd3d9fef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:36:21 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-a7a06a6d-12fb-4e13-ba71-b36ee49f157c tempest-VolumeDependencyTests-1733539683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e50da881-f74f-40fc-8be3-64798763cc3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:36:21 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-a7a06a6d-12fb-4e13-ba71-b36ee49f157c tempest-VolumeDependencyTests-1733539683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e50da881-f74f-40fc-8be3-64798763cc3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:36:21 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-a7a06a6d-12fb-4e13-ba71-b36ee49f157c tempest-VolumeDependencyTests-1733539683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b5e2071-4a42-4604-9843-2a79dfde4a4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:36:21 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-a7a06a6d-12fb-4e13-ba71-b36ee49f157c tempest-VolumeDependencyTests-1733539683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b5e2071-4a42-4604-9843-2a79dfde4a4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b8cf38d-60ae-44a6-8b53-18a28ceddd88', 'volume_name': 'volume-1b8cf38d-60ae-44a6-8b53-18a28ceddd88', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:36:21 devstack sudo[109765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-5e65c505-5170-4bfe-85a8-2952bb954ed1 Jun 29 03:36:21 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-a7a06a6d-12fb-4e13-ba71-b36ee49f157c tempest-VolumeDependencyTests-1733539683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79d66255-f1bf-4c26-bafb-bc24411f6769) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:36:21 devstack sudo[109765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:36:21 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-a7a06a6d-12fb-4e13-ba71-b36ee49f157c tempest-VolumeDependencyTests-1733539683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79d66255-f1bf-4c26-bafb-bc24411f6769) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:36:21 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-a7a06a6d-12fb-4e13-ba71-b36ee49f157c tempest-VolumeDependencyTests-1733539683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc90e855-77b9-47e8-afe5-cc1605169d96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:36:21 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-a7a06a6d-12fb-4e13-ba71-b36ee49f157c tempest-VolumeDependencyTests-1733539683 None] Volume 1b8cf38d-60ae-44a6-8b53-18a28ceddd88: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b8cf38d-60ae-44a6-8b53-18a28ceddd88', 'volume_size': 1} Jun 29 03:36:21 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-a7a06a6d-12fb-4e13-ba71-b36ee49f157c tempest-VolumeDependencyTests-1733539683 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:36:22 devstack sudo[109765]: pam_unix(sudo:session): session closed for user root Jun 29 03:36:22 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-cd28f394-c520-49e6-a393-b3f5467f9eb6 tempest-VolumesActionsTest-613223606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-5e65c505-5170-4bfe-85a8-2952bb954ed1" returned: 0 in 1.042s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:36:22 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-cd28f394-c520-49e6-a393-b3f5467f9eb6 tempest-VolumesActionsTest-613223606 None] <== create_volume: return (3125ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:36:22 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-cd28f394-c520-49e6-a393-b3f5467f9eb6 tempest-VolumesActionsTest-613223606 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.131s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:36:22 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-a7a06a6d-12fb-4e13-ba71-b36ee49f157c tempest-VolumeDependencyTests-1733539683 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.900s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:36:22 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-a7a06a6d-12fb-4e13-ba71-b36ee49f157c tempest-VolumeDependencyTests-1733539683 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:36:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-952824920',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b8cf38d-60ae-44a6-8b53-18a28ceddd88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a3f32611ff745e989667bec24d17a30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:36:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:36:21Z,use_quota=True,user_id='898654a3cb7147cabc25f1d2cd3d9fef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:36:22 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-a7a06a6d-12fb-4e13-ba71-b36ee49f157c tempest-VolumeDependencyTests-1733539683 None] Creating volume 1b8cf38d-60ae-44a6-8b53-18a28ceddd88 {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:36:22 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-a7a06a6d-12fb-4e13-ba71-b36ee49f157c tempest-VolumeDependencyTests-1733539683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:36:22 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-a7a06a6d-12fb-4e13-ba71-b36ee49f157c tempest-VolumeDependencyTests-1733539683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:36:22 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-a7a06a6d-12fb-4e13-ba71-b36ee49f157c tempest-VolumeDependencyTests-1733539683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:36:22 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-a7a06a6d-12fb-4e13-ba71-b36ee49f157c tempest-VolumeDependencyTests-1733539683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:36:22 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-a7a06a6d-12fb-4e13-ba71-b36ee49f157c tempest-VolumeDependencyTests-1733539683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:36:22 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-a7a06a6d-12fb-4e13-ba71-b36ee49f157c tempest-VolumeDependencyTests-1733539683 None] Selected osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:36:22 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-a7a06a6d-12fb-4e13-ba71-b36ee49f157c tempest-VolumeDependencyTests-1733539683 None] casted to osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f Jun 29 03:36:22 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a7a06a6d-12fb-4e13-ba71-b36ee49f157c tempest-VolumeDependencyTests-1733539683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-1b8cf38d-60ae-44a6-8b53-18a28ceddd88 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:36:22 devstack sudo[109771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-1b8cf38d-60ae-44a6-8b53-18a28ceddd88 1073741824 Jun 29 03:36:22 devstack sudo[109771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:36:22 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-cd28f394-c520-49e6-a393-b3f5467f9eb6 tempest-VolumesActionsTest-613223606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cacc462e-1665-41bd-a12d-4ff769f10388) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e65c505-5170-4bfe-85a8-2952bb954ed1', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:36:22 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-cd28f394-c520-49e6-a393-b3f5467f9eb6 tempest-VolumesActionsTest-613223606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83641821-6996-47de-a564-2c1bc64a35cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:36:22 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-cd28f394-c520-49e6-a393-b3f5467f9eb6 tempest-VolumesActionsTest-613223606 None] Volume volume-5e65c505-5170-4bfe-85a8-2952bb954ed1 (5e65c505-5170-4bfe-85a8-2952bb954ed1): created successfully Jun 29 03:36:22 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-cd28f394-c520-49e6-a393-b3f5467f9eb6 tempest-VolumesActionsTest-613223606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83641821-6996-47de-a564-2c1bc64a35cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:36:22 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-cd28f394-c520-49e6-a393-b3f5467f9eb6 tempest-VolumesActionsTest-613223606 None] Flow 'volume_create_manager' (5e5e4a5c-bf51-4c34-a695-5e23c1f11d46) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:36:22 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-cd28f394-c520-49e6-a393-b3f5467f9eb6 tempest-VolumesActionsTest-613223606 None] Created volume successfully. Jun 29 03:36:23 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-5d503ad9-7e4f-448d-9d0d-0e50f62a6f5b tempest-VolumesActionsTest-613223606 None] Acquiring lock "cinder-5e65c505-5170-4bfe-85a8-2952bb954ed1" by "attach_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:36:23 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-5d503ad9-7e4f-448d-9d0d-0e50f62a6f5b tempest-VolumesActionsTest-613223606 None] Lock "cinder-5e65c505-5170-4bfe-85a8-2952bb954ed1" acquired by "attach_volume" :: waited 0.023s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:36:23 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-5d503ad9-7e4f-448d-9d0d-0e50f62a6f5b tempest-VolumesActionsTest-613223606 None] Attaching volume 5e65c505-5170-4bfe-85a8-2952bb954ed1 to instance 6d9088ce-fc63-4b8a-affb-8e1ec3a4e641 at mountpoint /dev/vdb on host None. Jun 29 03:36:23 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-5d503ad9-7e4f-448d-9d0d-0e50f62a6f5b tempest-VolumesActionsTest-613223606 None] Attach volume completed successfully. Jun 29 03:36:23 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-5d503ad9-7e4f-448d-9d0d-0e50f62a6f5b tempest-VolumesActionsTest-613223606 None] Lock "cinder-5e65c505-5170-4bfe-85a8-2952bb954ed1" released by "attach_volume" :: held 0.119s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:36:23 devstack sudo[109771]: pam_unix(sudo:session): session closed for user root Jun 29 03:36:23 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a7a06a6d-12fb-4e13-ba71-b36ee49f157c tempest-VolumeDependencyTests-1733539683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-1b8cf38d-60ae-44a6-8b53-18a28ceddd88 1073741824" returned: 0 in 1.319s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:36:23 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a7a06a6d-12fb-4e13-ba71-b36ee49f157c tempest-VolumeDependencyTests-1733539683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-1b8cf38d-60ae-44a6-8b53-18a28ceddd88 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:36:23 devstack sudo[109781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-1b8cf38d-60ae-44a6-8b53-18a28ceddd88 Jun 29 03:36:23 devstack sudo[109781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:36:24 devstack sudo[109781]: pam_unix(sudo:session): session closed for user root Jun 29 03:36:24 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a7a06a6d-12fb-4e13-ba71-b36ee49f157c tempest-VolumeDependencyTests-1733539683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-1b8cf38d-60ae-44a6-8b53-18a28ceddd88" returned: 0 in 1.238s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:36:24 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-a7a06a6d-12fb-4e13-ba71-b36ee49f157c tempest-VolumeDependencyTests-1733539683 None] <== create_volume: return (2605ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:36:24 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-a7a06a6d-12fb-4e13-ba71-b36ee49f157c tempest-VolumeDependencyTests-1733539683 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.609s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:36:24 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-a7a06a6d-12fb-4e13-ba71-b36ee49f157c tempest-VolumeDependencyTests-1733539683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc90e855-77b9-47e8-afe5-cc1605169d96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b8cf38d-60ae-44a6-8b53-18a28ceddd88', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:36:24 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-a7a06a6d-12fb-4e13-ba71-b36ee49f157c tempest-VolumeDependencyTests-1733539683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30b673c0-40b3-45d8-86b1-75b0cd0978c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:36:24 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-2f2703f1-b26e-4947-8fc2-0797738d41ba tempest-VolumesActionsTest-1356070032 None] Terminate volume connection completed successfully. Jun 29 03:36:24 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-a7a06a6d-12fb-4e13-ba71-b36ee49f157c tempest-VolumeDependencyTests-1733539683 None] Volume volume-1b8cf38d-60ae-44a6-8b53-18a28ceddd88 (1b8cf38d-60ae-44a6-8b53-18a28ceddd88): created successfully Jun 29 03:36:24 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-a7a06a6d-12fb-4e13-ba71-b36ee49f157c tempest-VolumeDependencyTests-1733539683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30b673c0-40b3-45d8-86b1-75b0cd0978c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:36:24 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-a7a06a6d-12fb-4e13-ba71-b36ee49f157c tempest-VolumeDependencyTests-1733539683 None] Flow 'volume_create_manager' (8c1895e7-5b67-419b-9b33-df46e5fb8bb6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:36:24 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-a7a06a6d-12fb-4e13-ba71-b36ee49f157c tempest-VolumeDependencyTests-1733539683 None] Created volume successfully. Jun 29 03:36:25 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-2f2703f1-b26e-4947-8fc2-0797738d41ba tempest-VolumesActionsTest-1356070032 None] Acquiring lock "cinder-5e65c505-5170-4bfe-85a8-2952bb954ed1-detach_volume" by "detach_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:36:25 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-2f2703f1-b26e-4947-8fc2-0797738d41ba tempest-VolumesActionsTest-1356070032 None] Lock "cinder-5e65c505-5170-4bfe-85a8-2952bb954ed1-detach_volume" acquired by "detach_volume" :: waited 0.047s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:36:25 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-2f2703f1-b26e-4947-8fc2-0797738d41ba tempest-VolumesActionsTest-1356070032 None] Detaching volume 5e65c505-5170-4bfe-85a8-2952bb954ed1 from instance 6d9088ce-fc63-4b8a-affb-8e1ec3a4e641. Jun 29 03:36:25 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-2f2703f1-b26e-4947-8fc2-0797738d41ba tempest-VolumesActionsTest-1356070032 None] Detach volume completed successfully. Jun 29 03:36:25 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-2f2703f1-b26e-4947-8fc2-0797738d41ba tempest-VolumesActionsTest-1356070032 None] Lock "cinder-5e65c505-5170-4bfe-85a8-2952bb954ed1-detach_volume" released by "detach_volume" :: held 0.159s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:36:25 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-2542665f-da4b-4155-a08c-e5486277c486 tempest-VolumeDependencyTests-1733539683 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:36:25 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-2542665f-da4b-4155-a08c-e5486277c486 tempest-VolumeDependencyTests-1733539683 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:36:25 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-2542665f-da4b-4155-a08c-e5486277c486 tempest-VolumeDependencyTests-1733539683 None] Creating offline snapshot caa92a3b-200a-4d38-b153-7cd780538051 of volume 1b8cf38d-60ae-44a6-8b53-18a28ceddd88 {{(pid=93468) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 29 03:36:25 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e185252-92c4-4f72-ab9e-15c2c8651ac0]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:36:25 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2542665f-da4b-4155-a08c-e5486277c486 tempest-VolumeDependencyTests-1733539683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-1b8cf38d-60ae-44a6-8b53-18a28ceddd88 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:36:26 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-4671b42e-8ced-4de3-9e95-54086f3c09b1 tempest-VolumesActionsTest-613223606 None] Acquiring lock "cinder-5e65c505-5170-4bfe-85a8-2952bb954ed1-detach_volume" by "detach_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:36:26 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-4671b42e-8ced-4de3-9e95-54086f3c09b1 tempest-VolumesActionsTest-613223606 None] Lock "cinder-5e65c505-5170-4bfe-85a8-2952bb954ed1-detach_volume" acquired by "detach_volume" :: waited 0.032s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:36:26 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-4671b42e-8ced-4de3-9e95-54086f3c09b1 tempest-VolumesActionsTest-613223606 None] Volume detach called, but volume not attached. Jun 29 03:36:26 devstack sudo[109791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-1b8cf38d-60ae-44a6-8b53-18a28ceddd88 Jun 29 03:36:26 devstack sudo[109791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:36:26 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-4671b42e-8ced-4de3-9e95-54086f3c09b1 tempest-VolumesActionsTest-613223606 None] Lock "cinder-5e65c505-5170-4bfe-85a8-2952bb954ed1-detach_volume" released by "detach_volume" :: held 0.039s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:36:26 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-b71da21e-ce95-4070-aa1e-ec83fd0b8aaa tempest-VolumesActionsTest-613223606 None] Acquiring lock "cinder-5e65c505-5170-4bfe-85a8-2952bb954ed1-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:36:26 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-b71da21e-ce95-4070-aa1e-ec83fd0b8aaa tempest-VolumesActionsTest-613223606 None] Lock "cinder-5e65c505-5170-4bfe-85a8-2952bb954ed1-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:36:26 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-b71da21e-ce95-4070-aa1e-ec83fd0b8aaa tempest-VolumesActionsTest-613223606 None] Acquiring lock "cinder-quobyte-5e65c505-5170-4bfe-85a8-2952bb954ed1" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:36:26 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-b71da21e-ce95-4070-aa1e-ec83fd0b8aaa tempest-VolumesActionsTest-613223606 None] Lock "cinder-quobyte-5e65c505-5170-4bfe-85a8-2952bb954ed1" acquired by "delete_volume" :: waited 0.021s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:36:26 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[47348414-14ba-4422-9442-fc56eff122bc]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:36:26 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b71da21e-ce95-4070-aa1e-ec83fd0b8aaa tempest-VolumesActionsTest-613223606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-5e65c505-5170-4bfe-85a8-2952bb954ed1 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:36:27 devstack sudo[109791]: pam_unix(sudo:session): session closed for user root Jun 29 03:36:27 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2542665f-da4b-4155-a08c-e5486277c486 tempest-VolumeDependencyTests-1733539683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-1b8cf38d-60ae-44a6-8b53-18a28ceddd88" returned: 0 in 1.182s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:36:27 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2542665f-da4b-4155-a08c-e5486277c486 tempest-VolumeDependencyTests-1733539683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-1b8cf38d-60ae-44a6-8b53-18a28ceddd88,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-1b8cf38d-60ae-44a6-8b53-18a28ceddd88.caa92a3b-200a-4d38-b153-7cd780538051 1G {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:36:27 devstack sudo[109817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-1b8cf38d-60ae-44a6-8b53-18a28ceddd88,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-1b8cf38d-60ae-44a6-8b53-18a28ceddd88.caa92a3b-200a-4d38-b153-7cd780538051 1G Jun 29 03:36:27 devstack sudo[109817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:36:27 devstack sudo[109816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-5e65c505-5170-4bfe-85a8-2952bb954ed1 Jun 29 03:36:27 devstack sudo[109816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:36:28 devstack sudo[109816]: pam_unix(sudo:session): session closed for user root Jun 29 03:36:28 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b71da21e-ce95-4070-aa1e-ec83fd0b8aaa tempest-VolumesActionsTest-613223606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-5e65c505-5170-4bfe-85a8-2952bb954ed1" returned: 0 in 1.128s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:36:28 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b71da21e-ce95-4070-aa1e-ec83fd0b8aaa tempest-VolumesActionsTest-613223606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-5e65c505-5170-4bfe-85a8-2952bb954ed1 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:36:28 devstack sudo[109828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-5e65c505-5170-4bfe-85a8-2952bb954ed1 Jun 29 03:36:28 devstack sudo[109828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:36:28 devstack sudo[109817]: pam_unix(sudo:session): session closed for user root Jun 29 03:36:28 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2542665f-da4b-4155-a08c-e5486277c486 tempest-VolumeDependencyTests-1733539683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-1b8cf38d-60ae-44a6-8b53-18a28ceddd88,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-1b8cf38d-60ae-44a6-8b53-18a28ceddd88.caa92a3b-200a-4d38-b153-7cd780538051 1G" returned: 0 in 1.121s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:36:28 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2542665f-da4b-4155-a08c-e5486277c486 tempest-VolumeDependencyTests-1733539683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b8cf38d-60ae-44a6-8b53-18a28ceddd88 -F qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-1b8cf38d-60ae-44a6-8b53-18a28ceddd88.caa92a3b-200a-4d38-b153-7cd780538051 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:36:28 devstack sudo[109830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b8cf38d-60ae-44a6-8b53-18a28ceddd88 -F qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-1b8cf38d-60ae-44a6-8b53-18a28ceddd88.caa92a3b-200a-4d38-b153-7cd780538051 Jun 29 03:36:28 devstack sudo[109830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:36:28 devstack sudo[109828]: pam_unix(sudo:session): session closed for user root Jun 29 03:36:28 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b71da21e-ce95-4070-aa1e-ec83fd0b8aaa tempest-VolumesActionsTest-613223606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-5e65c505-5170-4bfe-85a8-2952bb954ed1" returned: 0 in 0.813s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:36:28 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-b71da21e-ce95-4070-aa1e-ec83fd0b8aaa tempest-VolumesActionsTest-613223606 None] Lock "cinder-quobyte-5e65c505-5170-4bfe-85a8-2952bb954ed1" released by "delete_volume" :: held 2.009s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:36:29 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-b71da21e-ce95-4070-aa1e-ec83fd0b8aaa tempest-VolumesActionsTest-613223606 None] Created reservations ['0835b569-af29-477d-98cd-cc545c2367eb', '16bdf2ff-2eda-4e39-b470-9b7e6974b188', 'cd3d055d-1440-48d0-8151-39b29a25b1f8', 'd539447f-66ad-4f58-8349-390dbff45ed4'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:36:29 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-b71da21e-ce95-4070-aa1e-ec83fd0b8aaa tempest-VolumesActionsTest-613223606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:36:29 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-b71da21e-ce95-4070-aa1e-ec83fd0b8aaa tempest-VolumesActionsTest-613223606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:36:29 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-b71da21e-ce95-4070-aa1e-ec83fd0b8aaa tempest-VolumesActionsTest-613223606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:36:29 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-b71da21e-ce95-4070-aa1e-ec83fd0b8aaa tempest-VolumesActionsTest-613223606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:36:29 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-b71da21e-ce95-4070-aa1e-ec83fd0b8aaa tempest-VolumesActionsTest-613223606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:36:29 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b71da21e-ce95-4070-aa1e-ec83fd0b8aaa tempest-VolumesActionsTest-613223606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:36:29 devstack sudo[109836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf Jun 29 03:36:29 devstack sudo[109836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:36:29 devstack sudo[109830]: pam_unix(sudo:session): session closed for user root Jun 29 03:36:29 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2542665f-da4b-4155-a08c-e5486277c486 tempest-VolumeDependencyTests-1733539683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b8cf38d-60ae-44a6-8b53-18a28ceddd88 -F qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-1b8cf38d-60ae-44a6-8b53-18a28ceddd88.caa92a3b-200a-4d38-b153-7cd780538051" returned: 0 in 0.957s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:36:29 devstack cinder-volume[93468]: WARNING cinder.volume.drivers.remotefs [None req-2542665f-da4b-4155-a08c-e5486277c486 tempest-VolumeDependencyTests-1733539683 None] /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-1b8cf38d-60ae-44a6-8b53-18a28ceddd88.caa92a3b-200a-4d38-b153-7cd780538051 is being set with open permissions: ugo+rw Jun 29 03:36:29 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2542665f-da4b-4155-a08c-e5486277c486 tempest-VolumeDependencyTests-1733539683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-1b8cf38d-60ae-44a6-8b53-18a28ceddd88.caa92a3b-200a-4d38-b153-7cd780538051 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:36:29 devstack sudo[109838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-1b8cf38d-60ae-44a6-8b53-18a28ceddd88.caa92a3b-200a-4d38-b153-7cd780538051 Jun 29 03:36:29 devstack sudo[109838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:36:29 devstack sudo[109836]: pam_unix(sudo:session): session closed for user root Jun 29 03:36:29 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b71da21e-ce95-4070-aa1e-ec83fd0b8aaa tempest-VolumesActionsTest-613223606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf" returned: 0 in 0.757s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:36:29 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-b71da21e-ce95-4070-aa1e-ec83fd0b8aaa tempest-VolumesActionsTest-613223606 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:36:29 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-b71da21e-ce95-4070-aa1e-ec83fd0b8aaa tempest-VolumesActionsTest-613223606 None] Deleted volume successfully. Jun 29 03:36:29 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-b71da21e-ce95-4070-aa1e-ec83fd0b8aaa tempest-VolumesActionsTest-613223606 None] Lock "cinder-5e65c505-5170-4bfe-85a8-2952bb954ed1-delete_volume" released by "delete_volume" :: held 3.105s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:36:30 devstack sudo[109838]: pam_unix(sudo:session): session closed for user root Jun 29 03:36:30 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2542665f-da4b-4155-a08c-e5486277c486 tempest-VolumeDependencyTests-1733539683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-1b8cf38d-60ae-44a6-8b53-18a28ceddd88.caa92a3b-200a-4d38-b153-7cd780538051" returned: 0 in 0.868s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:36:30 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2542665f-da4b-4155-a08c-e5486277c486 tempest-VolumeDependencyTests-1733539683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-1b8cf38d-60ae-44a6-8b53-18a28ceddd88.info {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:36:30 devstack sudo[109843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-1b8cf38d-60ae-44a6-8b53-18a28ceddd88.info Jun 29 03:36:30 devstack sudo[109843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:36:30 devstack sudo[109843]: pam_unix(sudo:session): session closed for user root Jun 29 03:36:30 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2542665f-da4b-4155-a08c-e5486277c486 tempest-VolumeDependencyTests-1733539683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-1b8cf38d-60ae-44a6-8b53-18a28ceddd88.info" returned: 0 in 0.805s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:36:30 devstack cinder-volume[93468]: WARNING cinder.volume.drivers.remotefs [None req-2542665f-da4b-4155-a08c-e5486277c486 tempest-VolumeDependencyTests-1733539683 None] /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-1b8cf38d-60ae-44a6-8b53-18a28ceddd88.info is being set with open permissions: ugo+rw Jun 29 03:36:30 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2542665f-da4b-4155-a08c-e5486277c486 tempest-VolumeDependencyTests-1733539683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-1b8cf38d-60ae-44a6-8b53-18a28ceddd88.info {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:36:30 devstack sudo[109846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-1b8cf38d-60ae-44a6-8b53-18a28ceddd88.info Jun 29 03:36:30 devstack sudo[109846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:36:32 devstack sudo[109846]: pam_unix(sudo:session): session closed for user root Jun 29 03:36:32 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2542665f-da4b-4155-a08c-e5486277c486 tempest-VolumeDependencyTests-1733539683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-1b8cf38d-60ae-44a6-8b53-18a28ceddd88.info" returned: 0 in 1.156s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:36:32 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-2542665f-da4b-4155-a08c-e5486277c486 tempest-VolumeDependencyTests-1733539683 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.237s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:36:32 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-2542665f-da4b-4155-a08c-e5486277c486 tempest-VolumeDependencyTests-1733539683 None] Create snapshot completed successfully Jun 29 03:36:33 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ea43b0f-5d00-4cdc-95f9-7c6c515be4b8 tempest-VolumeDependencyTests-1733539683 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:36:33 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-2ea43b0f-5d00-4cdc-95f9-7c6c515be4b8 tempest-VolumeDependencyTests-1733539683 None] Flow 'volume_create_manager' (8b36024a-1a3c-4dfa-ad68-d6b4ef570ce6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:36:33 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-2ea43b0f-5d00-4cdc-95f9-7c6c515be4b8 tempest-VolumeDependencyTests-1733539683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8add29c-af2f-4030-bae1-e2284c30f4d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:36:33 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-2ea43b0f-5d00-4cdc-95f9-7c6c515be4b8 tempest-VolumeDependencyTests-1733539683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8add29c-af2f-4030-bae1-e2284c30f4d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:36:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1647969980',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=667f0097-eb99-4368-be65-fc29b75c07f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a3f32611ff745e989667bec24d17a30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:36:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=caa92a3b-200a-4d38-b153-7cd780538051,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:36:33Z,use_quota=True,user_id='898654a3cb7147cabc25f1d2cd3d9fef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:36:33 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-2ea43b0f-5d00-4cdc-95f9-7c6c515be4b8 tempest-VolumeDependencyTests-1733539683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4067a1b-19d6-49f6-87fc-d88e6d58c2a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:36:33 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-2ea43b0f-5d00-4cdc-95f9-7c6c515be4b8 tempest-VolumeDependencyTests-1733539683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4067a1b-19d6-49f6-87fc-d88e6d58c2a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:36:33 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-2ea43b0f-5d00-4cdc-95f9-7c6c515be4b8 tempest-VolumeDependencyTests-1733539683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57f74c93-5d8d-4677-92cf-f11841d564b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:36:33 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-2ea43b0f-5d00-4cdc-95f9-7c6c515be4b8 tempest-VolumeDependencyTests-1733539683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57f74c93-5d8d-4677-92cf-f11841d564b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '667f0097-eb99-4368-be65-fc29b75c07f7', 'volume_name': 'volume-667f0097-eb99-4368-be65-fc29b75c07f7', 'volume_size': 1, 'snapshot_id': 'caa92a3b-200a-4d38-b153-7cd780538051'}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:36:33 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-2ea43b0f-5d00-4cdc-95f9-7c6c515be4b8 tempest-VolumeDependencyTests-1733539683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5d16fa4-396a-426c-8eae-45ea8534d9db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:36:33 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-2ea43b0f-5d00-4cdc-95f9-7c6c515be4b8 tempest-VolumeDependencyTests-1733539683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5d16fa4-396a-426c-8eae-45ea8534d9db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:36:33 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-2ea43b0f-5d00-4cdc-95f9-7c6c515be4b8 tempest-VolumeDependencyTests-1733539683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ac7e4aa-142f-4d61-81bb-c33ab113b83e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:36:33 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-2ea43b0f-5d00-4cdc-95f9-7c6c515be4b8 tempest-VolumeDependencyTests-1733539683 None] Volume 667f0097-eb99-4368-be65-fc29b75c07f7: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-667f0097-eb99-4368-be65-fc29b75c07f7', 'volume_size': 1, 'snapshot_id': 'caa92a3b-200a-4d38-b153-7cd780538051'} Jun 29 03:36:33 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-2ea43b0f-5d00-4cdc-95f9-7c6c515be4b8 tempest-VolumeDependencyTests-1733539683 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:36:33 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-2ea43b0f-5d00-4cdc-95f9-7c6c515be4b8 tempest-VolumeDependencyTests-1733539683 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:36:33 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-2ea43b0f-5d00-4cdc-95f9-7c6c515be4b8 tempest-VolumeDependencyTests-1733539683 None] Acquiring lock "cinder-quobyte-caa92a3b-200a-4d38-b153-7cd780538051-667f0097-eb99-4368-be65-fc29b75c07f7" by "_create_volume_from_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:36:33 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-2ea43b0f-5d00-4cdc-95f9-7c6c515be4b8 tempest-VolumeDependencyTests-1733539683 None] Lock "cinder-quobyte-caa92a3b-200a-4d38-b153-7cd780538051-667f0097-eb99-4368-be65-fc29b75c07f7" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:36:33 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-2ea43b0f-5d00-4cdc-95f9-7c6c515be4b8 tempest-VolumeDependencyTests-1733539683 None] Creating volume 667f0097-eb99-4368-be65-fc29b75c07f7 from snapshot caa92a3b-200a-4d38-b153-7cd780538051 {{(pid=93468) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 29 03:36:33 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-2ea43b0f-5d00-4cdc-95f9-7c6c515be4b8 tempest-VolumeDependencyTests-1733539683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:36:33 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-2ea43b0f-5d00-4cdc-95f9-7c6c515be4b8 tempest-VolumeDependencyTests-1733539683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:36:33 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-2ea43b0f-5d00-4cdc-95f9-7c6c515be4b8 tempest-VolumeDependencyTests-1733539683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:36:33 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-2ea43b0f-5d00-4cdc-95f9-7c6c515be4b8 tempest-VolumeDependencyTests-1733539683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:36:33 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-2ea43b0f-5d00-4cdc-95f9-7c6c515be4b8 tempest-VolumeDependencyTests-1733539683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:36:33 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-2ea43b0f-5d00-4cdc-95f9-7c6c515be4b8 tempest-VolumeDependencyTests-1733539683 None] Selected osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:36:33 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-2ea43b0f-5d00-4cdc-95f9-7c6c515be4b8 tempest-VolumeDependencyTests-1733539683 None] Acquiring lock "cinder-quobyte-667f0097-eb99-4368-be65-fc29b75c07f7" by "_copy_volume_from_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:36:33 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-2ea43b0f-5d00-4cdc-95f9-7c6c515be4b8 tempest-VolumeDependencyTests-1733539683 None] Lock "cinder-quobyte-667f0097-eb99-4368-be65-fc29b75c07f7" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:36:33 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-2ea43b0f-5d00-4cdc-95f9-7c6c515be4b8 tempest-VolumeDependencyTests-1733539683 None] snapshot: caa92a3b-200a-4d38-b153-7cd780538051, volume: 667f0097-eb99-4368-be65-fc29b75c07f7, {{(pid=93468) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 29 03:36:33 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-2ea43b0f-5d00-4cdc-95f9-7c6c515be4b8 tempest-VolumeDependencyTests-1733539683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:36:33 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-2ea43b0f-5d00-4cdc-95f9-7c6c515be4b8 tempest-VolumeDependencyTests-1733539683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:36:33 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-2ea43b0f-5d00-4cdc-95f9-7c6c515be4b8 tempest-VolumeDependencyTests-1733539683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:36:33 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-2ea43b0f-5d00-4cdc-95f9-7c6c515be4b8 tempest-VolumeDependencyTests-1733539683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:36:33 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-2ea43b0f-5d00-4cdc-95f9-7c6c515be4b8 tempest-VolumeDependencyTests-1733539683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:36:33 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ef6503a-4015-4582-81fe-470d8be5a8d4]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:36:33 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2ea43b0f-5d00-4cdc-95f9-7c6c515be4b8 tempest-VolumeDependencyTests-1733539683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-1b8cf38d-60ae-44a6-8b53-18a28ceddd88.caa92a3b-200a-4d38-b153-7cd780538051 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:36:33 devstack sudo[109894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-1b8cf38d-60ae-44a6-8b53-18a28ceddd88.caa92a3b-200a-4d38-b153-7cd780538051 Jun 29 03:36:33 devstack sudo[109894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:36:34 devstack sudo[109894]: pam_unix(sudo:session): session closed for user root Jun 29 03:36:34 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2ea43b0f-5d00-4cdc-95f9-7c6c515be4b8 tempest-VolumeDependencyTests-1733539683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-1b8cf38d-60ae-44a6-8b53-18a28ceddd88.caa92a3b-200a-4d38-b153-7cd780538051" returned: 0 in 1.018s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:36:34 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-2ea43b0f-5d00-4cdc-95f9-7c6c515be4b8 tempest-VolumeDependencyTests-1733539683 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1b8cf38d-60ae-44a6-8b53-18a28ceddd88(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93468) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 29 03:36:34 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-2ea43b0f-5d00-4cdc-95f9-7c6c515be4b8 tempest-VolumeDependencyTests-1733539683 None] will copy from snapshot at /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-1b8cf38d-60ae-44a6-8b53-18a28ceddd88 {{(pid=93468) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 29 03:36:34 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-2ea43b0f-5d00-4cdc-95f9-7c6c515be4b8 tempest-VolumeDependencyTests-1733539683 None] Creating direct copy from snapshot {{(pid=93468) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 29 03:36:34 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[05240713-ba12-4d0f-97e6-97198f1fe4c9]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:36:34 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2ea43b0f-5d00-4cdc-95f9-7c6c515be4b8 tempest-VolumeDependencyTests-1733539683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-1b8cf38d-60ae-44a6-8b53-18a28ceddd88 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:36:34 devstack sudo[109902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-1b8cf38d-60ae-44a6-8b53-18a28ceddd88 Jun 29 03:36:34 devstack sudo[109902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:36:35 devstack sudo[109902]: pam_unix(sudo:session): session closed for user root Jun 29 03:36:35 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2ea43b0f-5d00-4cdc-95f9-7c6c515be4b8 tempest-VolumeDependencyTests-1733539683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-1b8cf38d-60ae-44a6-8b53-18a28ceddd88" returned: 0 in 0.880s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:36:35 devstack cinder-volume[93468]: DEBUG cinder.utils [None req-2ea43b0f-5d00-4cdc-95f9-7c6c515be4b8 tempest-VolumeDependencyTests-1733539683 None] Path /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-667f0097-eb99-4368-be65-fc29b75c07f7 not found in is_blk_device check {{(pid=93468) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 29 03:36:35 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2ea43b0f-5d00-4cdc-95f9-7c6c515be4b8 tempest-VolumeDependencyTests-1733539683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-1b8cf38d-60ae-44a6-8b53-18a28ceddd88 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-667f0097-eb99-4368-be65-fc29b75c07f7 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:36:35 devstack sudo[109907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-1b8cf38d-60ae-44a6-8b53-18a28ceddd88 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-667f0097-eb99-4368-be65-fc29b75c07f7 Jun 29 03:36:35 devstack sudo[109907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:36:41 devstack sudo[109907]: pam_unix(sudo:session): session closed for user root Jun 29 03:36:41 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2ea43b0f-5d00-4cdc-95f9-7c6c515be4b8 tempest-VolumeDependencyTests-1733539683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-1b8cf38d-60ae-44a6-8b53-18a28ceddd88 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-667f0097-eb99-4368-be65-fc29b75c07f7" returned: 0 in 6.327s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:36:41 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[701e8487-55fd-4f9d-8e46-2d3e2e7e6ff5]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:36:41 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2ea43b0f-5d00-4cdc-95f9-7c6c515be4b8 tempest-VolumeDependencyTests-1733539683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-1b8cf38d-60ae-44a6-8b53-18a28ceddd88 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:36:41 devstack sudo[109921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-1b8cf38d-60ae-44a6-8b53-18a28ceddd88 Jun 29 03:36:41 devstack sudo[109921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:36:42 devstack sudo[109921]: pam_unix(sudo:session): session closed for user root Jun 29 03:36:42 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2ea43b0f-5d00-4cdc-95f9-7c6c515be4b8 tempest-VolumeDependencyTests-1733539683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-1b8cf38d-60ae-44a6-8b53-18a28ceddd88" returned: 0 in 1.398s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:36:42 devstack cinder-volume[93468]: DEBUG cinder.image.image_utils [None req-2ea43b0f-5d00-4cdc-95f9-7c6c515be4b8 tempest-VolumeDependencyTests-1733539683 None] Image conversion details: src /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-1b8cf38d-60ae-44a6-8b53-18a28ceddd88, size 1024.00 MB, duration 6.33 sec, destination /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-667f0097-eb99-4368-be65-fc29b75c07f7 {{(pid=93468) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 29 03:36:42 devstack cinder-volume[93468]: INFO cinder.image.image_utils [None req-2ea43b0f-5d00-4cdc-95f9-7c6c515be4b8 tempest-VolumeDependencyTests-1733539683 None] Converted 1024.00 MB image at 161.81 MB/s Jun 29 03:36:42 devstack cinder-volume[93468]: WARNING cinder.volume.drivers.remotefs [None req-2ea43b0f-5d00-4cdc-95f9-7c6c515be4b8 tempest-VolumeDependencyTests-1733539683 None] /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-667f0097-eb99-4368-be65-fc29b75c07f7 is being set with open permissions: ugo+rw Jun 29 03:36:42 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2ea43b0f-5d00-4cdc-95f9-7c6c515be4b8 tempest-VolumeDependencyTests-1733539683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-667f0097-eb99-4368-be65-fc29b75c07f7 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:36:43 devstack sudo[109927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-667f0097-eb99-4368-be65-fc29b75c07f7 Jun 29 03:36:43 devstack sudo[109927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:36:43 devstack cinder-volume[93468]: DEBUG dbcounter [-] [93468] Writing DB stats cinder:SELECT=96,cinder:UPDATE=119,cinder:INSERT=28,cinder:DELETE=4 {{(pid=93468) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 29 03:36:43 devstack cinder-volume[93468]: DEBUG dbcounter [-] [93468] Writing DB stats cinder:SELECT=89,cinder:UPDATE=113,cinder:INSERT=27,cinder:DELETE=15 {{(pid=93468) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 29 03:36:43 devstack sudo[109927]: pam_unix(sudo:session): session closed for user root Jun 29 03:36:43 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2ea43b0f-5d00-4cdc-95f9-7c6c515be4b8 tempest-VolumeDependencyTests-1733539683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-667f0097-eb99-4368-be65-fc29b75c07f7" returned: 0 in 0.827s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:36:43 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-2ea43b0f-5d00-4cdc-95f9-7c6c515be4b8 tempest-VolumeDependencyTests-1733539683 None] Lock "cinder-quobyte-667f0097-eb99-4368-be65-fc29b75c07f7" released by "_copy_volume_from_snapshot" :: held 10.630s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:36:43 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-2ea43b0f-5d00-4cdc-95f9-7c6c515be4b8 tempest-VolumeDependencyTests-1733539683 None] Lock "cinder-quobyte-caa92a3b-200a-4d38-b153-7cd780538051-667f0097-eb99-4368-be65-fc29b75c07f7" released by "_create_volume_from_snapshot" :: held 10.673s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:36:43 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-2ea43b0f-5d00-4cdc-95f9-7c6c515be4b8 tempest-VolumeDependencyTests-1733539683 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.693s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:36:43 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-2ea43b0f-5d00-4cdc-95f9-7c6c515be4b8 tempest-VolumeDependencyTests-1733539683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ac7e4aa-142f-4d61-81bb-c33ab113b83e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-667f0097-eb99-4368-be65-fc29b75c07f7', 'volume_size': 1, 'snapshot_id': 'caa92a3b-200a-4d38-b153-7cd780538051'}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:36:43 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-2ea43b0f-5d00-4cdc-95f9-7c6c515be4b8 tempest-VolumeDependencyTests-1733539683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77d3c69a-c0d8-42bc-a4e1-75387d3469c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:36:43 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-2ea43b0f-5d00-4cdc-95f9-7c6c515be4b8 tempest-VolumeDependencyTests-1733539683 None] Volume volume-667f0097-eb99-4368-be65-fc29b75c07f7 (667f0097-eb99-4368-be65-fc29b75c07f7): created successfully Jun 29 03:36:43 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-2ea43b0f-5d00-4cdc-95f9-7c6c515be4b8 tempest-VolumeDependencyTests-1733539683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77d3c69a-c0d8-42bc-a4e1-75387d3469c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:36:43 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-2ea43b0f-5d00-4cdc-95f9-7c6c515be4b8 tempest-VolumeDependencyTests-1733539683 None] Flow 'volume_create_manager' (8b36024a-1a3c-4dfa-ad68-d6b4ef570ce6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:36:44 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-2ea43b0f-5d00-4cdc-95f9-7c6c515be4b8 tempest-VolumeDependencyTests-1733539683 None] Created volume successfully. Jun 29 03:36:44 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-650703dc-d960-4016-9221-3837978af3a9 tempest-VolumeDependencyTests-1733539683 None] Acquiring lock "cinder-caa92a3b-200a-4d38-b153-7cd780538051-delete_snapshot" by "delete_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:36:44 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-650703dc-d960-4016-9221-3837978af3a9 tempest-VolumeDependencyTests-1733539683 None] Lock "cinder-caa92a3b-200a-4d38-b153-7cd780538051-delete_snapshot" acquired by "delete_snapshot" :: waited 0.043s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:36:44 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-650703dc-d960-4016-9221-3837978af3a9 tempest-VolumeDependencyTests-1733539683 None] Acquiring lock "cinder-quobyte-1b8cf38d-60ae-44a6-8b53-18a28ceddd88" by "delete_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:36:44 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-650703dc-d960-4016-9221-3837978af3a9 tempest-VolumeDependencyTests-1733539683 None] Lock "cinder-quobyte-1b8cf38d-60ae-44a6-8b53-18a28ceddd88" acquired by "delete_snapshot" :: waited 0.037s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:36:44 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-650703dc-d960-4016-9221-3837978af3a9 tempest-VolumeDependencyTests-1733539683 None] Acquiring lock "cinder-quobyte-caa92a3b-200a-4d38-b153-7cd780538051" by "_delete_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:36:44 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-650703dc-d960-4016-9221-3837978af3a9 tempest-VolumeDependencyTests-1733539683 None] Lock "cinder-quobyte-caa92a3b-200a-4d38-b153-7cd780538051" acquired by "_delete_snapshot" :: waited 0.038s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:36:44 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-650703dc-d960-4016-9221-3837978af3a9 tempest-VolumeDependencyTests-1733539683 None] Deleting offline snapshot caa92a3b-200a-4d38-b153-7cd780538051 of volume 1b8cf38d-60ae-44a6-8b53-18a28ceddd88 {{(pid=93468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 29 03:36:44 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-650703dc-d960-4016-9221-3837978af3a9 tempest-VolumeDependencyTests-1733539683 None] snapshot_file for this snap is: volume-1b8cf38d-60ae-44a6-8b53-18a28ceddd88.caa92a3b-200a-4d38-b153-7cd780538051 {{(pid=93468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 29 03:36:44 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[09539af1-f392-4760-a13e-00f7d1e1e283]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:36:44 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-650703dc-d960-4016-9221-3837978af3a9 tempest-VolumeDependencyTests-1733539683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-1b8cf38d-60ae-44a6-8b53-18a28ceddd88.caa92a3b-200a-4d38-b153-7cd780538051 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:36:44 devstack sudo[109965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-1b8cf38d-60ae-44a6-8b53-18a28ceddd88.caa92a3b-200a-4d38-b153-7cd780538051 Jun 29 03:36:44 devstack sudo[109965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:36:44 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-747dcec3-b675-4576-b96f-e35fc5ab2232 tempest-VolumesActionsTest-613223606 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:36:44 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-747dcec3-b675-4576-b96f-e35fc5ab2232 tempest-VolumesActionsTest-613223606 None] Flow 'volume_create_manager' (2c4d4dd1-635f-44fd-b6ee-25f05e049945) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:36:44 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-747dcec3-b675-4576-b96f-e35fc5ab2232 tempest-VolumesActionsTest-613223606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30eeda70-482c-4d42-84c2-0c1dbef847bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:36:45 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-747dcec3-b675-4576-b96f-e35fc5ab2232 tempest-VolumesActionsTest-613223606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30eeda70-482c-4d42-84c2-0c1dbef847bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:36:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1200301374',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6acb14a1-79a7-416f-a173-fbf3ee4fa02f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1532758db6b54b66a2e5c4709e8cfdf7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:36:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:36:45Z,use_quota=True,user_id='b5900938aa1642a58d248cc9fd4c336a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:36:45 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-747dcec3-b675-4576-b96f-e35fc5ab2232 tempest-VolumesActionsTest-613223606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67d36f1f-2645-4d54-beaf-3d253ad6f3d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:36:45 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-747dcec3-b675-4576-b96f-e35fc5ab2232 tempest-VolumesActionsTest-613223606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67d36f1f-2645-4d54-beaf-3d253ad6f3d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:36:45 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-747dcec3-b675-4576-b96f-e35fc5ab2232 tempest-VolumesActionsTest-613223606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a0a5db9-8832-421f-a287-f04cd80f7f52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:36:45 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-747dcec3-b675-4576-b96f-e35fc5ab2232 tempest-VolumesActionsTest-613223606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a0a5db9-8832-421f-a287-f04cd80f7f52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6acb14a1-79a7-416f-a173-fbf3ee4fa02f', 'volume_name': 'volume-6acb14a1-79a7-416f-a173-fbf3ee4fa02f', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:36:45 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-747dcec3-b675-4576-b96f-e35fc5ab2232 tempest-VolumesActionsTest-613223606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d1f3bab-e618-4598-be7b-2e733c5411d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:36:45 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-747dcec3-b675-4576-b96f-e35fc5ab2232 tempest-VolumesActionsTest-613223606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d1f3bab-e618-4598-be7b-2e733c5411d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:36:45 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-747dcec3-b675-4576-b96f-e35fc5ab2232 tempest-VolumesActionsTest-613223606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6da4743-9cb0-4a64-95ac-89e4865297bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:36:45 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-747dcec3-b675-4576-b96f-e35fc5ab2232 tempest-VolumesActionsTest-613223606 None] Volume 6acb14a1-79a7-416f-a173-fbf3ee4fa02f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6acb14a1-79a7-416f-a173-fbf3ee4fa02f', 'volume_size': 1} Jun 29 03:36:45 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-747dcec3-b675-4576-b96f-e35fc5ab2232 tempest-VolumesActionsTest-613223606 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:36:45 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-747dcec3-b675-4576-b96f-e35fc5ab2232 tempest-VolumesActionsTest-613223606 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:36:45 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-747dcec3-b675-4576-b96f-e35fc5ab2232 tempest-VolumesActionsTest-613223606 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:36:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1200301374',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6acb14a1-79a7-416f-a173-fbf3ee4fa02f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1532758db6b54b66a2e5c4709e8cfdf7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:36:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:36:45Z,use_quota=True,user_id='b5900938aa1642a58d248cc9fd4c336a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:36:45 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-747dcec3-b675-4576-b96f-e35fc5ab2232 tempest-VolumesActionsTest-613223606 None] Creating volume 6acb14a1-79a7-416f-a173-fbf3ee4fa02f {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:36:45 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-747dcec3-b675-4576-b96f-e35fc5ab2232 tempest-VolumesActionsTest-613223606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:36:45 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-747dcec3-b675-4576-b96f-e35fc5ab2232 tempest-VolumesActionsTest-613223606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:36:45 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-747dcec3-b675-4576-b96f-e35fc5ab2232 tempest-VolumesActionsTest-613223606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:36:45 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-747dcec3-b675-4576-b96f-e35fc5ab2232 tempest-VolumesActionsTest-613223606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:36:45 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-747dcec3-b675-4576-b96f-e35fc5ab2232 tempest-VolumesActionsTest-613223606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:36:45 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-747dcec3-b675-4576-b96f-e35fc5ab2232 tempest-VolumesActionsTest-613223606 None] Selected osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:36:45 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-747dcec3-b675-4576-b96f-e35fc5ab2232 tempest-VolumesActionsTest-613223606 None] casted to osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f Jun 29 03:36:45 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-747dcec3-b675-4576-b96f-e35fc5ab2232 tempest-VolumesActionsTest-613223606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-6acb14a1-79a7-416f-a173-fbf3ee4fa02f 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:36:45 devstack sudo[109970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-6acb14a1-79a7-416f-a173-fbf3ee4fa02f 1073741824 Jun 29 03:36:45 devstack sudo[109970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:36:45 devstack sudo[109965]: pam_unix(sudo:session): session closed for user root Jun 29 03:36:45 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-650703dc-d960-4016-9221-3837978af3a9 tempest-VolumeDependencyTests-1733539683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-1b8cf38d-60ae-44a6-8b53-18a28ceddd88.caa92a3b-200a-4d38-b153-7cd780538051" returned: 0 in 1.245s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:36:45 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-650703dc-d960-4016-9221-3837978af3a9 tempest-VolumeDependencyTests-1733539683 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1b8cf38d-60ae-44a6-8b53-18a28ceddd88(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93468) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 29 03:36:45 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddbd50b8-5eee-434a-a062-b4aa0be80355]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:36:45 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-650703dc-d960-4016-9221-3837978af3a9 tempest-VolumeDependencyTests-1733539683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-1b8cf38d-60ae-44a6-8b53-18a28ceddd88 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:36:45 devstack sudo[109975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-1b8cf38d-60ae-44a6-8b53-18a28ceddd88 Jun 29 03:36:45 devstack sudo[109975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:36:46 devstack sudo[109970]: pam_unix(sudo:session): session closed for user root Jun 29 03:36:46 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-747dcec3-b675-4576-b96f-e35fc5ab2232 tempest-VolumesActionsTest-613223606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-6acb14a1-79a7-416f-a173-fbf3ee4fa02f 1073741824" returned: 0 in 1.260s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:36:46 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-747dcec3-b675-4576-b96f-e35fc5ab2232 tempest-VolumesActionsTest-613223606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-6acb14a1-79a7-416f-a173-fbf3ee4fa02f {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:36:46 devstack sudo[109981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-6acb14a1-79a7-416f-a173-fbf3ee4fa02f Jun 29 03:36:46 devstack sudo[109981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:36:46 devstack sudo[109975]: pam_unix(sudo:session): session closed for user root Jun 29 03:36:46 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-650703dc-d960-4016-9221-3837978af3a9 tempest-VolumeDependencyTests-1733539683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-1b8cf38d-60ae-44a6-8b53-18a28ceddd88" returned: 0 in 0.972s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:36:46 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-650703dc-d960-4016-9221-3837978af3a9 tempest-VolumeDependencyTests-1733539683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-1b8cf38d-60ae-44a6-8b53-18a28ceddd88.caa92a3b-200a-4d38-b153-7cd780538051 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:36:46 devstack sudo[109987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-1b8cf38d-60ae-44a6-8b53-18a28ceddd88.caa92a3b-200a-4d38-b153-7cd780538051 Jun 29 03:36:46 devstack sudo[109987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:36:47 devstack sudo[109981]: pam_unix(sudo:session): session closed for user root Jun 29 03:36:47 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-747dcec3-b675-4576-b96f-e35fc5ab2232 tempest-VolumesActionsTest-613223606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-6acb14a1-79a7-416f-a173-fbf3ee4fa02f" returned: 0 in 0.843s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:36:47 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-747dcec3-b675-4576-b96f-e35fc5ab2232 tempest-VolumesActionsTest-613223606 None] <== create_volume: return (2170ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:36:47 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-747dcec3-b675-4576-b96f-e35fc5ab2232 tempest-VolumesActionsTest-613223606 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.177s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:36:47 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-747dcec3-b675-4576-b96f-e35fc5ab2232 tempest-VolumesActionsTest-613223606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6da4743-9cb0-4a64-95ac-89e4865297bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6acb14a1-79a7-416f-a173-fbf3ee4fa02f', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:36:47 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-747dcec3-b675-4576-b96f-e35fc5ab2232 tempest-VolumesActionsTest-613223606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be38ca6f-4f30-4b74-a361-468f81b3b733) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:36:47 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-747dcec3-b675-4576-b96f-e35fc5ab2232 tempest-VolumesActionsTest-613223606 None] Volume volume-6acb14a1-79a7-416f-a173-fbf3ee4fa02f (6acb14a1-79a7-416f-a173-fbf3ee4fa02f): created successfully Jun 29 03:36:47 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-747dcec3-b675-4576-b96f-e35fc5ab2232 tempest-VolumesActionsTest-613223606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be38ca6f-4f30-4b74-a361-468f81b3b733) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:36:47 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-747dcec3-b675-4576-b96f-e35fc5ab2232 tempest-VolumesActionsTest-613223606 None] Flow 'volume_create_manager' (2c4d4dd1-635f-44fd-b6ee-25f05e049945) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:36:47 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-747dcec3-b675-4576-b96f-e35fc5ab2232 tempest-VolumesActionsTest-613223606 None] Created volume successfully. Jun 29 03:36:47 devstack sudo[109987]: pam_unix(sudo:session): session closed for user root Jun 29 03:36:47 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-650703dc-d960-4016-9221-3837978af3a9 tempest-VolumeDependencyTests-1733539683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-1b8cf38d-60ae-44a6-8b53-18a28ceddd88.caa92a3b-200a-4d38-b153-7cd780538051" returned: 0 in 1.071s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:36:47 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-650703dc-d960-4016-9221-3837978af3a9 tempest-VolumeDependencyTests-1733539683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-1b8cf38d-60ae-44a6-8b53-18a28ceddd88.caa92a3b-200a-4d38-b153-7cd780538051 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:36:47 devstack sudo[109993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-1b8cf38d-60ae-44a6-8b53-18a28ceddd88.caa92a3b-200a-4d38-b153-7cd780538051 Jun 29 03:36:47 devstack sudo[109993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:36:48 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-5b6fe0a7-f3ec-42b1-89a9-c019f46fd122 tempest-VolumesActionsTest-1356070032 None] Acquiring lock "cinder-6acb14a1-79a7-416f-a173-fbf3ee4fa02f-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:36:48 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-5b6fe0a7-f3ec-42b1-89a9-c019f46fd122 tempest-VolumesActionsTest-1356070032 None] Lock "cinder-6acb14a1-79a7-416f-a173-fbf3ee4fa02f-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:36:48 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-5b6fe0a7-f3ec-42b1-89a9-c019f46fd122 tempest-VolumesActionsTest-1356070032 None] Acquiring lock "cinder-quobyte-6acb14a1-79a7-416f-a173-fbf3ee4fa02f" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:36:48 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-5b6fe0a7-f3ec-42b1-89a9-c019f46fd122 tempest-VolumesActionsTest-1356070032 None] Lock "cinder-quobyte-6acb14a1-79a7-416f-a173-fbf3ee4fa02f" acquired by "delete_volume" :: waited 0.021s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:36:48 devstack sudo[109993]: pam_unix(sudo:session): session closed for user root Jun 29 03:36:48 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-650703dc-d960-4016-9221-3837978af3a9 tempest-VolumeDependencyTests-1733539683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-1b8cf38d-60ae-44a6-8b53-18a28ceddd88.caa92a3b-200a-4d38-b153-7cd780538051" returned: 0 in 0.812s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:36:48 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ac0cc20-0e27-4a4d-8bd1-69a148443478]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:36:48 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-5b6fe0a7-f3ec-42b1-89a9-c019f46fd122 tempest-VolumesActionsTest-1356070032 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-6acb14a1-79a7-416f-a173-fbf3ee4fa02f {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:36:48 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-650703dc-d960-4016-9221-3837978af3a9 tempest-VolumeDependencyTests-1733539683 None] Lock "cinder-quobyte-caa92a3b-200a-4d38-b153-7cd780538051" released by "_delete_snapshot" :: held 4.287s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:36:48 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-650703dc-d960-4016-9221-3837978af3a9 tempest-VolumeDependencyTests-1733539683 None] Lock "cinder-quobyte-1b8cf38d-60ae-44a6-8b53-18a28ceddd88" released by "delete_snapshot" :: held 4.342s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:36:48 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-650703dc-d960-4016-9221-3837978af3a9 tempest-VolumeDependencyTests-1733539683 None] Created reservations ['b0ce6cb7-1106-4944-933b-d22c125c8ce5', '1eb90a45-1b60-4259-af07-f1cd4ca43c39', '2f499f0d-3b47-4b3c-8994-afff6f3caaf4', '952bad92-decf-4784-812b-b2de8f8fba3d'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:36:48 devstack sudo[109996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-6acb14a1-79a7-416f-a173-fbf3ee4fa02f Jun 29 03:36:48 devstack sudo[109996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:36:48 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-650703dc-d960-4016-9221-3837978af3a9 tempest-VolumeDependencyTests-1733539683 None] Delete snapshot completed successfully. Jun 29 03:36:48 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-650703dc-d960-4016-9221-3837978af3a9 tempest-VolumeDependencyTests-1733539683 None] Lock "cinder-caa92a3b-200a-4d38-b153-7cd780538051-delete_snapshot" released by "delete_snapshot" :: held 4.535s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:36:49 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-93f9305f-f846-491c-820f-a8b50957948b tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:36:49 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-93f9305f-f846-491c-820f-a8b50957948b tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Flow 'volume_create_manager' (e4e6d1b7-80cf-40d3-bce8-ead9f99c6ab6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:36:49 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-93f9305f-f846-491c-820f-a8b50957948b tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef99d27c-91ec-4731-8117-7c13b3a70c8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:36:49 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-93f9305f-f846-491c-820f-a8b50957948b tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef99d27c-91ec-4731-8117-7c13b3a70c8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:36:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-546218787',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a4c9cfd-96cf-4c12-9a22-18a278a490aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33449e7960d2463da9c00aa12d513ebf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:36:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:36:49Z,use_quota=True,user_id='9a0eb6fa4c8e4da9ab38564aca8a189e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:36:49 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-93f9305f-f846-491c-820f-a8b50957948b tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6da0c82e-edf8-4951-918b-48acbd3be30a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:36:49 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-93f9305f-f846-491c-820f-a8b50957948b tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6da0c82e-edf8-4951-918b-48acbd3be30a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:36:49 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-93f9305f-f846-491c-820f-a8b50957948b tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b2d02cb-7af4-4e7d-8332-456693490039) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:36:49 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-93f9305f-f846-491c-820f-a8b50957948b tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b2d02cb-7af4-4e7d-8332-456693490039) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a4c9cfd-96cf-4c12-9a22-18a278a490aa', 'volume_name': 'volume-1a4c9cfd-96cf-4c12-9a22-18a278a490aa', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:36:49 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-93f9305f-f846-491c-820f-a8b50957948b tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bd2a336-a8fb-4e4c-8ff0-cbba4b34e3cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:36:49 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-93f9305f-f846-491c-820f-a8b50957948b tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bd2a336-a8fb-4e4c-8ff0-cbba4b34e3cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:36:49 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-93f9305f-f846-491c-820f-a8b50957948b tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc828776-0a8f-4416-90d5-8ae6251e5c07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:36:49 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-93f9305f-f846-491c-820f-a8b50957948b tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Volume 1a4c9cfd-96cf-4c12-9a22-18a278a490aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a4c9cfd-96cf-4c12-9a22-18a278a490aa', 'volume_size': 1} Jun 29 03:36:49 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-93f9305f-f846-491c-820f-a8b50957948b tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:36:49 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-93f9305f-f846-491c-820f-a8b50957948b tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:36:49 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-93f9305f-f846-491c-820f-a8b50957948b tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:36:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-546218787',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a4c9cfd-96cf-4c12-9a22-18a278a490aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33449e7960d2463da9c00aa12d513ebf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:36:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:36:49Z,use_quota=True,user_id='9a0eb6fa4c8e4da9ab38564aca8a189e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:36:49 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-93f9305f-f846-491c-820f-a8b50957948b tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Creating volume 1a4c9cfd-96cf-4c12-9a22-18a278a490aa {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:36:49 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-93f9305f-f846-491c-820f-a8b50957948b tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:36:49 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-93f9305f-f846-491c-820f-a8b50957948b tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:36:49 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-93f9305f-f846-491c-820f-a8b50957948b tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:36:49 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-93f9305f-f846-491c-820f-a8b50957948b tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:36:49 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-93f9305f-f846-491c-820f-a8b50957948b tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:36:49 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-93f9305f-f846-491c-820f-a8b50957948b tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Selected osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:36:49 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-93f9305f-f846-491c-820f-a8b50957948b tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] casted to osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f Jun 29 03:36:49 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-93f9305f-f846-491c-820f-a8b50957948b tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-1a4c9cfd-96cf-4c12-9a22-18a278a490aa 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:36:49 devstack sudo[110001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-1a4c9cfd-96cf-4c12-9a22-18a278a490aa 1073741824 Jun 29 03:36:49 devstack sudo[110001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:36:49 devstack sudo[109996]: pam_unix(sudo:session): session closed for user root Jun 29 03:36:49 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-5b6fe0a7-f3ec-42b1-89a9-c019f46fd122 tempest-VolumesActionsTest-1356070032 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-6acb14a1-79a7-416f-a173-fbf3ee4fa02f" returned: 0 in 0.872s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:36:49 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-5b6fe0a7-f3ec-42b1-89a9-c019f46fd122 tempest-VolumesActionsTest-1356070032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-6acb14a1-79a7-416f-a173-fbf3ee4fa02f {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:36:49 devstack sudo[110003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-6acb14a1-79a7-416f-a173-fbf3ee4fa02f Jun 29 03:36:49 devstack sudo[110003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:36:49 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-f99d789a-9141-40d5-8105-16b2b84b4052 tempest-VolumeDependencyTests-1733539683 None] Acquiring lock "cinder-1b8cf38d-60ae-44a6-8b53-18a28ceddd88-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:36:49 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-f99d789a-9141-40d5-8105-16b2b84b4052 tempest-VolumeDependencyTests-1733539683 None] Lock "cinder-1b8cf38d-60ae-44a6-8b53-18a28ceddd88-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:36:49 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-f99d789a-9141-40d5-8105-16b2b84b4052 tempest-VolumeDependencyTests-1733539683 None] Acquiring lock "cinder-quobyte-1b8cf38d-60ae-44a6-8b53-18a28ceddd88" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:36:49 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-f99d789a-9141-40d5-8105-16b2b84b4052 tempest-VolumeDependencyTests-1733539683 None] Lock "cinder-quobyte-1b8cf38d-60ae-44a6-8b53-18a28ceddd88" acquired by "delete_volume" :: waited 0.030s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:36:49 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[72eb8a98-8824-4400-87a4-3f2824905475]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:36:49 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-f99d789a-9141-40d5-8105-16b2b84b4052 tempest-VolumeDependencyTests-1733539683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-1b8cf38d-60ae-44a6-8b53-18a28ceddd88 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:36:50 devstack sudo[110005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-1b8cf38d-60ae-44a6-8b53-18a28ceddd88 Jun 29 03:36:50 devstack sudo[110005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:36:50 devstack sudo[110003]: pam_unix(sudo:session): session closed for user root Jun 29 03:36:50 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-5b6fe0a7-f3ec-42b1-89a9-c019f46fd122 tempest-VolumesActionsTest-1356070032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-6acb14a1-79a7-416f-a173-fbf3ee4fa02f" returned: 0 in 0.717s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:36:50 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-5b6fe0a7-f3ec-42b1-89a9-c019f46fd122 tempest-VolumesActionsTest-1356070032 None] Lock "cinder-quobyte-6acb14a1-79a7-416f-a173-fbf3ee4fa02f" released by "delete_volume" :: held 1.683s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:36:50 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-5b6fe0a7-f3ec-42b1-89a9-c019f46fd122 tempest-VolumesActionsTest-1356070032 None] Created reservations ['c21c9e8a-9c6f-4dd0-87d6-5e649666b749', 'a1af002d-7f35-4ebc-91a4-50a62d67e9da', 'f8becb58-e84e-4852-ba2a-2e059c191585', '2e883aee-139d-4fdd-9e22-40a12568be6f'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:36:50 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-5b6fe0a7-f3ec-42b1-89a9-c019f46fd122 tempest-VolumesActionsTest-1356070032 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:36:50 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-5b6fe0a7-f3ec-42b1-89a9-c019f46fd122 tempest-VolumesActionsTest-1356070032 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:36:50 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-5b6fe0a7-f3ec-42b1-89a9-c019f46fd122 tempest-VolumesActionsTest-1356070032 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:36:50 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-5b6fe0a7-f3ec-42b1-89a9-c019f46fd122 tempest-VolumesActionsTest-1356070032 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:36:50 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-5b6fe0a7-f3ec-42b1-89a9-c019f46fd122 tempest-VolumesActionsTest-1356070032 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:36:50 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-5b6fe0a7-f3ec-42b1-89a9-c019f46fd122 tempest-VolumesActionsTest-1356070032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:36:50 devstack sudo[110001]: pam_unix(sudo:session): session closed for user root Jun 29 03:36:50 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-93f9305f-f846-491c-820f-a8b50957948b tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-1a4c9cfd-96cf-4c12-9a22-18a278a490aa 1073741824" returned: 0 in 0.973s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:36:50 devstack sudo[110012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf Jun 29 03:36:50 devstack sudo[110012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:36:50 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-93f9305f-f846-491c-820f-a8b50957948b tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-1a4c9cfd-96cf-4c12-9a22-18a278a490aa {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:36:50 devstack sudo[110014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-1a4c9cfd-96cf-4c12-9a22-18a278a490aa Jun 29 03:36:50 devstack sudo[110014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:36:51 devstack sudo[110005]: pam_unix(sudo:session): session closed for user root Jun 29 03:36:51 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-f99d789a-9141-40d5-8105-16b2b84b4052 tempest-VolumeDependencyTests-1733539683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-1b8cf38d-60ae-44a6-8b53-18a28ceddd88" returned: 0 in 1.065s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:36:51 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-f99d789a-9141-40d5-8105-16b2b84b4052 tempest-VolumeDependencyTests-1733539683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-1b8cf38d-60ae-44a6-8b53-18a28ceddd88 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:36:51 devstack sudo[110019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-1b8cf38d-60ae-44a6-8b53-18a28ceddd88 Jun 29 03:36:51 devstack sudo[110019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:36:51 devstack sudo[110012]: pam_unix(sudo:session): session closed for user root Jun 29 03:36:51 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-5b6fe0a7-f3ec-42b1-89a9-c019f46fd122 tempest-VolumesActionsTest-1356070032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf" returned: 0 in 1.009s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:36:51 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-5b6fe0a7-f3ec-42b1-89a9-c019f46fd122 tempest-VolumesActionsTest-1356070032 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:36:51 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-5b6fe0a7-f3ec-42b1-89a9-c019f46fd122 tempest-VolumesActionsTest-1356070032 None] Deleted volume successfully. Jun 29 03:36:51 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-5b6fe0a7-f3ec-42b1-89a9-c019f46fd122 tempest-VolumesActionsTest-1356070032 None] Lock "cinder-6acb14a1-79a7-416f-a173-fbf3ee4fa02f-delete_volume" released by "delete_volume" :: held 2.979s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:36:51 devstack sudo[110014]: pam_unix(sudo:session): session closed for user root Jun 29 03:36:51 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-93f9305f-f846-491c-820f-a8b50957948b tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-1a4c9cfd-96cf-4c12-9a22-18a278a490aa" returned: 0 in 1.273s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:36:51 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-93f9305f-f846-491c-820f-a8b50957948b tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] <== create_volume: return (2298ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:36:51 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-93f9305f-f846-491c-820f-a8b50957948b tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.301s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:36:51 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-93f9305f-f846-491c-820f-a8b50957948b tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc828776-0a8f-4416-90d5-8ae6251e5c07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a4c9cfd-96cf-4c12-9a22-18a278a490aa', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:36:51 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-93f9305f-f846-491c-820f-a8b50957948b tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5c95ac1-9170-4d7f-b0bd-98b658e7c1c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:36:51 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-93f9305f-f846-491c-820f-a8b50957948b tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Volume volume-1a4c9cfd-96cf-4c12-9a22-18a278a490aa (1a4c9cfd-96cf-4c12-9a22-18a278a490aa): created successfully Jun 29 03:36:51 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-93f9305f-f846-491c-820f-a8b50957948b tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5c95ac1-9170-4d7f-b0bd-98b658e7c1c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:36:51 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-93f9305f-f846-491c-820f-a8b50957948b tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Flow 'volume_create_manager' (e4e6d1b7-80cf-40d3-bce8-ead9f99c6ab6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:36:51 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-80d88871-5b66-423a-a3e6-af71f1136da3 tempest-VolumesActionsTest-613223606 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:36:51 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-80d88871-5b66-423a-a3e6-af71f1136da3 tempest-VolumesActionsTest-613223606 None] Flow 'volume_create_manager' (8817543c-7d7a-428b-9fe1-f42a9bf8d313) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:36:51 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-80d88871-5b66-423a-a3e6-af71f1136da3 tempest-VolumesActionsTest-613223606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70ea18a9-a1b6-470b-afc8-ab6aef2a212f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:36:51 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-93f9305f-f846-491c-820f-a8b50957948b tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Created volume successfully. Jun 29 03:36:51 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-80d88871-5b66-423a-a3e6-af71f1136da3 tempest-VolumesActionsTest-613223606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70ea18a9-a1b6-470b-afc8-ab6aef2a212f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:36:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1751299446',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96fcfb75-0d45-4786-93ac-f9115b90752f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1532758db6b54b66a2e5c4709e8cfdf7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:36:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:36:52Z,use_quota=True,user_id='b5900938aa1642a58d248cc9fd4c336a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:36:51 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-80d88871-5b66-423a-a3e6-af71f1136da3 tempest-VolumesActionsTest-613223606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d08b338d-7033-4e5e-a267-948fc7ae2274) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:36:51 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-80d88871-5b66-423a-a3e6-af71f1136da3 tempest-VolumesActionsTest-613223606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d08b338d-7033-4e5e-a267-948fc7ae2274) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:36:51 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-80d88871-5b66-423a-a3e6-af71f1136da3 tempest-VolumesActionsTest-613223606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a853c40-74bb-48b4-b0a5-c586e9a8a57a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:36:51 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-80d88871-5b66-423a-a3e6-af71f1136da3 tempest-VolumesActionsTest-613223606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a853c40-74bb-48b4-b0a5-c586e9a8a57a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '96fcfb75-0d45-4786-93ac-f9115b90752f', 'volume_name': 'volume-96fcfb75-0d45-4786-93ac-f9115b90752f', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:36:51 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-80d88871-5b66-423a-a3e6-af71f1136da3 tempest-VolumesActionsTest-613223606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0f47a47-e86e-4537-bd05-59bb8004117d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:36:52 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-80d88871-5b66-423a-a3e6-af71f1136da3 tempest-VolumesActionsTest-613223606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0f47a47-e86e-4537-bd05-59bb8004117d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:36:52 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-80d88871-5b66-423a-a3e6-af71f1136da3 tempest-VolumesActionsTest-613223606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd8149ea-0546-477c-889c-ab9ff3af7350) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:36:52 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-80d88871-5b66-423a-a3e6-af71f1136da3 tempest-VolumesActionsTest-613223606 None] Volume 96fcfb75-0d45-4786-93ac-f9115b90752f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-96fcfb75-0d45-4786-93ac-f9115b90752f', 'volume_size': 1} Jun 29 03:36:52 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-80d88871-5b66-423a-a3e6-af71f1136da3 tempest-VolumesActionsTest-613223606 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:36:52 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-80d88871-5b66-423a-a3e6-af71f1136da3 tempest-VolumesActionsTest-613223606 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:36:52 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-80d88871-5b66-423a-a3e6-af71f1136da3 tempest-VolumesActionsTest-613223606 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:36:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1751299446',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96fcfb75-0d45-4786-93ac-f9115b90752f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1532758db6b54b66a2e5c4709e8cfdf7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:36:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:36:52Z,use_quota=True,user_id='b5900938aa1642a58d248cc9fd4c336a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:36:52 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-80d88871-5b66-423a-a3e6-af71f1136da3 tempest-VolumesActionsTest-613223606 None] Creating volume 96fcfb75-0d45-4786-93ac-f9115b90752f {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:36:52 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-80d88871-5b66-423a-a3e6-af71f1136da3 tempest-VolumesActionsTest-613223606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:36:52 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-80d88871-5b66-423a-a3e6-af71f1136da3 tempest-VolumesActionsTest-613223606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:36:52 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-80d88871-5b66-423a-a3e6-af71f1136da3 tempest-VolumesActionsTest-613223606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:36:52 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-80d88871-5b66-423a-a3e6-af71f1136da3 tempest-VolumesActionsTest-613223606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:36:52 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-80d88871-5b66-423a-a3e6-af71f1136da3 tempest-VolumesActionsTest-613223606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:36:52 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-80d88871-5b66-423a-a3e6-af71f1136da3 tempest-VolumesActionsTest-613223606 None] Selected osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:36:52 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-80d88871-5b66-423a-a3e6-af71f1136da3 tempest-VolumesActionsTest-613223606 None] casted to osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f Jun 29 03:36:52 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-80d88871-5b66-423a-a3e6-af71f1136da3 tempest-VolumesActionsTest-613223606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-96fcfb75-0d45-4786-93ac-f9115b90752f 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:36:52 devstack sudo[110025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-96fcfb75-0d45-4786-93ac-f9115b90752f 1073741824 Jun 29 03:36:52 devstack sudo[110025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:36:52 devstack sudo[110019]: pam_unix(sudo:session): session closed for user root Jun 29 03:36:52 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-f99d789a-9141-40d5-8105-16b2b84b4052 tempest-VolumeDependencyTests-1733539683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-1b8cf38d-60ae-44a6-8b53-18a28ceddd88" returned: 0 in 1.180s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:36:52 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-f99d789a-9141-40d5-8105-16b2b84b4052 tempest-VolumeDependencyTests-1733539683 None] Lock "cinder-quobyte-1b8cf38d-60ae-44a6-8b53-18a28ceddd88" released by "delete_volume" :: held 2.333s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:36:52 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-f99d789a-9141-40d5-8105-16b2b84b4052 tempest-VolumeDependencyTests-1733539683 None] Created reservations ['8acbea04-3a8a-4357-bc09-539605ccaa35', '010f5275-44e2-4920-8bb7-91a6593e967f', 'f307d850-4766-4690-b9a0-3744ad3ac96c', '1887abc0-4f67-4f4d-aa63-5f97c40bc434'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:36:52 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-f99d789a-9141-40d5-8105-16b2b84b4052 tempest-VolumeDependencyTests-1733539683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:36:52 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-f99d789a-9141-40d5-8105-16b2b84b4052 tempest-VolumeDependencyTests-1733539683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:36:52 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-f99d789a-9141-40d5-8105-16b2b84b4052 tempest-VolumeDependencyTests-1733539683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:36:52 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-f99d789a-9141-40d5-8105-16b2b84b4052 tempest-VolumeDependencyTests-1733539683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:36:52 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-f99d789a-9141-40d5-8105-16b2b84b4052 tempest-VolumeDependencyTests-1733539683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:36:52 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-f99d789a-9141-40d5-8105-16b2b84b4052 tempest-VolumeDependencyTests-1733539683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:36:52 devstack sudo[110027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf Jun 29 03:36:52 devstack sudo[110027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:36:53 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-4d0d9c33-484f-47b9-8749-37a1edd12f95 tempest-VolumeDependencyTests-1733539683 None] Acquiring lock "cinder-667f0097-eb99-4368-be65-fc29b75c07f7-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:36:53 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-4d0d9c33-484f-47b9-8749-37a1edd12f95 tempest-VolumeDependencyTests-1733539683 None] Lock "cinder-667f0097-eb99-4368-be65-fc29b75c07f7-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:36:53 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-4d0d9c33-484f-47b9-8749-37a1edd12f95 tempest-VolumeDependencyTests-1733539683 None] Acquiring lock "cinder-quobyte-667f0097-eb99-4368-be65-fc29b75c07f7" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:36:53 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-4d0d9c33-484f-47b9-8749-37a1edd12f95 tempest-VolumeDependencyTests-1733539683 None] Lock "cinder-quobyte-667f0097-eb99-4368-be65-fc29b75c07f7" acquired by "delete_volume" :: waited 0.034s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:36:53 devstack sudo[110027]: pam_unix(sudo:session): session closed for user root Jun 29 03:36:53 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-f99d789a-9141-40d5-8105-16b2b84b4052 tempest-VolumeDependencyTests-1733539683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf" returned: 0 in 1.147s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:36:53 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-f99d789a-9141-40d5-8105-16b2b84b4052 tempest-VolumeDependencyTests-1733539683 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:36:53 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cac58ef-bc4b-47ca-87cd-ec74c2358e6f]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:36:53 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-4d0d9c33-484f-47b9-8749-37a1edd12f95 tempest-VolumeDependencyTests-1733539683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-667f0097-eb99-4368-be65-fc29b75c07f7 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:36:53 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-f99d789a-9141-40d5-8105-16b2b84b4052 tempest-VolumeDependencyTests-1733539683 None] Deleted volume successfully. Jun 29 03:36:53 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-f99d789a-9141-40d5-8105-16b2b84b4052 tempest-VolumeDependencyTests-1733539683 None] Lock "cinder-1b8cf38d-60ae-44a6-8b53-18a28ceddd88-delete_volume" released by "delete_volume" :: held 3.815s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:36:53 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c3ccfa8-d129-4721-a4f0-cfa1b8ce6272 tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:36:53 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-0c3ccfa8-d129-4721-a4f0-cfa1b8ce6272 tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Flow 'volume_create_manager' (534ba104-c8e9-4904-b7a6-9a539a9d202b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:36:53 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-0c3ccfa8-d129-4721-a4f0-cfa1b8ce6272 tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f33d128b-404b-4670-936f-b37b176158d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:36:53 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-0c3ccfa8-d129-4721-a4f0-cfa1b8ce6272 tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f33d128b-404b-4670-936f-b37b176158d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:36:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1184032190',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ccc07ab-a8d0-40af-8eae-296645be7caa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33449e7960d2463da9c00aa12d513ebf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:36:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:36:54Z,use_quota=True,user_id='9a0eb6fa4c8e4da9ab38564aca8a189e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:36:53 devstack sudo[110025]: pam_unix(sudo:session): session closed for user root Jun 29 03:36:53 devstack sudo[110033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-667f0097-eb99-4368-be65-fc29b75c07f7 Jun 29 03:36:53 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-0c3ccfa8-d129-4721-a4f0-cfa1b8ce6272 tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b62bfe86-96a2-4190-b662-835f7de0a3c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:36:53 devstack sudo[110033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:36:53 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-0c3ccfa8-d129-4721-a4f0-cfa1b8ce6272 tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b62bfe86-96a2-4190-b662-835f7de0a3c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:36:53 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-0c3ccfa8-d129-4721-a4f0-cfa1b8ce6272 tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4814883-e528-4e95-a58c-1f14780f320e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:36:53 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-0c3ccfa8-d129-4721-a4f0-cfa1b8ce6272 tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4814883-e528-4e95-a58c-1f14780f320e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ccc07ab-a8d0-40af-8eae-296645be7caa', 'volume_name': 'volume-9ccc07ab-a8d0-40af-8eae-296645be7caa', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:36:53 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-0c3ccfa8-d129-4721-a4f0-cfa1b8ce6272 tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4930698-c660-4c7c-ab2e-2e8dbbfe8249) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:36:53 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-0c3ccfa8-d129-4721-a4f0-cfa1b8ce6272 tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4930698-c660-4c7c-ab2e-2e8dbbfe8249) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:36:53 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-0c3ccfa8-d129-4721-a4f0-cfa1b8ce6272 tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5ef6114-0692-4e36-8c63-016296a56ecb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:36:53 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-0c3ccfa8-d129-4721-a4f0-cfa1b8ce6272 tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Volume 9ccc07ab-a8d0-40af-8eae-296645be7caa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ccc07ab-a8d0-40af-8eae-296645be7caa', 'volume_size': 1} Jun 29 03:36:53 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-0c3ccfa8-d129-4721-a4f0-cfa1b8ce6272 tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:36:53 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-80d88871-5b66-423a-a3e6-af71f1136da3 tempest-VolumesActionsTest-613223606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-96fcfb75-0d45-4786-93ac-f9115b90752f 1073741824" returned: 0 in 1.713s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:36:53 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-80d88871-5b66-423a-a3e6-af71f1136da3 tempest-VolumesActionsTest-613223606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-96fcfb75-0d45-4786-93ac-f9115b90752f {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:36:53 devstack sudo[110035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-96fcfb75-0d45-4786-93ac-f9115b90752f Jun 29 03:36:53 devstack sudo[110035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:36:54 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a0f3dd9-08e1-4722-84cd-af47974c52bd tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:36:54 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-2a0f3dd9-08e1-4722-84cd-af47974c52bd tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Flow 'volume_create_manager' (3f99c4a5-d8d2-4c71-9936-8550e01dc7cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:36:54 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-2a0f3dd9-08e1-4722-84cd-af47974c52bd tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ee0a3f1-b247-4952-aa84-8f7b69a688b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:36:54 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-2a0f3dd9-08e1-4722-84cd-af47974c52bd tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ee0a3f1-b247-4952-aa84-8f7b69a688b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:36:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1297386483',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b621a92-cb64-4ec4-b4e0-8bacd726e2dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33449e7960d2463da9c00aa12d513ebf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:36:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:36:54Z,use_quota=True,user_id='9a0eb6fa4c8e4da9ab38564aca8a189e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:36:54 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-2a0f3dd9-08e1-4722-84cd-af47974c52bd tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dec1628d-db35-45d1-adf9-b61599d38be7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:36:54 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-2a0f3dd9-08e1-4722-84cd-af47974c52bd tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dec1628d-db35-45d1-adf9-b61599d38be7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:36:54 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-2a0f3dd9-08e1-4722-84cd-af47974c52bd tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d6e2d2a-1c6b-48b1-9294-20d1c4cbe789) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:36:54 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-2a0f3dd9-08e1-4722-84cd-af47974c52bd tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d6e2d2a-1c6b-48b1-9294-20d1c4cbe789) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b621a92-cb64-4ec4-b4e0-8bacd726e2dd', 'volume_name': 'volume-4b621a92-cb64-4ec4-b4e0-8bacd726e2dd', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:36:54 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-2a0f3dd9-08e1-4722-84cd-af47974c52bd tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ee5f659-835b-4019-8ec3-8feb8ef5d479) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:36:54 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-2a0f3dd9-08e1-4722-84cd-af47974c52bd tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ee5f659-835b-4019-8ec3-8feb8ef5d479) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:36:54 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-2a0f3dd9-08e1-4722-84cd-af47974c52bd tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d29c562e-d44a-4dec-a54e-7755fa5ffaeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:36:54 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-2a0f3dd9-08e1-4722-84cd-af47974c52bd tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Volume 4b621a92-cb64-4ec4-b4e0-8bacd726e2dd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b621a92-cb64-4ec4-b4e0-8bacd726e2dd', 'volume_size': 1} Jun 29 03:36:54 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-2a0f3dd9-08e1-4722-84cd-af47974c52bd tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:36:54 devstack sudo[110033]: pam_unix(sudo:session): session closed for user root Jun 29 03:36:54 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-4d0d9c33-484f-47b9-8749-37a1edd12f95 tempest-VolumeDependencyTests-1733539683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-667f0097-eb99-4368-be65-fc29b75c07f7" returned: 0 in 1.302s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:36:54 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-4d0d9c33-484f-47b9-8749-37a1edd12f95 tempest-VolumeDependencyTests-1733539683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-667f0097-eb99-4368-be65-fc29b75c07f7 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:36:54 devstack sudo[110041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-667f0097-eb99-4368-be65-fc29b75c07f7 Jun 29 03:36:54 devstack sudo[110041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:36:54 devstack sudo[110035]: pam_unix(sudo:session): session closed for user root Jun 29 03:36:54 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-80d88871-5b66-423a-a3e6-af71f1136da3 tempest-VolumesActionsTest-613223606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-96fcfb75-0d45-4786-93ac-f9115b90752f" returned: 0 in 1.116s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:36:54 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-80d88871-5b66-423a-a3e6-af71f1136da3 tempest-VolumesActionsTest-613223606 None] <== create_volume: return (2934ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:36:54 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-80d88871-5b66-423a-a3e6-af71f1136da3 tempest-VolumesActionsTest-613223606 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.940s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:36:54 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-0c3ccfa8-d129-4721-a4f0-cfa1b8ce6272 tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.209s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:36:54 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-0c3ccfa8-d129-4721-a4f0-cfa1b8ce6272 tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:36:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1184032190',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ccc07ab-a8d0-40af-8eae-296645be7caa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33449e7960d2463da9c00aa12d513ebf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:36:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:36:54Z,use_quota=True,user_id='9a0eb6fa4c8e4da9ab38564aca8a189e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:36:54 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-0c3ccfa8-d129-4721-a4f0-cfa1b8ce6272 tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Creating volume 9ccc07ab-a8d0-40af-8eae-296645be7caa {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:36:54 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-0c3ccfa8-d129-4721-a4f0-cfa1b8ce6272 tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:36:54 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-0c3ccfa8-d129-4721-a4f0-cfa1b8ce6272 tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:36:54 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-0c3ccfa8-d129-4721-a4f0-cfa1b8ce6272 tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:36:54 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-0c3ccfa8-d129-4721-a4f0-cfa1b8ce6272 tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:36:54 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-0c3ccfa8-d129-4721-a4f0-cfa1b8ce6272 tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:36:54 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-0c3ccfa8-d129-4721-a4f0-cfa1b8ce6272 tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Selected osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:36:54 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-0c3ccfa8-d129-4721-a4f0-cfa1b8ce6272 tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] casted to osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f Jun 29 03:36:54 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-0c3ccfa8-d129-4721-a4f0-cfa1b8ce6272 tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9ccc07ab-a8d0-40af-8eae-296645be7caa 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:36:55 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-281adcde-7462-41e0-b33d-62febe20fc42 tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:36:55 devstack sudo[110043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9ccc07ab-a8d0-40af-8eae-296645be7caa 1073741824 Jun 29 03:36:55 devstack sudo[110043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:36:55 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-281adcde-7462-41e0-b33d-62febe20fc42 tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Flow 'volume_create_manager' (24b01704-cda6-4edc-865e-76fe14b2e166) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:36:55 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-281adcde-7462-41e0-b33d-62febe20fc42 tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50e8c8ee-6df3-4abc-ac4f-cf127a0ad309) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:36:55 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-80d88871-5b66-423a-a3e6-af71f1136da3 tempest-VolumesActionsTest-613223606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd8149ea-0546-477c-889c-ab9ff3af7350) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96fcfb75-0d45-4786-93ac-f9115b90752f', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:36:55 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-80d88871-5b66-423a-a3e6-af71f1136da3 tempest-VolumesActionsTest-613223606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a724eec-df3d-4e47-afe0-f0f299364e80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:36:55 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-281adcde-7462-41e0-b33d-62febe20fc42 tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50e8c8ee-6df3-4abc-ac4f-cf127a0ad309) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:36:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1145776241',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fbbd084c-3f07-4b2b-8e6f-827a1de4b9c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33449e7960d2463da9c00aa12d513ebf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:36:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:36:55Z,use_quota=True,user_id='9a0eb6fa4c8e4da9ab38564aca8a189e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:36:55 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-281adcde-7462-41e0-b33d-62febe20fc42 tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32b080e1-1ce7-40c5-a663-6bcb9389fb27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:36:55 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-281adcde-7462-41e0-b33d-62febe20fc42 tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32b080e1-1ce7-40c5-a663-6bcb9389fb27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:36:55 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-281adcde-7462-41e0-b33d-62febe20fc42 tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5d400ed-dd57-4b19-b0fc-8b9065cb6c35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:36:55 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-281adcde-7462-41e0-b33d-62febe20fc42 tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5d400ed-dd57-4b19-b0fc-8b9065cb6c35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fbbd084c-3f07-4b2b-8e6f-827a1de4b9c4', 'volume_name': 'volume-fbbd084c-3f07-4b2b-8e6f-827a1de4b9c4', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:36:55 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-281adcde-7462-41e0-b33d-62febe20fc42 tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c03327e0-12dd-4397-bbe8-b6c94b8d3417) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:36:55 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-281adcde-7462-41e0-b33d-62febe20fc42 tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c03327e0-12dd-4397-bbe8-b6c94b8d3417) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:36:55 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-281adcde-7462-41e0-b33d-62febe20fc42 tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c4a8035-8f6d-46ee-9e3d-9e1bf181e884) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:36:55 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-281adcde-7462-41e0-b33d-62febe20fc42 tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Volume fbbd084c-3f07-4b2b-8e6f-827a1de4b9c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fbbd084c-3f07-4b2b-8e6f-827a1de4b9c4', 'volume_size': 1} Jun 29 03:36:55 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-281adcde-7462-41e0-b33d-62febe20fc42 tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:36:55 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-80d88871-5b66-423a-a3e6-af71f1136da3 tempest-VolumesActionsTest-613223606 None] Volume volume-96fcfb75-0d45-4786-93ac-f9115b90752f (96fcfb75-0d45-4786-93ac-f9115b90752f): created successfully Jun 29 03:36:55 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-80d88871-5b66-423a-a3e6-af71f1136da3 tempest-VolumesActionsTest-613223606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a724eec-df3d-4e47-afe0-f0f299364e80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:36:55 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-80d88871-5b66-423a-a3e6-af71f1136da3 tempest-VolumesActionsTest-613223606 None] Flow 'volume_create_manager' (8817543c-7d7a-428b-9fe1-f42a9bf8d313) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:36:55 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-80d88871-5b66-423a-a3e6-af71f1136da3 tempest-VolumesActionsTest-613223606 None] Created volume successfully. Jun 29 03:36:55 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa1fb145-f046-4c5e-a7fc-0e77406bcee8 tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:36:55 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-aa1fb145-f046-4c5e-a7fc-0e77406bcee8 tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Flow 'volume_create_manager' (736e8dae-10b2-4d4e-8d8e-f30aaac98c08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:36:55 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-aa1fb145-f046-4c5e-a7fc-0e77406bcee8 tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (926cadd8-6bfa-4a24-ac20-8c86786cd889) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:36:55 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-aa1fb145-f046-4c5e-a7fc-0e77406bcee8 tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (926cadd8-6bfa-4a24-ac20-8c86786cd889) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:36:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1234237972',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=240ae311-e208-4617-886f-d4977f3e3c21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33449e7960d2463da9c00aa12d513ebf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:36:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:36:56Z,use_quota=True,user_id='9a0eb6fa4c8e4da9ab38564aca8a189e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:36:55 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-aa1fb145-f046-4c5e-a7fc-0e77406bcee8 tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91406459-5720-4058-9486-8df647eca8c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:36:55 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-aa1fb145-f046-4c5e-a7fc-0e77406bcee8 tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91406459-5720-4058-9486-8df647eca8c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:36:55 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-aa1fb145-f046-4c5e-a7fc-0e77406bcee8 tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bed128ca-c562-4ee4-933f-8423cf0358d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:36:55 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-aa1fb145-f046-4c5e-a7fc-0e77406bcee8 tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bed128ca-c562-4ee4-933f-8423cf0358d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '240ae311-e208-4617-886f-d4977f3e3c21', 'volume_name': 'volume-240ae311-e208-4617-886f-d4977f3e3c21', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:36:55 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-aa1fb145-f046-4c5e-a7fc-0e77406bcee8 tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cc7033a-34ab-4769-8f91-def8e8032f69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:36:55 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-aa1fb145-f046-4c5e-a7fc-0e77406bcee8 tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cc7033a-34ab-4769-8f91-def8e8032f69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:36:55 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-aa1fb145-f046-4c5e-a7fc-0e77406bcee8 tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab6ad135-34bd-4a0e-940f-6dcf5d3b1fc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:36:55 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-aa1fb145-f046-4c5e-a7fc-0e77406bcee8 tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Volume 240ae311-e208-4617-886f-d4977f3e3c21: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-240ae311-e208-4617-886f-d4977f3e3c21', 'volume_size': 1} Jun 29 03:36:55 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-aa1fb145-f046-4c5e-a7fc-0e77406bcee8 tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:36:55 devstack sudo[110041]: pam_unix(sudo:session): session closed for user root Jun 29 03:36:55 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-4d0d9c33-484f-47b9-8749-37a1edd12f95 tempest-VolumeDependencyTests-1733539683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-667f0097-eb99-4368-be65-fc29b75c07f7" returned: 0 in 1.142s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:36:56 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-4d0d9c33-484f-47b9-8749-37a1edd12f95 tempest-VolumeDependencyTests-1733539683 None] Lock "cinder-quobyte-667f0097-eb99-4368-be65-fc29b75c07f7" released by "delete_volume" :: held 2.529s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:36:56 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-4d0d9c33-484f-47b9-8749-37a1edd12f95 tempest-VolumeDependencyTests-1733539683 None] Created reservations ['262f4c16-c63b-492f-9eb1-98892d4936c7', '701e8fc8-4316-432f-bb17-b66686d75766', '9b9fc729-ec66-44b8-8368-5a5d8f17c68e', '1bb3f16d-8963-461f-84cb-e681161fcac2'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:36:56 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-4d0d9c33-484f-47b9-8749-37a1edd12f95 tempest-VolumeDependencyTests-1733539683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:36:56 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-4d0d9c33-484f-47b9-8749-37a1edd12f95 tempest-VolumeDependencyTests-1733539683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:36:56 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-4d0d9c33-484f-47b9-8749-37a1edd12f95 tempest-VolumeDependencyTests-1733539683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:36:56 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-4d0d9c33-484f-47b9-8749-37a1edd12f95 tempest-VolumeDependencyTests-1733539683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:36:56 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-4d0d9c33-484f-47b9-8749-37a1edd12f95 tempest-VolumeDependencyTests-1733539683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:36:56 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-4d0d9c33-484f-47b9-8749-37a1edd12f95 tempest-VolumeDependencyTests-1733539683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:36:56 devstack sudo[110049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf Jun 29 03:36:56 devstack sudo[110049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:36:56 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-711dd3e3-9b83-449e-9475-c668ea7794de tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:36:56 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-711dd3e3-9b83-449e-9475-c668ea7794de tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Flow 'volume_create_manager' (b52b4400-4e7e-4ff5-9032-68c775fbf9a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:36:56 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-711dd3e3-9b83-449e-9475-c668ea7794de tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41f53e6e-4b9d-494c-87c4-8d7d244ed50e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:36:56 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-c5575b7e-3558-4c1e-93df-a86c8c4dffeb tempest-VolumesActionsTest-1356070032 None] Acquiring lock "cinder-96fcfb75-0d45-4786-93ac-f9115b90752f-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:36:56 devstack sudo[110043]: pam_unix(sudo:session): session closed for user root Jun 29 03:36:56 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-711dd3e3-9b83-449e-9475-c668ea7794de tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41f53e6e-4b9d-494c-87c4-8d7d244ed50e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:36:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1310929738',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51d9b0df-570d-427a-8831-861ae54b3d6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33449e7960d2463da9c00aa12d513ebf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:36:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:36:56Z,use_quota=True,user_id='9a0eb6fa4c8e4da9ab38564aca8a189e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:36:56 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-711dd3e3-9b83-449e-9475-c668ea7794de tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b332718-63da-4a49-8ff5-0cdcb6d19462) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:36:56 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-711dd3e3-9b83-449e-9475-c668ea7794de tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b332718-63da-4a49-8ff5-0cdcb6d19462) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:36:56 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-711dd3e3-9b83-449e-9475-c668ea7794de tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f18e6476-6210-4af2-ab6f-582528c09d19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:36:56 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-711dd3e3-9b83-449e-9475-c668ea7794de tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f18e6476-6210-4af2-ab6f-582528c09d19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '51d9b0df-570d-427a-8831-861ae54b3d6c', 'volume_name': 'volume-51d9b0df-570d-427a-8831-861ae54b3d6c', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:36:56 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-711dd3e3-9b83-449e-9475-c668ea7794de tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (271fb568-5575-4a09-9d8e-4c3460643134) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:36:56 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-711dd3e3-9b83-449e-9475-c668ea7794de tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (271fb568-5575-4a09-9d8e-4c3460643134) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:36:56 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-711dd3e3-9b83-449e-9475-c668ea7794de tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3dc337ed-e2b6-4c46-9b74-ba88a116cd56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:36:56 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-711dd3e3-9b83-449e-9475-c668ea7794de tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Volume 51d9b0df-570d-427a-8831-861ae54b3d6c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-51d9b0df-570d-427a-8831-861ae54b3d6c', 'volume_size': 1} Jun 29 03:36:56 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-711dd3e3-9b83-449e-9475-c668ea7794de tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:36:56 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-0c3ccfa8-d129-4721-a4f0-cfa1b8ce6272 tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9ccc07ab-a8d0-40af-8eae-296645be7caa 1073741824" returned: 0 in 1.543s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:36:56 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-c5575b7e-3558-4c1e-93df-a86c8c4dffeb tempest-VolumesActionsTest-1356070032 None] Lock "cinder-96fcfb75-0d45-4786-93ac-f9115b90752f-delete_volume" acquired by "delete_volume" :: waited 0.090s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:36:56 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-0c3ccfa8-d129-4721-a4f0-cfa1b8ce6272 tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9ccc07ab-a8d0-40af-8eae-296645be7caa {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:36:56 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-c5575b7e-3558-4c1e-93df-a86c8c4dffeb tempest-VolumesActionsTest-1356070032 None] Acquiring lock "cinder-quobyte-96fcfb75-0d45-4786-93ac-f9115b90752f" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:36:56 devstack sudo[110051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9ccc07ab-a8d0-40af-8eae-296645be7caa Jun 29 03:36:56 devstack sudo[110051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:36:56 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-c5575b7e-3558-4c1e-93df-a86c8c4dffeb tempest-VolumesActionsTest-1356070032 None] Lock "cinder-quobyte-96fcfb75-0d45-4786-93ac-f9115b90752f" acquired by "delete_volume" :: waited 0.030s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:36:56 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[051abef4-5153-4e4a-8723-43e5f18d1cb9]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:36:56 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c5575b7e-3558-4c1e-93df-a86c8c4dffeb tempest-VolumesActionsTest-1356070032 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-96fcfb75-0d45-4786-93ac-f9115b90752f {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:36:56 devstack sudo[110053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-96fcfb75-0d45-4786-93ac-f9115b90752f Jun 29 03:36:56 devstack sudo[110053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:36:57 devstack sudo[110049]: pam_unix(sudo:session): session closed for user root Jun 29 03:36:57 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-4d0d9c33-484f-47b9-8749-37a1edd12f95 tempest-VolumeDependencyTests-1733539683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf" returned: 0 in 0.891s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:36:57 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-4d0d9c33-484f-47b9-8749-37a1edd12f95 tempest-VolumeDependencyTests-1733539683 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:36:57 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-4d0d9c33-484f-47b9-8749-37a1edd12f95 tempest-VolumeDependencyTests-1733539683 None] Deleted volume successfully. Jun 29 03:36:57 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-4d0d9c33-484f-47b9-8749-37a1edd12f95 tempest-VolumeDependencyTests-1733539683 None] Lock "cinder-667f0097-eb99-4368-be65-fc29b75c07f7-delete_volume" released by "delete_volume" :: held 3.788s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:36:57 devstack sudo[110051]: pam_unix(sudo:session): session closed for user root Jun 29 03:36:57 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-0c3ccfa8-d129-4721-a4f0-cfa1b8ce6272 tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9ccc07ab-a8d0-40af-8eae-296645be7caa" returned: 0 in 0.908s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:36:57 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-0c3ccfa8-d129-4721-a4f0-cfa1b8ce6272 tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] <== create_volume: return (2509ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:36:57 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-0c3ccfa8-d129-4721-a4f0-cfa1b8ce6272 tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.513s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:36:57 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-2a0f3dd9-08e1-4722-84cd-af47974c52bd tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.786s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:36:57 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-2a0f3dd9-08e1-4722-84cd-af47974c52bd tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:36:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1297386483',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b621a92-cb64-4ec4-b4e0-8bacd726e2dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33449e7960d2463da9c00aa12d513ebf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:36:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:36:54Z,use_quota=True,user_id='9a0eb6fa4c8e4da9ab38564aca8a189e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:36:57 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-2a0f3dd9-08e1-4722-84cd-af47974c52bd tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Creating volume 4b621a92-cb64-4ec4-b4e0-8bacd726e2dd {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:36:57 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-2a0f3dd9-08e1-4722-84cd-af47974c52bd tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:36:57 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-2a0f3dd9-08e1-4722-84cd-af47974c52bd tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:36:57 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-2a0f3dd9-08e1-4722-84cd-af47974c52bd tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:36:57 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-2a0f3dd9-08e1-4722-84cd-af47974c52bd tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:36:57 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-2a0f3dd9-08e1-4722-84cd-af47974c52bd tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:36:57 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-2a0f3dd9-08e1-4722-84cd-af47974c52bd tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Selected osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:36:57 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-2a0f3dd9-08e1-4722-84cd-af47974c52bd tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] casted to osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f Jun 29 03:36:57 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2a0f3dd9-08e1-4722-84cd-af47974c52bd tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-4b621a92-cb64-4ec4-b4e0-8bacd726e2dd 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:36:57 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-0c3ccfa8-d129-4721-a4f0-cfa1b8ce6272 tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5ef6114-0692-4e36-8c63-016296a56ecb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ccc07ab-a8d0-40af-8eae-296645be7caa', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:36:57 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-0c3ccfa8-d129-4721-a4f0-cfa1b8ce6272 tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06cf9913-1e5b-4ebb-ac6c-17f389a03f1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:36:57 devstack sudo[110057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-4b621a92-cb64-4ec4-b4e0-8bacd726e2dd 1073741824 Jun 29 03:36:57 devstack sudo[110057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:36:57 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-0c3ccfa8-d129-4721-a4f0-cfa1b8ce6272 tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Volume volume-9ccc07ab-a8d0-40af-8eae-296645be7caa (9ccc07ab-a8d0-40af-8eae-296645be7caa): created successfully Jun 29 03:36:57 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-0c3ccfa8-d129-4721-a4f0-cfa1b8ce6272 tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06cf9913-1e5b-4ebb-ac6c-17f389a03f1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:36:57 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-0c3ccfa8-d129-4721-a4f0-cfa1b8ce6272 tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Flow 'volume_create_manager' (534ba104-c8e9-4904-b7a6-9a539a9d202b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:36:57 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-0c3ccfa8-d129-4721-a4f0-cfa1b8ce6272 tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Created volume successfully. Jun 29 03:36:57 devstack sudo[110053]: pam_unix(sudo:session): session closed for user root Jun 29 03:36:57 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c5575b7e-3558-4c1e-93df-a86c8c4dffeb tempest-VolumesActionsTest-1356070032 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-96fcfb75-0d45-4786-93ac-f9115b90752f" returned: 0 in 1.152s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:36:57 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c5575b7e-3558-4c1e-93df-a86c8c4dffeb tempest-VolumesActionsTest-1356070032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-96fcfb75-0d45-4786-93ac-f9115b90752f {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:36:57 devstack sudo[110062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-96fcfb75-0d45-4786-93ac-f9115b90752f Jun 29 03:36:57 devstack sudo[110062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:36:58 devstack sudo[110062]: pam_unix(sudo:session): session closed for user root Jun 29 03:36:58 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c5575b7e-3558-4c1e-93df-a86c8c4dffeb tempest-VolumesActionsTest-1356070032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-96fcfb75-0d45-4786-93ac-f9115b90752f" returned: 0 in 0.949s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:36:58 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-c5575b7e-3558-4c1e-93df-a86c8c4dffeb tempest-VolumesActionsTest-1356070032 None] Lock "cinder-quobyte-96fcfb75-0d45-4786-93ac-f9115b90752f" released by "delete_volume" :: held 2.161s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:36:58 devstack sudo[110057]: pam_unix(sudo:session): session closed for user root Jun 29 03:36:58 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2a0f3dd9-08e1-4722-84cd-af47974c52bd tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-4b621a92-cb64-4ec4-b4e0-8bacd726e2dd 1073741824" returned: 0 in 1.326s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:36:58 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-c5575b7e-3558-4c1e-93df-a86c8c4dffeb tempest-VolumesActionsTest-1356070032 None] Created reservations ['961a200c-0af0-4d6e-a2bc-5c7f00881b33', '8cfc8340-5200-4528-8629-bb74bf675e58', '2f19ba14-a58d-4b98-9175-2f858dc63fa5', '58c3f03a-9e65-48c7-b3f7-fc718550ec12'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:36:58 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2a0f3dd9-08e1-4722-84cd-af47974c52bd tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-4b621a92-cb64-4ec4-b4e0-8bacd726e2dd {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:36:58 devstack sudo[110069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-4b621a92-cb64-4ec4-b4e0-8bacd726e2dd Jun 29 03:36:58 devstack sudo[110069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:36:58 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-c5575b7e-3558-4c1e-93df-a86c8c4dffeb tempest-VolumesActionsTest-1356070032 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:36:58 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-c5575b7e-3558-4c1e-93df-a86c8c4dffeb tempest-VolumesActionsTest-1356070032 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:36:58 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-c5575b7e-3558-4c1e-93df-a86c8c4dffeb tempest-VolumesActionsTest-1356070032 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:36:58 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-c5575b7e-3558-4c1e-93df-a86c8c4dffeb tempest-VolumesActionsTest-1356070032 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:36:58 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-c5575b7e-3558-4c1e-93df-a86c8c4dffeb tempest-VolumesActionsTest-1356070032 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:36:58 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c5575b7e-3558-4c1e-93df-a86c8c4dffeb tempest-VolumesActionsTest-1356070032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:36:58 devstack sudo[110071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf Jun 29 03:36:58 devstack sudo[110071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:36:59 devstack sudo[110071]: pam_unix(sudo:session): session closed for user root Jun 29 03:36:59 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c5575b7e-3558-4c1e-93df-a86c8c4dffeb tempest-VolumesActionsTest-1356070032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf" returned: 0 in 1.013s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:36:59 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-c5575b7e-3558-4c1e-93df-a86c8c4dffeb tempest-VolumesActionsTest-1356070032 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:36:59 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-c5575b7e-3558-4c1e-93df-a86c8c4dffeb tempest-VolumesActionsTest-1356070032 None] Deleted volume successfully. Jun 29 03:37:00 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-c5575b7e-3558-4c1e-93df-a86c8c4dffeb tempest-VolumesActionsTest-1356070032 None] Lock "cinder-96fcfb75-0d45-4786-93ac-f9115b90752f-delete_volume" released by "delete_volume" :: held 3.486s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:37:00 devstack sudo[110069]: pam_unix(sudo:session): session closed for user root Jun 29 03:37:00 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2a0f3dd9-08e1-4722-84cd-af47974c52bd tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-4b621a92-cb64-4ec4-b4e0-8bacd726e2dd" returned: 0 in 1.232s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:37:00 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-2a0f3dd9-08e1-4722-84cd-af47974c52bd tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] <== create_volume: return (2618ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:37:00 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-2a0f3dd9-08e1-4722-84cd-af47974c52bd tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.623s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:37:00 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-281adcde-7462-41e0-b33d-62febe20fc42 tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.968s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:37:00 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-281adcde-7462-41e0-b33d-62febe20fc42 tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:36:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1145776241',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fbbd084c-3f07-4b2b-8e6f-827a1de4b9c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33449e7960d2463da9c00aa12d513ebf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:36:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:36:55Z,use_quota=True,user_id='9a0eb6fa4c8e4da9ab38564aca8a189e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:37:00 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-281adcde-7462-41e0-b33d-62febe20fc42 tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Creating volume fbbd084c-3f07-4b2b-8e6f-827a1de4b9c4 {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:37:00 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-281adcde-7462-41e0-b33d-62febe20fc42 tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:37:00 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-281adcde-7462-41e0-b33d-62febe20fc42 tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:37:00 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-281adcde-7462-41e0-b33d-62febe20fc42 tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:37:00 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-281adcde-7462-41e0-b33d-62febe20fc42 tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:37:00 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-281adcde-7462-41e0-b33d-62febe20fc42 tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:37:00 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-281adcde-7462-41e0-b33d-62febe20fc42 tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Selected osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:37:00 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-281adcde-7462-41e0-b33d-62febe20fc42 tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] casted to osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f Jun 29 03:37:00 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-281adcde-7462-41e0-b33d-62febe20fc42 tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-fbbd084c-3f07-4b2b-8e6f-827a1de4b9c4 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:37:00 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-2a0f3dd9-08e1-4722-84cd-af47974c52bd tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d29c562e-d44a-4dec-a54e-7755fa5ffaeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b621a92-cb64-4ec4-b4e0-8bacd726e2dd', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:37:00 devstack sudo[110075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-fbbd084c-3f07-4b2b-8e6f-827a1de4b9c4 1073741824 Jun 29 03:37:00 devstack sudo[110075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:37:00 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-2a0f3dd9-08e1-4722-84cd-af47974c52bd tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24cc7a8a-182d-4293-8b9e-1410e0af67b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:37:00 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-2a0f3dd9-08e1-4722-84cd-af47974c52bd tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Volume volume-4b621a92-cb64-4ec4-b4e0-8bacd726e2dd (4b621a92-cb64-4ec4-b4e0-8bacd726e2dd): created successfully Jun 29 03:37:00 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-2a0f3dd9-08e1-4722-84cd-af47974c52bd tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24cc7a8a-182d-4293-8b9e-1410e0af67b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:37:00 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-2a0f3dd9-08e1-4722-84cd-af47974c52bd tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Flow 'volume_create_manager' (3f99c4a5-d8d2-4c71-9936-8550e01dc7cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:37:00 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-2a0f3dd9-08e1-4722-84cd-af47974c52bd tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Created volume successfully. Jun 29 03:37:00 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-424512f4-1d96-44ce-875a-f4d4c194d2f3 tempest-VolumesActionsTest-613223606 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:37:00 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-424512f4-1d96-44ce-875a-f4d4c194d2f3 tempest-VolumesActionsTest-613223606 None] Flow 'volume_create_manager' (7915335f-d02e-47f4-8cdc-39d2e68acfef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:37:00 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-424512f4-1d96-44ce-875a-f4d4c194d2f3 tempest-VolumesActionsTest-613223606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9884a1e-7dc1-4a4b-acd7-aecaadf58cda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:37:00 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-424512f4-1d96-44ce-875a-f4d4c194d2f3 tempest-VolumesActionsTest-613223606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9884a1e-7dc1-4a4b-acd7-aecaadf58cda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:37:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1810157098',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9094a707-b360-46b3-9554-e1d28b20c0d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1532758db6b54b66a2e5c4709e8cfdf7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:37:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:37:01Z,use_quota=True,user_id='b5900938aa1642a58d248cc9fd4c336a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:37:00 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-424512f4-1d96-44ce-875a-f4d4c194d2f3 tempest-VolumesActionsTest-613223606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2bfe877-4583-4e94-831d-623b5e7097e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:37:00 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-424512f4-1d96-44ce-875a-f4d4c194d2f3 tempest-VolumesActionsTest-613223606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2bfe877-4583-4e94-831d-623b5e7097e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:37:00 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-424512f4-1d96-44ce-875a-f4d4c194d2f3 tempest-VolumesActionsTest-613223606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97c75c69-8a49-4cca-8576-b03e21173a19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:37:00 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-424512f4-1d96-44ce-875a-f4d4c194d2f3 tempest-VolumesActionsTest-613223606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97c75c69-8a49-4cca-8576-b03e21173a19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9094a707-b360-46b3-9554-e1d28b20c0d2', 'volume_name': 'volume-9094a707-b360-46b3-9554-e1d28b20c0d2', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:37:00 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-424512f4-1d96-44ce-875a-f4d4c194d2f3 tempest-VolumesActionsTest-613223606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e8480f3-9471-47d2-a7b3-68d8f97f6a24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:37:00 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-424512f4-1d96-44ce-875a-f4d4c194d2f3 tempest-VolumesActionsTest-613223606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e8480f3-9471-47d2-a7b3-68d8f97f6a24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:37:00 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-424512f4-1d96-44ce-875a-f4d4c194d2f3 tempest-VolumesActionsTest-613223606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3256a9ac-2780-4928-98ff-6dd1c9538816) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:37:00 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-424512f4-1d96-44ce-875a-f4d4c194d2f3 tempest-VolumesActionsTest-613223606 None] Volume 9094a707-b360-46b3-9554-e1d28b20c0d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9094a707-b360-46b3-9554-e1d28b20c0d2', 'volume_size': 1} Jun 29 03:37:00 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-424512f4-1d96-44ce-875a-f4d4c194d2f3 tempest-VolumesActionsTest-613223606 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:37:01 devstack sudo[110075]: pam_unix(sudo:session): session closed for user root Jun 29 03:37:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-281adcde-7462-41e0-b33d-62febe20fc42 tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-fbbd084c-3f07-4b2b-8e6f-827a1de4b9c4 1073741824" returned: 0 in 1.185s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:37:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-281adcde-7462-41e0-b33d-62febe20fc42 tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-fbbd084c-3f07-4b2b-8e6f-827a1de4b9c4 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:37:01 devstack sudo[110081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-fbbd084c-3f07-4b2b-8e6f-827a1de4b9c4 Jun 29 03:37:01 devstack sudo[110081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:37:02 devstack sudo[110081]: pam_unix(sudo:session): session closed for user root Jun 29 03:37:02 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-281adcde-7462-41e0-b33d-62febe20fc42 tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-fbbd084c-3f07-4b2b-8e6f-827a1de4b9c4" returned: 0 in 0.708s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:37:02 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-281adcde-7462-41e0-b33d-62febe20fc42 tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] <== create_volume: return (1952ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:37:02 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-281adcde-7462-41e0-b33d-62febe20fc42 tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.959s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:37:02 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-aa1fb145-f046-4c5e-a7fc-0e77406bcee8 tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.239s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:37:02 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-aa1fb145-f046-4c5e-a7fc-0e77406bcee8 tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:36:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1234237972',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=240ae311-e208-4617-886f-d4977f3e3c21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33449e7960d2463da9c00aa12d513ebf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:36:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:36:56Z,use_quota=True,user_id='9a0eb6fa4c8e4da9ab38564aca8a189e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:37:02 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-aa1fb145-f046-4c5e-a7fc-0e77406bcee8 tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Creating volume 240ae311-e208-4617-886f-d4977f3e3c21 {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:37:02 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-aa1fb145-f046-4c5e-a7fc-0e77406bcee8 tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:37:02 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-aa1fb145-f046-4c5e-a7fc-0e77406bcee8 tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:37:02 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-aa1fb145-f046-4c5e-a7fc-0e77406bcee8 tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:37:02 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-aa1fb145-f046-4c5e-a7fc-0e77406bcee8 tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:37:02 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-aa1fb145-f046-4c5e-a7fc-0e77406bcee8 tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:37:02 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-aa1fb145-f046-4c5e-a7fc-0e77406bcee8 tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Selected osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:37:02 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-aa1fb145-f046-4c5e-a7fc-0e77406bcee8 tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] casted to osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f Jun 29 03:37:02 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-aa1fb145-f046-4c5e-a7fc-0e77406bcee8 tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-240ae311-e208-4617-886f-d4977f3e3c21 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:37:02 devstack sudo[110085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-240ae311-e208-4617-886f-d4977f3e3c21 1073741824 Jun 29 03:37:02 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-281adcde-7462-41e0-b33d-62febe20fc42 tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c4a8035-8f6d-46ee-9e3d-9e1bf181e884) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fbbd084c-3f07-4b2b-8e6f-827a1de4b9c4', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:37:02 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-281adcde-7462-41e0-b33d-62febe20fc42 tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0dc20fd-9e8c-4af3-a4a4-69a8f785a123) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:37:02 devstack sudo[110085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:37:02 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-281adcde-7462-41e0-b33d-62febe20fc42 tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Volume volume-fbbd084c-3f07-4b2b-8e6f-827a1de4b9c4 (fbbd084c-3f07-4b2b-8e6f-827a1de4b9c4): created successfully Jun 29 03:37:02 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-281adcde-7462-41e0-b33d-62febe20fc42 tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0dc20fd-9e8c-4af3-a4a4-69a8f785a123) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:37:02 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-281adcde-7462-41e0-b33d-62febe20fc42 tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Flow 'volume_create_manager' (24b01704-cda6-4edc-865e-76fe14b2e166) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:37:02 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-281adcde-7462-41e0-b33d-62febe20fc42 tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Created volume successfully. Jun 29 03:37:03 devstack sudo[110085]: pam_unix(sudo:session): session closed for user root Jun 29 03:37:03 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-aa1fb145-f046-4c5e-a7fc-0e77406bcee8 tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-240ae311-e208-4617-886f-d4977f3e3c21 1073741824" returned: 0 in 0.950s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:37:03 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-aa1fb145-f046-4c5e-a7fc-0e77406bcee8 tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-240ae311-e208-4617-886f-d4977f3e3c21 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:37:03 devstack sudo[110091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-240ae311-e208-4617-886f-d4977f3e3c21 Jun 29 03:37:03 devstack sudo[110091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:37:03 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4d78c6b-7d8b-419c-9f22-4b82499f6568 tempest-TestStampPattern-670457191 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:37:03 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-a4d78c6b-7d8b-419c-9f22-4b82499f6568 tempest-TestStampPattern-670457191 None] Flow 'volume_create_manager' (3f0b60dd-6d11-4b97-8de7-7130785bb013) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:37:03 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-a4d78c6b-7d8b-419c-9f22-4b82499f6568 tempest-TestStampPattern-670457191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bb0f51b-799f-4402-8309-ed7a3f4698ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:37:03 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-a4d78c6b-7d8b-419c-9f22-4b82499f6568 tempest-TestStampPattern-670457191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bb0f51b-799f-4402-8309-ed7a3f4698ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:37:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-905026258',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27bc308b-b543-4d10-a580-b570f71d8866,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34f0cf688f5c4bd186883e488d8efed3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:37:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:37:04Z,use_quota=True,user_id='2d01311273684c5dbec9dc9f2c877f9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:37:03 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-a4d78c6b-7d8b-419c-9f22-4b82499f6568 tempest-TestStampPattern-670457191 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2317f6c-99eb-4c54-bba0-649693971b09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:37:03 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-a4d78c6b-7d8b-419c-9f22-4b82499f6568 tempest-TestStampPattern-670457191 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2317f6c-99eb-4c54-bba0-649693971b09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:37:03 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-a4d78c6b-7d8b-419c-9f22-4b82499f6568 tempest-TestStampPattern-670457191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d26c8263-7f1b-470a-9a2a-52dfe4c136a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:37:03 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-a4d78c6b-7d8b-419c-9f22-4b82499f6568 tempest-TestStampPattern-670457191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d26c8263-7f1b-470a-9a2a-52dfe4c136a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '27bc308b-b543-4d10-a580-b570f71d8866', 'volume_name': 'volume-27bc308b-b543-4d10-a580-b570f71d8866', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:37:03 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-a4d78c6b-7d8b-419c-9f22-4b82499f6568 tempest-TestStampPattern-670457191 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9446bddc-fbc7-49d8-894c-6f89fb459856) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:37:03 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-a4d78c6b-7d8b-419c-9f22-4b82499f6568 tempest-TestStampPattern-670457191 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9446bddc-fbc7-49d8-894c-6f89fb459856) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:37:03 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-a4d78c6b-7d8b-419c-9f22-4b82499f6568 tempest-TestStampPattern-670457191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2d90a8e-8858-4c38-b1f9-8ca70f362c75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:37:03 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-a4d78c6b-7d8b-419c-9f22-4b82499f6568 tempest-TestStampPattern-670457191 None] Volume 27bc308b-b543-4d10-a580-b570f71d8866: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-27bc308b-b543-4d10-a580-b570f71d8866', 'volume_size': 1} Jun 29 03:37:03 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-a4d78c6b-7d8b-419c-9f22-4b82499f6568 tempest-TestStampPattern-670457191 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:37:03 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e9fb49a-5da1-4428-a4ce-65ae4ca5c67b tempest-VolumeImageDependencyTests-156688489 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:37:03 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-2e9fb49a-5da1-4428-a4ce-65ae4ca5c67b tempest-VolumeImageDependencyTests-156688489 None] Flow 'volume_create_manager' (ae23f868-b4b3-4148-bd6b-24156e74bc2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:37:03 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-2e9fb49a-5da1-4428-a4ce-65ae4ca5c67b tempest-VolumeImageDependencyTests-156688489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f76fef81-9d50-4e9f-bc5e-a9422b927f7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:37:03 devstack sudo[110091]: pam_unix(sudo:session): session closed for user root Jun 29 03:37:03 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-2e9fb49a-5da1-4428-a4ce-65ae4ca5c67b tempest-VolumeImageDependencyTests-156688489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f76fef81-9d50-4e9f-bc5e-a9422b927f7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:37:03Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e6cce25-4339-4f80-967a-77ffe10d426f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='032dc17188674e20909b693006f713fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:37:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:37:04Z,use_quota=True,user_id='226f091b4a0a46fe9634804b98346582',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:37:03 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-2e9fb49a-5da1-4428-a4ce-65ae4ca5c67b tempest-VolumeImageDependencyTests-156688489 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30755a6f-1709-4469-ae93-f464847b9f1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:37:03 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-2e9fb49a-5da1-4428-a4ce-65ae4ca5c67b tempest-VolumeImageDependencyTests-156688489 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30755a6f-1709-4469-ae93-f464847b9f1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:37:03 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-2e9fb49a-5da1-4428-a4ce-65ae4ca5c67b tempest-VolumeImageDependencyTests-156688489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad439c3c-cbc6-4030-ad30-2b28af140170) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:37:03 devstack cinder-volume[93468]: DEBUG cinder.image.glance [None req-2e9fb49a-5da1-4428-a4ce-65ae4ca5c67b tempest-VolumeImageDependencyTests-156688489 None] Creating Keystone auth plugin from conf {{(pid=93468) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 29 03:37:03 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-aa1fb145-f046-4c5e-a7fc-0e77406bcee8 tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-240ae311-e208-4617-886f-d4977f3e3c21" returned: 0 in 0.865s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:37:03 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-aa1fb145-f046-4c5e-a7fc-0e77406bcee8 tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] <== create_volume: return (1864ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:37:03 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-aa1fb145-f046-4c5e-a7fc-0e77406bcee8 tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.870s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:37:03 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-711dd3e3-9b83-449e-9475-c668ea7794de tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.433s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:37:03 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-711dd3e3-9b83-449e-9475-c668ea7794de tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:36:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1310929738',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51d9b0df-570d-427a-8831-861ae54b3d6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33449e7960d2463da9c00aa12d513ebf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:36:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:36:56Z,use_quota=True,user_id='9a0eb6fa4c8e4da9ab38564aca8a189e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:37:03 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-711dd3e3-9b83-449e-9475-c668ea7794de tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Creating volume 51d9b0df-570d-427a-8831-861ae54b3d6c {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:37:03 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-711dd3e3-9b83-449e-9475-c668ea7794de tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:37:03 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-711dd3e3-9b83-449e-9475-c668ea7794de tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:37:03 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-711dd3e3-9b83-449e-9475-c668ea7794de tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:37:03 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-711dd3e3-9b83-449e-9475-c668ea7794de tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:37:03 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-711dd3e3-9b83-449e-9475-c668ea7794de tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:37:03 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-711dd3e3-9b83-449e-9475-c668ea7794de tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Selected osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:37:03 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-711dd3e3-9b83-449e-9475-c668ea7794de tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] casted to osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f Jun 29 03:37:03 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-711dd3e3-9b83-449e-9475-c668ea7794de tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-51d9b0df-570d-427a-8831-861ae54b3d6c 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:37:03 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-aa1fb145-f046-4c5e-a7fc-0e77406bcee8 tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab6ad135-34bd-4a0e-940f-6dcf5d3b1fc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-240ae311-e208-4617-886f-d4977f3e3c21', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:37:04 devstack sudo[110094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-51d9b0df-570d-427a-8831-861ae54b3d6c 1073741824 Jun 29 03:37:04 devstack sudo[110094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:37:04 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-aa1fb145-f046-4c5e-a7fc-0e77406bcee8 tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c69ca49-4f88-40c5-a5b5-52942858e963) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:37:04 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-aa1fb145-f046-4c5e-a7fc-0e77406bcee8 tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Volume volume-240ae311-e208-4617-886f-d4977f3e3c21 (240ae311-e208-4617-886f-d4977f3e3c21): created successfully Jun 29 03:37:04 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-aa1fb145-f046-4c5e-a7fc-0e77406bcee8 tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c69ca49-4f88-40c5-a5b5-52942858e963) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:37:04 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-aa1fb145-f046-4c5e-a7fc-0e77406bcee8 tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Flow 'volume_create_manager' (736e8dae-10b2-4d4e-8d8e-f30aaac98c08) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:37:04 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-aa1fb145-f046-4c5e-a7fc-0e77406bcee8 tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Created volume successfully. Jun 29 03:37:04 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-2e9fb49a-5da1-4428-a4ce-65ae4ca5c67b tempest-VolumeImageDependencyTests-156688489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad439c3c-cbc6-4030-ad30-2b28af140170) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '3e6cce25-4339-4f80-967a-77ffe10d426f', 'volume_name': 'volume-3e6cce25-4339-4f80-967a-77ffe10d426f', 'volume_size': 1, 'image_id': '512374c2-bfb4-4fcc-a773-d1be4d15497c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/512374c2-bfb4-4fcc-a773-d1be4d15497c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '2e95569c82e8581e8a78998413a97abb', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '032dc17188674e20909b693006f713fd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '8615f78943aec56918ae706766a22280ac258cedfc07bd7ac81f7571a9ff5676368d4b8a5bdeac5189449bc16428b01446728a6e0311dff5849bdf5bbea1834e', 'id': '512374c2-bfb4-4fcc-a773-d1be4d15497c', 'created_at': datetime.datetime(2026, 6, 29, 1, 37, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 29, 1, 37, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/512374c2-bfb4-4fcc-a773-d1be4d15497c/file', 'properties': {}}, 'image_service': }' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:37:04 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-2e9fb49a-5da1-4428-a4ce-65ae4ca5c67b tempest-VolumeImageDependencyTests-156688489 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4171c3d-6143-41f7-9e63-92fd981eef58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:37:04 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-2e9fb49a-5da1-4428-a4ce-65ae4ca5c67b tempest-VolumeImageDependencyTests-156688489 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4171c3d-6143-41f7-9e63-92fd981eef58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:37:04 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-2e9fb49a-5da1-4428-a4ce-65ae4ca5c67b tempest-VolumeImageDependencyTests-156688489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2774b0b3-80d1-485f-ba4e-8b83350777a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:37:04 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-2e9fb49a-5da1-4428-a4ce-65ae4ca5c67b tempest-VolumeImageDependencyTests-156688489 None] Volume 3e6cce25-4339-4f80-967a-77ffe10d426f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-3e6cce25-4339-4f80-967a-77ffe10d426f', 'volume_size': 1, 'image_id': '512374c2-bfb4-4fcc-a773-d1be4d15497c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/512374c2-bfb4-4fcc-a773-d1be4d15497c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '2e95569c82e8581e8a78998413a97abb', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '032dc17188674e20909b693006f713fd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '8615f78943aec56918ae706766a22280ac258cedfc07bd7ac81f7571a9ff5676368d4b8a5bdeac5189449bc16428b01446728a6e0311dff5849bdf5bbea1834e', 'id': '512374c2-bfb4-4fcc-a773-d1be4d15497c', 'created_at': datetime.datetime(2026, 6, 29, 1, 37, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 29, 1, 37, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/512374c2-bfb4-4fcc-a773-d1be4d15497c/file', 'properties': {}}, 'image_service': } Jun 29 03:37:04 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e9fb49a-5da1-4428-a4ce-65ae4ca5c67b tempest-VolumeImageDependencyTests-156688489 None] Trying to clone 3e6cce25-4339-4f80-967a-77ffe10d426f from image 512374c2-bfb4-4fcc-a773-d1be4d15497c at location (None, [{'url': 'file:///opt/stack/data/glance/images/512374c2-bfb4-4fcc-a773-d1be4d15497c', 'metadata': {}}]). {{(pid=93468) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 29 03:37:04 devstack cinder-volume[93468]: DEBUG cinder.image.image_utils [None req-2e9fb49a-5da1-4428-a4ce-65ae4ca5c67b tempest-VolumeImageDependencyTests-156688489 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_512374c2-bfb4-4fcc-a773-d1be4d15497c_wuvfibwjdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=93468) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 29 03:37:04 devstack cinder-volume[93468]: INFO cinder.image.image_utils [None req-2e9fb49a-5da1-4428-a4ce-65ae4ca5c67b tempest-VolumeImageDependencyTests-156688489 None] Image download 0.00 MB at 0.00 MB/s Jun 29 03:37:04 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9277a6c-66c7-4d00-90d4-f469252ceb39]: (4, 'raw') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:37:04 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2e9fb49a-5da1-4428-a4ce-65ae4ca5c67b tempest-VolumeImageDependencyTests-156688489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_512374c2-bfb4-4fcc-a773-d1be4d15497c_wuvfibwjdevstack@QuobyteHD {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:37:04 devstack sudo[110096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_512374c2-bfb4-4fcc-a773-d1be4d15497c_wuvfibwjdevstack@QuobyteHD Jun 29 03:37:04 devstack sudo[110096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:37:04 devstack sudo[110094]: pam_unix(sudo:session): session closed for user root Jun 29 03:37:04 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-711dd3e3-9b83-449e-9475-c668ea7794de tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-51d9b0df-570d-427a-8831-861ae54b3d6c 1073741824" returned: 0 in 0.998s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:37:05 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-711dd3e3-9b83-449e-9475-c668ea7794de tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-51d9b0df-570d-427a-8831-861ae54b3d6c {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:37:05 devstack sudo[110104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-51d9b0df-570d-427a-8831-861ae54b3d6c Jun 29 03:37:05 devstack sudo[110104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:37:05 devstack sudo[110096]: pam_unix(sudo:session): session closed for user root Jun 29 03:37:05 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2e9fb49a-5da1-4428-a4ce-65ae4ca5c67b tempest-VolumeImageDependencyTests-156688489 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_512374c2-bfb4-4fcc-a773-d1be4d15497c_wuvfibwjdevstack@QuobyteHD" returned: 0 in 0.856s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:37:05 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2e9fb49a-5da1-4428-a4ce-65ae4ca5c67b tempest-VolumeImageDependencyTests-156688489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_512374c2-bfb4-4fcc-a773-d1be4d15497c_wuvfibwjdevstack@QuobyteHD {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:37:05 devstack sudo[110108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_512374c2-bfb4-4fcc-a773-d1be4d15497c_wuvfibwjdevstack@QuobyteHD Jun 29 03:37:05 devstack sudo[110108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:37:05 devstack sudo[110104]: pam_unix(sudo:session): session closed for user root Jun 29 03:37:05 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-711dd3e3-9b83-449e-9475-c668ea7794de tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-51d9b0df-570d-427a-8831-861ae54b3d6c" returned: 0 in 0.761s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:37:05 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-711dd3e3-9b83-449e-9475-c668ea7794de tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] <== create_volume: return (1813ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:37:05 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-711dd3e3-9b83-449e-9475-c668ea7794de tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.817s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:37:05 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-424512f4-1d96-44ce-875a-f4d4c194d2f3 tempest-VolumesActionsTest-613223606 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.080s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:37:05 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-424512f4-1d96-44ce-875a-f4d4c194d2f3 tempest-VolumesActionsTest-613223606 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:37:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1810157098',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9094a707-b360-46b3-9554-e1d28b20c0d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1532758db6b54b66a2e5c4709e8cfdf7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:37:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:37:01Z,use_quota=True,user_id='b5900938aa1642a58d248cc9fd4c336a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:37:05 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-424512f4-1d96-44ce-875a-f4d4c194d2f3 tempest-VolumesActionsTest-613223606 None] Creating volume 9094a707-b360-46b3-9554-e1d28b20c0d2 {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:37:05 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-424512f4-1d96-44ce-875a-f4d4c194d2f3 tempest-VolumesActionsTest-613223606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:37:05 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-424512f4-1d96-44ce-875a-f4d4c194d2f3 tempest-VolumesActionsTest-613223606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:37:05 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-424512f4-1d96-44ce-875a-f4d4c194d2f3 tempest-VolumesActionsTest-613223606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:37:05 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-424512f4-1d96-44ce-875a-f4d4c194d2f3 tempest-VolumesActionsTest-613223606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:37:05 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-424512f4-1d96-44ce-875a-f4d4c194d2f3 tempest-VolumesActionsTest-613223606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:37:05 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-424512f4-1d96-44ce-875a-f4d4c194d2f3 tempest-VolumesActionsTest-613223606 None] Selected osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:37:05 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-424512f4-1d96-44ce-875a-f4d4c194d2f3 tempest-VolumesActionsTest-613223606 None] casted to osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f Jun 29 03:37:05 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-424512f4-1d96-44ce-875a-f4d4c194d2f3 tempest-VolumesActionsTest-613223606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9094a707-b360-46b3-9554-e1d28b20c0d2 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:37:05 devstack sudo[110111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9094a707-b360-46b3-9554-e1d28b20c0d2 1073741824 Jun 29 03:37:05 devstack sudo[110111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:37:05 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-711dd3e3-9b83-449e-9475-c668ea7794de tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3dc337ed-e2b6-4c46-9b74-ba88a116cd56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-51d9b0df-570d-427a-8831-861ae54b3d6c', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:37:05 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-711dd3e3-9b83-449e-9475-c668ea7794de tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f17ff137-f5a4-4381-ac93-eac964609205) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:37:05 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-711dd3e3-9b83-449e-9475-c668ea7794de tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Volume volume-51d9b0df-570d-427a-8831-861ae54b3d6c (51d9b0df-570d-427a-8831-861ae54b3d6c): created successfully Jun 29 03:37:05 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-711dd3e3-9b83-449e-9475-c668ea7794de tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f17ff137-f5a4-4381-ac93-eac964609205) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:37:05 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-711dd3e3-9b83-449e-9475-c668ea7794de tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Flow 'volume_create_manager' (b52b4400-4e7e-4ff5-9032-68c775fbf9a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:37:05 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-711dd3e3-9b83-449e-9475-c668ea7794de tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Created volume successfully. Jun 29 03:37:06 devstack sudo[110108]: pam_unix(sudo:session): session closed for user root Jun 29 03:37:06 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2e9fb49a-5da1-4428-a4ce-65ae4ca5c67b tempest-VolumeImageDependencyTests-156688489 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_512374c2-bfb4-4fcc-a773-d1be4d15497c_wuvfibwjdevstack@QuobyteHD" returned: 1 in 0.882s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:37:06 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2e9fb49a-5da1-4428-a4ce-65ae4ca5c67b tempest-VolumeImageDependencyTests-156688489 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_512374c2-bfb4-4fcc-a773-d1be4d15497c_wuvfibwjdevstack@QuobyteHD' failed. Not Retrying. {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 29 03:37:06 devstack cinder-volume[93468]: DEBUG cinder.image.image_utils [None req-2e9fb49a-5da1-4428-a4ce-65ae4ca5c67b tempest-VolumeImageDependencyTests-156688489 None] Temporary image 512374c2-bfb4-4fcc-a773-d1be4d15497c is fetched for user 226f091b4a0a46fe9634804b98346582. {{(pid=93468) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 29 03:37:06 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c20bbe3-ad89-4dcb-b547-b008749346bb]: (4, 'raw') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:37:06 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2e9fb49a-5da1-4428-a4ce-65ae4ca5c67b tempest-VolumeImageDependencyTests-156688489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_512374c2-bfb4-4fcc-a773-d1be4d15497c_wuvfibwjdevstack@QuobyteHD {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:37:06 devstack sudo[110116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_512374c2-bfb4-4fcc-a773-d1be4d15497c_wuvfibwjdevstack@QuobyteHD Jun 29 03:37:06 devstack sudo[110116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:37:06 devstack sudo[110111]: pam_unix(sudo:session): session closed for user root Jun 29 03:37:06 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-424512f4-1d96-44ce-875a-f4d4c194d2f3 tempest-VolumesActionsTest-613223606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9094a707-b360-46b3-9554-e1d28b20c0d2 1073741824" returned: 0 in 0.888s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:37:06 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-424512f4-1d96-44ce-875a-f4d4c194d2f3 tempest-VolumesActionsTest-613223606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9094a707-b360-46b3-9554-e1d28b20c0d2 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:37:06 devstack sudo[110121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9094a707-b360-46b3-9554-e1d28b20c0d2 Jun 29 03:37:06 devstack sudo[110121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:37:06 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-f5792bf3-0cfa-4667-9382-a487712a6cdd tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Acquiring lock "cinder-51d9b0df-570d-427a-8831-861ae54b3d6c-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:37:06 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-f5792bf3-0cfa-4667-9382-a487712a6cdd tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Lock "cinder-51d9b0df-570d-427a-8831-861ae54b3d6c-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:37:06 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-f5792bf3-0cfa-4667-9382-a487712a6cdd tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Acquiring lock "cinder-quobyte-51d9b0df-570d-427a-8831-861ae54b3d6c" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:37:06 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-f5792bf3-0cfa-4667-9382-a487712a6cdd tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Lock "cinder-quobyte-51d9b0df-570d-427a-8831-861ae54b3d6c" acquired by "delete_volume" :: waited 0.018s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:37:07 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[8afb7586-71b9-4955-ad88-9444bec91e90]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:37:07 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-f5792bf3-0cfa-4667-9382-a487712a6cdd tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-51d9b0df-570d-427a-8831-861ae54b3d6c {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:37:07 devstack sudo[110116]: pam_unix(sudo:session): session closed for user root Jun 29 03:37:07 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2e9fb49a-5da1-4428-a4ce-65ae4ca5c67b tempest-VolumeImageDependencyTests-156688489 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_512374c2-bfb4-4fcc-a773-d1be4d15497c_wuvfibwjdevstack@QuobyteHD" returned: 0 in 0.836s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:37:07 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2e9fb49a-5da1-4428-a4ce-65ae4ca5c67b tempest-VolumeImageDependencyTests-156688489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_512374c2-bfb4-4fcc-a773-d1be4d15497c_wuvfibwjdevstack@QuobyteHD {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:37:07 devstack sudo[110125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-51d9b0df-570d-427a-8831-861ae54b3d6c Jun 29 03:37:07 devstack sudo[110125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:37:07 devstack sudo[110126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_512374c2-bfb4-4fcc-a773-d1be4d15497c_wuvfibwjdevstack@QuobyteHD Jun 29 03:37:07 devstack sudo[110126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:37:07 devstack sudo[110121]: pam_unix(sudo:session): session closed for user root Jun 29 03:37:07 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-424512f4-1d96-44ce-875a-f4d4c194d2f3 tempest-VolumesActionsTest-613223606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9094a707-b360-46b3-9554-e1d28b20c0d2" returned: 0 in 0.799s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:37:07 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-424512f4-1d96-44ce-875a-f4d4c194d2f3 tempest-VolumesActionsTest-613223606 None] <== create_volume: return (1735ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:37:07 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-424512f4-1d96-44ce-875a-f4d4c194d2f3 tempest-VolumesActionsTest-613223606 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.738s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:37:07 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-a4d78c6b-7d8b-419c-9f22-4b82499f6568 tempest-TestStampPattern-670457191 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.761s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:37:07 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-a4d78c6b-7d8b-419c-9f22-4b82499f6568 tempest-TestStampPattern-670457191 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:37:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-905026258',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27bc308b-b543-4d10-a580-b570f71d8866,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34f0cf688f5c4bd186883e488d8efed3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:37:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:37:04Z,use_quota=True,user_id='2d01311273684c5dbec9dc9f2c877f9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:37:07 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-a4d78c6b-7d8b-419c-9f22-4b82499f6568 tempest-TestStampPattern-670457191 None] Creating volume 27bc308b-b543-4d10-a580-b570f71d8866 {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:37:07 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-a4d78c6b-7d8b-419c-9f22-4b82499f6568 tempest-TestStampPattern-670457191 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:37:07 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-a4d78c6b-7d8b-419c-9f22-4b82499f6568 tempest-TestStampPattern-670457191 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:37:07 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-a4d78c6b-7d8b-419c-9f22-4b82499f6568 tempest-TestStampPattern-670457191 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:37:07 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-a4d78c6b-7d8b-419c-9f22-4b82499f6568 tempest-TestStampPattern-670457191 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:37:07 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-a4d78c6b-7d8b-419c-9f22-4b82499f6568 tempest-TestStampPattern-670457191 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:37:07 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-a4d78c6b-7d8b-419c-9f22-4b82499f6568 tempest-TestStampPattern-670457191 None] Selected osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:37:07 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-a4d78c6b-7d8b-419c-9f22-4b82499f6568 tempest-TestStampPattern-670457191 None] casted to osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f Jun 29 03:37:07 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a4d78c6b-7d8b-419c-9f22-4b82499f6568 tempest-TestStampPattern-670457191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-27bc308b-b543-4d10-a580-b570f71d8866 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:37:07 devstack sudo[110130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-27bc308b-b543-4d10-a580-b570f71d8866 1073741824 Jun 29 03:37:07 devstack sudo[110130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:37:07 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-424512f4-1d96-44ce-875a-f4d4c194d2f3 tempest-VolumesActionsTest-613223606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3256a9ac-2780-4928-98ff-6dd1c9538816) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9094a707-b360-46b3-9554-e1d28b20c0d2', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:37:07 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-424512f4-1d96-44ce-875a-f4d4c194d2f3 tempest-VolumesActionsTest-613223606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0025d36-7147-4758-9106-acfd73f0d0ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:37:07 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-424512f4-1d96-44ce-875a-f4d4c194d2f3 tempest-VolumesActionsTest-613223606 None] Volume volume-9094a707-b360-46b3-9554-e1d28b20c0d2 (9094a707-b360-46b3-9554-e1d28b20c0d2): created successfully Jun 29 03:37:07 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-424512f4-1d96-44ce-875a-f4d4c194d2f3 tempest-VolumesActionsTest-613223606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0025d36-7147-4758-9106-acfd73f0d0ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:37:07 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-424512f4-1d96-44ce-875a-f4d4c194d2f3 tempest-VolumesActionsTest-613223606 None] Flow 'volume_create_manager' (7915335f-d02e-47f4-8cdc-39d2e68acfef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:37:07 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-424512f4-1d96-44ce-875a-f4d4c194d2f3 tempest-VolumesActionsTest-613223606 None] Created volume successfully. Jun 29 03:37:07 devstack sudo[110125]: pam_unix(sudo:session): session closed for user root Jun 29 03:37:07 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-f5792bf3-0cfa-4667-9382-a487712a6cdd tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-51d9b0df-570d-427a-8831-861ae54b3d6c" returned: 0 in 0.794s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:37:07 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-f5792bf3-0cfa-4667-9382-a487712a6cdd tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-51d9b0df-570d-427a-8831-861ae54b3d6c {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:37:07 devstack sudo[110126]: pam_unix(sudo:session): session closed for user root Jun 29 03:37:07 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2e9fb49a-5da1-4428-a4ce-65ae4ca5c67b tempest-VolumeImageDependencyTests-156688489 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_512374c2-bfb4-4fcc-a773-d1be4d15497c_wuvfibwjdevstack@QuobyteHD" returned: 1 in 0.780s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:37:07 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2e9fb49a-5da1-4428-a4ce-65ae4ca5c67b tempest-VolumeImageDependencyTests-156688489 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_512374c2-bfb4-4fcc-a773-d1be4d15497c_wuvfibwjdevstack@QuobyteHD' failed. Not Retrying. {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 29 03:37:07 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-2e9fb49a-5da1-4428-a4ce-65ae4ca5c67b tempest-VolumeImageDependencyTests-156688489 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:37:07 devstack sudo[110139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-51d9b0df-570d-427a-8831-861ae54b3d6c Jun 29 03:37:07 devstack sudo[110139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:37:08 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-6bb5ce39-e1d0-4547-8c54-c8f10cb93a53 tempest-VolumesActionsTest-1356070032 None] Acquiring lock "cinder-9094a707-b360-46b3-9554-e1d28b20c0d2-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:37:08 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-6bb5ce39-e1d0-4547-8c54-c8f10cb93a53 tempest-VolumesActionsTest-1356070032 None] Lock "cinder-9094a707-b360-46b3-9554-e1d28b20c0d2-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:37:08 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-6bb5ce39-e1d0-4547-8c54-c8f10cb93a53 tempest-VolumesActionsTest-1356070032 None] Acquiring lock "cinder-quobyte-9094a707-b360-46b3-9554-e1d28b20c0d2" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:37:08 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-6bb5ce39-e1d0-4547-8c54-c8f10cb93a53 tempest-VolumesActionsTest-1356070032 None] Lock "cinder-quobyte-9094a707-b360-46b3-9554-e1d28b20c0d2" acquired by "delete_volume" :: waited 0.016s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:37:08 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ec90d60-40e8-418d-a9e6-a4708d4433b2]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:37:08 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-6bb5ce39-e1d0-4547-8c54-c8f10cb93a53 tempest-VolumesActionsTest-1356070032 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9094a707-b360-46b3-9554-e1d28b20c0d2 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:37:08 devstack sudo[110145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9094a707-b360-46b3-9554-e1d28b20c0d2 Jun 29 03:37:08 devstack sudo[110145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:37:08 devstack sudo[110130]: pam_unix(sudo:session): session closed for user root Jun 29 03:37:08 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a4d78c6b-7d8b-419c-9f22-4b82499f6568 tempest-TestStampPattern-670457191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-27bc308b-b543-4d10-a580-b570f71d8866 1073741824" returned: 0 in 1.001s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:37:08 devstack sudo[110139]: pam_unix(sudo:session): session closed for user root Jun 29 03:37:08 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-f5792bf3-0cfa-4667-9382-a487712a6cdd tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-51d9b0df-570d-427a-8831-861ae54b3d6c" returned: 0 in 0.733s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:37:08 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-f5792bf3-0cfa-4667-9382-a487712a6cdd tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Lock "cinder-quobyte-51d9b0df-570d-427a-8831-861ae54b3d6c" released by "delete_volume" :: held 1.591s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:37:08 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a4d78c6b-7d8b-419c-9f22-4b82499f6568 tempest-TestStampPattern-670457191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-27bc308b-b543-4d10-a580-b570f71d8866 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:37:08 devstack sudo[110148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-27bc308b-b543-4d10-a580-b570f71d8866 Jun 29 03:37:08 devstack sudo[110148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:37:08 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-f5792bf3-0cfa-4667-9382-a487712a6cdd tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Created reservations ['4e330ef2-8ee7-4649-a115-dd865e4b68da', '06d04cee-5cdf-450a-b694-d494c8adc015', 'f4d5cf27-95b4-40cf-8358-2b44cddf70c1', '29dbbedd-ab0b-4569-b8cb-45658826a9f1'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:37:08 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-f5792bf3-0cfa-4667-9382-a487712a6cdd tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:37:08 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-f5792bf3-0cfa-4667-9382-a487712a6cdd tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:37:08 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-f5792bf3-0cfa-4667-9382-a487712a6cdd tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:37:08 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-f5792bf3-0cfa-4667-9382-a487712a6cdd tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:37:08 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-f5792bf3-0cfa-4667-9382-a487712a6cdd tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:37:08 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-f5792bf3-0cfa-4667-9382-a487712a6cdd tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:37:08 devstack sudo[110150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf Jun 29 03:37:08 devstack sudo[110150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:37:09 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-572565c0-a921-408d-b958-aa54f3b05df0 tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Acquiring lock "cinder-240ae311-e208-4617-886f-d4977f3e3c21-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:37:09 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-572565c0-a921-408d-b958-aa54f3b05df0 tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Lock "cinder-240ae311-e208-4617-886f-d4977f3e3c21-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:37:09 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-572565c0-a921-408d-b958-aa54f3b05df0 tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Acquiring lock "cinder-quobyte-240ae311-e208-4617-886f-d4977f3e3c21" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:37:09 devstack sudo[110145]: pam_unix(sudo:session): session closed for user root Jun 29 03:37:09 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-6bb5ce39-e1d0-4547-8c54-c8f10cb93a53 tempest-VolumesActionsTest-1356070032 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9094a707-b360-46b3-9554-e1d28b20c0d2" returned: 0 in 0.913s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:37:09 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-6bb5ce39-e1d0-4547-8c54-c8f10cb93a53 tempest-VolumesActionsTest-1356070032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9094a707-b360-46b3-9554-e1d28b20c0d2 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:37:09 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-572565c0-a921-408d-b958-aa54f3b05df0 tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Lock "cinder-quobyte-240ae311-e208-4617-886f-d4977f3e3c21" acquired by "delete_volume" :: waited 0.036s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:37:09 devstack sudo[110157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9094a707-b360-46b3-9554-e1d28b20c0d2 Jun 29 03:37:09 devstack sudo[110157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:37:09 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[052c1afb-ae50-4e12-ba48-c28b79f72c8e]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:37:09 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-572565c0-a921-408d-b958-aa54f3b05df0 tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-240ae311-e208-4617-886f-d4977f3e3c21 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:37:09 devstack sudo[110148]: pam_unix(sudo:session): session closed for user root Jun 29 03:37:09 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a4d78c6b-7d8b-419c-9f22-4b82499f6568 tempest-TestStampPattern-670457191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-27bc308b-b543-4d10-a580-b570f71d8866" returned: 0 in 0.848s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:37:09 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-a4d78c6b-7d8b-419c-9f22-4b82499f6568 tempest-TestStampPattern-670457191 None] <== create_volume: return (1914ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:37:09 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-a4d78c6b-7d8b-419c-9f22-4b82499f6568 tempest-TestStampPattern-670457191 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.920s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:37:09 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-2e9fb49a-5da1-4428-a4ce-65ae4ca5c67b tempest-VolumeImageDependencyTests-156688489 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.604s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:37:09 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-2e9fb49a-5da1-4428-a4ce-65ae4ca5c67b tempest-VolumeImageDependencyTests-156688489 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:37:03Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e6cce25-4339-4f80-967a-77ffe10d426f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='032dc17188674e20909b693006f713fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:37:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:37:04Z,use_quota=True,user_id='226f091b4a0a46fe9634804b98346582',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:37:09 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-2e9fb49a-5da1-4428-a4ce-65ae4ca5c67b tempest-VolumeImageDependencyTests-156688489 None] Creating volume 3e6cce25-4339-4f80-967a-77ffe10d426f {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:37:09 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-2e9fb49a-5da1-4428-a4ce-65ae4ca5c67b tempest-VolumeImageDependencyTests-156688489 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:37:09 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-2e9fb49a-5da1-4428-a4ce-65ae4ca5c67b tempest-VolumeImageDependencyTests-156688489 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:37:09 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-2e9fb49a-5da1-4428-a4ce-65ae4ca5c67b tempest-VolumeImageDependencyTests-156688489 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:37:09 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-2e9fb49a-5da1-4428-a4ce-65ae4ca5c67b tempest-VolumeImageDependencyTests-156688489 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:37:09 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-2e9fb49a-5da1-4428-a4ce-65ae4ca5c67b tempest-VolumeImageDependencyTests-156688489 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:37:09 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-2e9fb49a-5da1-4428-a4ce-65ae4ca5c67b tempest-VolumeImageDependencyTests-156688489 None] Selected osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:37:09 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-2e9fb49a-5da1-4428-a4ce-65ae4ca5c67b tempest-VolumeImageDependencyTests-156688489 None] casted to osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f Jun 29 03:37:09 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2e9fb49a-5da1-4428-a4ce-65ae4ca5c67b tempest-VolumeImageDependencyTests-156688489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-3e6cce25-4339-4f80-967a-77ffe10d426f 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:37:09 devstack sudo[110150]: pam_unix(sudo:session): session closed for user root Jun 29 03:37:09 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-f5792bf3-0cfa-4667-9382-a487712a6cdd tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf" returned: 0 in 0.764s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:37:09 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-f5792bf3-0cfa-4667-9382-a487712a6cdd tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:37:09 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-f5792bf3-0cfa-4667-9382-a487712a6cdd tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Deleted volume successfully. Jun 29 03:37:09 devstack sudo[110161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-3e6cce25-4339-4f80-967a-77ffe10d426f 1073741824 Jun 29 03:37:09 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-a4d78c6b-7d8b-419c-9f22-4b82499f6568 tempest-TestStampPattern-670457191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2d90a8e-8858-4c38-b1f9-8ca70f362c75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-27bc308b-b543-4d10-a580-b570f71d8866', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:37:09 devstack sudo[110161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:37:09 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-a4d78c6b-7d8b-419c-9f22-4b82499f6568 tempest-TestStampPattern-670457191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e64e8b95-bbfa-4e92-83d9-ee3bde4f52af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:37:09 devstack sudo[110160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-240ae311-e208-4617-886f-d4977f3e3c21 Jun 29 03:37:09 devstack sudo[110160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:37:09 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-a4d78c6b-7d8b-419c-9f22-4b82499f6568 tempest-TestStampPattern-670457191 None] Volume volume-27bc308b-b543-4d10-a580-b570f71d8866 (27bc308b-b543-4d10-a580-b570f71d8866): created successfully Jun 29 03:37:09 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-a4d78c6b-7d8b-419c-9f22-4b82499f6568 tempest-TestStampPattern-670457191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e64e8b95-bbfa-4e92-83d9-ee3bde4f52af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:37:09 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-a4d78c6b-7d8b-419c-9f22-4b82499f6568 tempest-TestStampPattern-670457191 None] Flow 'volume_create_manager' (3f0b60dd-6d11-4b97-8de7-7130785bb013) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:37:09 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-f5792bf3-0cfa-4667-9382-a487712a6cdd tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Lock "cinder-51d9b0df-570d-427a-8831-861ae54b3d6c-delete_volume" released by "delete_volume" :: held 2.723s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:37:09 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-a4d78c6b-7d8b-419c-9f22-4b82499f6568 tempest-TestStampPattern-670457191 None] Created volume successfully. Jun 29 03:37:10 devstack sudo[110157]: pam_unix(sudo:session): session closed for user root Jun 29 03:37:10 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-6bb5ce39-e1d0-4547-8c54-c8f10cb93a53 tempest-VolumesActionsTest-1356070032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9094a707-b360-46b3-9554-e1d28b20c0d2" returned: 0 in 0.742s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:37:10 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-6bb5ce39-e1d0-4547-8c54-c8f10cb93a53 tempest-VolumesActionsTest-1356070032 None] Lock "cinder-quobyte-9094a707-b360-46b3-9554-e1d28b20c0d2" released by "delete_volume" :: held 1.705s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:37:10 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-6bb5ce39-e1d0-4547-8c54-c8f10cb93a53 tempest-VolumesActionsTest-1356070032 None] Created reservations ['5aa7f4a6-6602-4960-a86e-bb94c1c24584', 'c252552a-f8c6-479f-b360-b39079a42ec8', '6042c109-2aa3-4488-b908-e8ff3382d7b9', '3dbd0b6d-9d0c-4b15-8f5d-a5a149c2b3b2'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:37:10 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-6bb5ce39-e1d0-4547-8c54-c8f10cb93a53 tempest-VolumesActionsTest-1356070032 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:37:10 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-6bb5ce39-e1d0-4547-8c54-c8f10cb93a53 tempest-VolumesActionsTest-1356070032 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:37:10 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-6bb5ce39-e1d0-4547-8c54-c8f10cb93a53 tempest-VolumesActionsTest-1356070032 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:37:10 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-6bb5ce39-e1d0-4547-8c54-c8f10cb93a53 tempest-VolumesActionsTest-1356070032 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:37:10 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-6bb5ce39-e1d0-4547-8c54-c8f10cb93a53 tempest-VolumesActionsTest-1356070032 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:37:10 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-6bb5ce39-e1d0-4547-8c54-c8f10cb93a53 tempest-VolumesActionsTest-1356070032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:37:10 devstack sudo[110170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf Jun 29 03:37:10 devstack sudo[110170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:37:10 devstack sudo[110160]: pam_unix(sudo:session): session closed for user root Jun 29 03:37:10 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-572565c0-a921-408d-b958-aa54f3b05df0 tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-240ae311-e208-4617-886f-d4977f3e3c21" returned: 0 in 0.979s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:37:10 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-572565c0-a921-408d-b958-aa54f3b05df0 tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-240ae311-e208-4617-886f-d4977f3e3c21 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:37:10 devstack sudo[110174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-240ae311-e208-4617-886f-d4977f3e3c21 Jun 29 03:37:10 devstack sudo[110174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:37:10 devstack sudo[110161]: pam_unix(sudo:session): session closed for user root Jun 29 03:37:10 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2e9fb49a-5da1-4428-a4ce-65ae4ca5c67b tempest-VolumeImageDependencyTests-156688489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-3e6cce25-4339-4f80-967a-77ffe10d426f 1073741824" returned: 0 in 1.440s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:37:10 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2e9fb49a-5da1-4428-a4ce-65ae4ca5c67b tempest-VolumeImageDependencyTests-156688489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-3e6cce25-4339-4f80-967a-77ffe10d426f {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:37:11 devstack sudo[110176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-3e6cce25-4339-4f80-967a-77ffe10d426f Jun 29 03:37:11 devstack sudo[110176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:37:11 devstack sudo[110170]: pam_unix(sudo:session): session closed for user root Jun 29 03:37:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-6bb5ce39-e1d0-4547-8c54-c8f10cb93a53 tempest-VolumesActionsTest-1356070032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf" returned: 0 in 1.256s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:37:11 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-6bb5ce39-e1d0-4547-8c54-c8f10cb93a53 tempest-VolumesActionsTest-1356070032 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:37:11 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-6bb5ce39-e1d0-4547-8c54-c8f10cb93a53 tempest-VolumesActionsTest-1356070032 None] Deleted volume successfully. Jun 29 03:37:11 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-6bb5ce39-e1d0-4547-8c54-c8f10cb93a53 tempest-VolumesActionsTest-1356070032 None] Lock "cinder-9094a707-b360-46b3-9554-e1d28b20c0d2-delete_volume" released by "delete_volume" :: held 3.334s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:37:11 devstack sudo[110174]: pam_unix(sudo:session): session closed for user root Jun 29 03:37:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-572565c0-a921-408d-b958-aa54f3b05df0 tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-240ae311-e208-4617-886f-d4977f3e3c21" returned: 0 in 1.231s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:37:11 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-572565c0-a921-408d-b958-aa54f3b05df0 tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Lock "cinder-quobyte-240ae311-e208-4617-886f-d4977f3e3c21" released by "delete_volume" :: held 2.300s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:37:11 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-572565c0-a921-408d-b958-aa54f3b05df0 tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Created reservations ['46cbc533-7499-4fee-ac82-1e3046f84ec8', '5e803782-da35-4485-9cb3-9a1ade3f91b1', '06934f10-4e15-4e83-947c-0c6189d9b120', 'f87ae6f4-19d5-4083-8bfc-a0d92971e4fe'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:37:11 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-4489a499-4d88-468b-a37e-0d74b41ccc35 tempest-VolumesActionsTest-613223606 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:37:11 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-4489a499-4d88-468b-a37e-0d74b41ccc35 tempest-VolumesActionsTest-613223606 None] Flow 'volume_create_manager' (156d75f4-db2a-4d8b-8dc7-b6dd019e6633) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:37:11 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-4489a499-4d88-468b-a37e-0d74b41ccc35 tempest-VolumesActionsTest-613223606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0aab5606-9c82-4aea-8448-419e6167a596) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:37:11 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-4489a499-4d88-468b-a37e-0d74b41ccc35 tempest-VolumesActionsTest-613223606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0aab5606-9c82-4aea-8448-419e6167a596) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:37:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-553908754',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ed6528a-6cde-424d-bcef-604e767a81a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1532758db6b54b66a2e5c4709e8cfdf7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:37:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:37:12Z,use_quota=True,user_id='b5900938aa1642a58d248cc9fd4c336a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:37:11 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-4489a499-4d88-468b-a37e-0d74b41ccc35 tempest-VolumesActionsTest-613223606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e781604-b6c8-423c-bf7d-12921d51bb8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:37:11 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-4489a499-4d88-468b-a37e-0d74b41ccc35 tempest-VolumesActionsTest-613223606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e781604-b6c8-423c-bf7d-12921d51bb8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:37:11 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-4489a499-4d88-468b-a37e-0d74b41ccc35 tempest-VolumesActionsTest-613223606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff64c390-96d7-4031-866f-cafc2d3d255b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:37:11 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-4489a499-4d88-468b-a37e-0d74b41ccc35 tempest-VolumesActionsTest-613223606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff64c390-96d7-4031-866f-cafc2d3d255b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ed6528a-6cde-424d-bcef-604e767a81a4', 'volume_name': 'volume-0ed6528a-6cde-424d-bcef-604e767a81a4', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:37:11 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-4489a499-4d88-468b-a37e-0d74b41ccc35 tempest-VolumesActionsTest-613223606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5f383bf-2912-4062-a814-3a1b08509bad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:37:11 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-4489a499-4d88-468b-a37e-0d74b41ccc35 tempest-VolumesActionsTest-613223606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5f383bf-2912-4062-a814-3a1b08509bad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:37:11 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-4489a499-4d88-468b-a37e-0d74b41ccc35 tempest-VolumesActionsTest-613223606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f11b9a71-c762-4182-a21a-fd43a3182b9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:37:11 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-4489a499-4d88-468b-a37e-0d74b41ccc35 tempest-VolumesActionsTest-613223606 None] Volume 0ed6528a-6cde-424d-bcef-604e767a81a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ed6528a-6cde-424d-bcef-604e767a81a4', 'volume_size': 1} Jun 29 03:37:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-4489a499-4d88-468b-a37e-0d74b41ccc35 tempest-VolumesActionsTest-613223606 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:37:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-572565c0-a921-408d-b958-aa54f3b05df0 tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:37:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-572565c0-a921-408d-b958-aa54f3b05df0 tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:37:11 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-572565c0-a921-408d-b958-aa54f3b05df0 tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:37:11 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-572565c0-a921-408d-b958-aa54f3b05df0 tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:37:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-572565c0-a921-408d-b958-aa54f3b05df0 tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:37:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-572565c0-a921-408d-b958-aa54f3b05df0 tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:37:11 devstack sudo[110176]: pam_unix(sudo:session): session closed for user root Jun 29 03:37:11 devstack cinder-volume[93468]: DEBUG oslo_service.periodic_task [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93468) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 29 03:37:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:37:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:37:11 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:37:11 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:37:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:37:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:37:11 devstack sudo[110183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf Jun 29 03:37:11 devstack sudo[110183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:37:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2e9fb49a-5da1-4428-a4ce-65ae4ca5c67b tempest-VolumeImageDependencyTests-156688489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-3e6cce25-4339-4f80-967a-77ffe10d426f" returned: 0 in 0.927s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:37:11 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-2e9fb49a-5da1-4428-a4ce-65ae4ca5c67b tempest-VolumeImageDependencyTests-156688489 None] <== create_volume: return (2463ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:37:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-2e9fb49a-5da1-4428-a4ce-65ae4ca5c67b tempest-VolumeImageDependencyTests-156688489 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.468s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:37:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-4489a499-4d88-468b-a37e-0d74b41ccc35 tempest-VolumesActionsTest-613223606 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.067s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:37:11 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-4489a499-4d88-468b-a37e-0d74b41ccc35 tempest-VolumesActionsTest-613223606 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:37:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-553908754',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ed6528a-6cde-424d-bcef-604e767a81a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1532758db6b54b66a2e5c4709e8cfdf7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:37:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:37:12Z,use_quota=True,user_id='b5900938aa1642a58d248cc9fd4c336a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:37:11 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-4489a499-4d88-468b-a37e-0d74b41ccc35 tempest-VolumesActionsTest-613223606 None] Creating volume 0ed6528a-6cde-424d-bcef-604e767a81a4 {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:37:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-4489a499-4d88-468b-a37e-0d74b41ccc35 tempest-VolumesActionsTest-613223606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:37:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-4489a499-4d88-468b-a37e-0d74b41ccc35 tempest-VolumesActionsTest-613223606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:37:11 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-4489a499-4d88-468b-a37e-0d74b41ccc35 tempest-VolumesActionsTest-613223606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:37:11 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-4489a499-4d88-468b-a37e-0d74b41ccc35 tempest-VolumesActionsTest-613223606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:37:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-4489a499-4d88-468b-a37e-0d74b41ccc35 tempest-VolumesActionsTest-613223606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:37:11 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-4489a499-4d88-468b-a37e-0d74b41ccc35 tempest-VolumesActionsTest-613223606 None] Selected osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:37:11 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-4489a499-4d88-468b-a37e-0d74b41ccc35 tempest-VolumesActionsTest-613223606 None] casted to osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f Jun 29 03:37:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-4489a499-4d88-468b-a37e-0d74b41ccc35 tempest-VolumesActionsTest-613223606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-0ed6528a-6cde-424d-bcef-604e767a81a4 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:37:11 devstack sudo[110185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf Jun 29 03:37:11 devstack sudo[110185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:37:11 devstack sudo[110189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-0ed6528a-6cde-424d-bcef-604e767a81a4 1073741824 Jun 29 03:37:11 devstack sudo[110189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:37:12 devstack cinder-volume[93468]: DEBUG cinder.volume.volume_utils [None req-2e9fb49a-5da1-4428-a4ce-65ae4ca5c67b tempest-VolumeImageDependencyTests-156688489 None] Attempting download of 512374c2-bfb4-4fcc-a773-d1be4d15497c ((None, [{'url': 'file:///opt/stack/data/glance/images/512374c2-bfb4-4fcc-a773-d1be4d15497c', 'metadata': {}}])) to volume 3e6cce25-4339-4f80-967a-77ffe10d426f. {{(pid=93468) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 29 03:37:12 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[1108d23c-e321-4ca0-8638-1b78acc096ca]: (4, 'raw') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:37:12 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2e9fb49a-5da1-4428-a4ce-65ae4ca5c67b tempest-VolumeImageDependencyTests-156688489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_512374c2-bfb4-4fcc-a773-d1be4d15497c_2nokbjqk {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:37:12 devstack sudo[110192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_512374c2-bfb4-4fcc-a773-d1be4d15497c_2nokbjqk Jun 29 03:37:12 devstack sudo[110192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:37:12 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-fd5c81e5-772a-4c02-9af3-12d15d6e9c56 tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Acquiring lock "cinder-fbbd084c-3f07-4b2b-8e6f-827a1de4b9c4-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:37:12 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-fd5c81e5-772a-4c02-9af3-12d15d6e9c56 tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Lock "cinder-fbbd084c-3f07-4b2b-8e6f-827a1de4b9c4-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:37:12 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-fd5c81e5-772a-4c02-9af3-12d15d6e9c56 tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Acquiring lock "cinder-quobyte-fbbd084c-3f07-4b2b-8e6f-827a1de4b9c4" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:37:13 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-fd5c81e5-772a-4c02-9af3-12d15d6e9c56 tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Lock "cinder-quobyte-fbbd084c-3f07-4b2b-8e6f-827a1de4b9c4" acquired by "delete_volume" :: waited 0.043s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:37:13 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[94aa6803-f7a9-41ce-b8c8-95913298874b]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:37:13 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-fd5c81e5-772a-4c02-9af3-12d15d6e9c56 tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-fbbd084c-3f07-4b2b-8e6f-827a1de4b9c4 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:37:13 devstack sudo[110185]: pam_unix(sudo:session): session closed for user root Jun 29 03:37:13 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf" returned: 0 in 1.409s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:37:13 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:37:13 devstack cinder-volume[93468]: DEBUG oslo_service.periodic_task [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Running periodic task VolumeManager._thread_info {{(pid=93468) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 29 03:37:13 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] thread count: 28 {{(pid=93468) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 29 03:37:13 devstack sudo[110207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-fbbd084c-3f07-4b2b-8e6f-827a1de4b9c4 Jun 29 03:37:13 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] thread info: [<_MainThread(MainThread, started 132331377287296)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93468) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 29 03:37:13 devstack sudo[110207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:37:13 devstack sudo[110192]: pam_unix(sudo:session): session closed for user root Jun 29 03:37:13 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2e9fb49a-5da1-4428-a4ce-65ae4ca5c67b tempest-VolumeImageDependencyTests-156688489 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_512374c2-bfb4-4fcc-a773-d1be4d15497c_2nokbjqk" returned: 0 in 1.245s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:37:13 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2e9fb49a-5da1-4428-a4ce-65ae4ca5c67b tempest-VolumeImageDependencyTests-156688489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_512374c2-bfb4-4fcc-a773-d1be4d15497c_2nokbjqk {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:37:13 devstack sudo[110183]: pam_unix(sudo:session): session closed for user root Jun 29 03:37:13 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-572565c0-a921-408d-b958-aa54f3b05df0 tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf" returned: 0 in 1.607s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:37:13 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-572565c0-a921-408d-b958-aa54f3b05df0 tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:37:13 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-572565c0-a921-408d-b958-aa54f3b05df0 tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Deleted volume successfully. Jun 29 03:37:13 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-572565c0-a921-408d-b958-aa54f3b05df0 tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Lock "cinder-240ae311-e208-4617-886f-d4977f3e3c21-delete_volume" released by "delete_volume" :: held 4.323s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:37:13 devstack sudo[110217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_512374c2-bfb4-4fcc-a773-d1be4d15497c_2nokbjqk Jun 29 03:37:13 devstack sudo[110217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:37:13 devstack sudo[110189]: pam_unix(sudo:session): session closed for user root Jun 29 03:37:13 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-4489a499-4d88-468b-a37e-0d74b41ccc35 tempest-VolumesActionsTest-613223606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-0ed6528a-6cde-424d-bcef-604e767a81a4 1073741824" returned: 0 in 1.680s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:37:13 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-4489a499-4d88-468b-a37e-0d74b41ccc35 tempest-VolumesActionsTest-613223606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-0ed6528a-6cde-424d-bcef-604e767a81a4 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:37:13 devstack sudo[110220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-0ed6528a-6cde-424d-bcef-604e767a81a4 Jun 29 03:37:13 devstack sudo[110220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:37:14 devstack sudo[110217]: pam_unix(sudo:session): session closed for user root Jun 29 03:37:14 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2e9fb49a-5da1-4428-a4ce-65ae4ca5c67b tempest-VolumeImageDependencyTests-156688489 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_512374c2-bfb4-4fcc-a773-d1be4d15497c_2nokbjqk" returned: 1 in 0.841s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:37:14 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2e9fb49a-5da1-4428-a4ce-65ae4ca5c67b tempest-VolumeImageDependencyTests-156688489 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_512374c2-bfb4-4fcc-a773-d1be4d15497c_2nokbjqk' failed. Not Retrying. {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 29 03:37:14 devstack sudo[110207]: pam_unix(sudo:session): session closed for user root Jun 29 03:37:14 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[e421770d-339b-4d06-bf3a-5a7e526e1237]: (4, 'raw') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:37:14 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2e9fb49a-5da1-4428-a4ce-65ae4ca5c67b tempest-VolumeImageDependencyTests-156688489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_512374c2-bfb4-4fcc-a773-d1be4d15497c_wuvfibwjdevstack@QuobyteHD {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:37:14 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-fd5c81e5-772a-4c02-9af3-12d15d6e9c56 tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-fbbd084c-3f07-4b2b-8e6f-827a1de4b9c4" returned: 0 in 1.158s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:37:14 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-fd5c81e5-772a-4c02-9af3-12d15d6e9c56 tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-fbbd084c-3f07-4b2b-8e6f-827a1de4b9c4 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:37:14 devstack sudo[110229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-fbbd084c-3f07-4b2b-8e6f-827a1de4b9c4 Jun 29 03:37:14 devstack sudo[110229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:37:14 devstack sudo[110228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_512374c2-bfb4-4fcc-a773-d1be4d15497c_wuvfibwjdevstack@QuobyteHD Jun 29 03:37:14 devstack sudo[110228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:37:14 devstack sudo[110220]: pam_unix(sudo:session): session closed for user root Jun 29 03:37:14 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-4489a499-4d88-468b-a37e-0d74b41ccc35 tempest-VolumesActionsTest-613223606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-0ed6528a-6cde-424d-bcef-604e767a81a4" returned: 0 in 0.815s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:37:14 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-4489a499-4d88-468b-a37e-0d74b41ccc35 tempest-VolumesActionsTest-613223606 None] <== create_volume: return (2537ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:37:14 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-4489a499-4d88-468b-a37e-0d74b41ccc35 tempest-VolumesActionsTest-613223606 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.541s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:37:14 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-4489a499-4d88-468b-a37e-0d74b41ccc35 tempest-VolumesActionsTest-613223606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f11b9a71-c762-4182-a21a-fd43a3182b9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ed6528a-6cde-424d-bcef-604e767a81a4', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:37:14 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-4489a499-4d88-468b-a37e-0d74b41ccc35 tempest-VolumesActionsTest-613223606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8055e18f-07f9-4e5a-b884-fc650203de99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:37:14 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-4489a499-4d88-468b-a37e-0d74b41ccc35 tempest-VolumesActionsTest-613223606 None] Volume volume-0ed6528a-6cde-424d-bcef-604e767a81a4 (0ed6528a-6cde-424d-bcef-604e767a81a4): created successfully Jun 29 03:37:14 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-4489a499-4d88-468b-a37e-0d74b41ccc35 tempest-VolumesActionsTest-613223606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8055e18f-07f9-4e5a-b884-fc650203de99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:37:14 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-4489a499-4d88-468b-a37e-0d74b41ccc35 tempest-VolumesActionsTest-613223606 None] Flow 'volume_create_manager' (156d75f4-db2a-4d8b-8dc7-b6dd019e6633) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:37:14 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-4489a499-4d88-468b-a37e-0d74b41ccc35 tempest-VolumesActionsTest-613223606 None] Created volume successfully. Jun 29 03:37:14 devstack sudo[110229]: pam_unix(sudo:session): session closed for user root Jun 29 03:37:14 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-fd5c81e5-772a-4c02-9af3-12d15d6e9c56 tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-fbbd084c-3f07-4b2b-8e6f-827a1de4b9c4" returned: 0 in 0.721s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:37:14 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-fd5c81e5-772a-4c02-9af3-12d15d6e9c56 tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Lock "cinder-quobyte-fbbd084c-3f07-4b2b-8e6f-827a1de4b9c4" released by "delete_volume" :: held 1.967s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:37:15 devstack sudo[110228]: pam_unix(sudo:session): session closed for user root Jun 29 03:37:15 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2e9fb49a-5da1-4428-a4ce-65ae4ca5c67b tempest-VolumeImageDependencyTests-156688489 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_512374c2-bfb4-4fcc-a773-d1be4d15497c_wuvfibwjdevstack@QuobyteHD" returned: 0 in 0.786s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:37:15 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2e9fb49a-5da1-4428-a4ce-65ae4ca5c67b tempest-VolumeImageDependencyTests-156688489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_512374c2-bfb4-4fcc-a773-d1be4d15497c_wuvfibwjdevstack@QuobyteHD {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:37:15 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-fd5c81e5-772a-4c02-9af3-12d15d6e9c56 tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Created reservations ['444964bc-da60-4e56-b698-73171b9e46dc', 'c49e523f-6a6b-4d2b-b803-09df886e6051', '87ab73a7-a9e6-4470-abaa-63d6429d5339', 'd6aead85-49d1-4d99-b446-836bb400d9d6'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:37:15 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-fd5c81e5-772a-4c02-9af3-12d15d6e9c56 tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:37:15 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-fd5c81e5-772a-4c02-9af3-12d15d6e9c56 tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:37:15 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-fd5c81e5-772a-4c02-9af3-12d15d6e9c56 tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:37:15 devstack sudo[110236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_512374c2-bfb4-4fcc-a773-d1be4d15497c_wuvfibwjdevstack@QuobyteHD Jun 29 03:37:15 devstack sudo[110236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:37:15 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-fd5c81e5-772a-4c02-9af3-12d15d6e9c56 tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:37:15 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-fd5c81e5-772a-4c02-9af3-12d15d6e9c56 tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:37:15 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-fd5c81e5-772a-4c02-9af3-12d15d6e9c56 tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:37:15 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-ad896f69-17d3-4add-9585-3de660e7d42f tempest-VolumesActionsTest-1356070032 None] Acquiring lock "cinder-0ed6528a-6cde-424d-bcef-604e767a81a4-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:37:15 devstack sudo[110238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf Jun 29 03:37:15 devstack sudo[110238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:37:15 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-ad896f69-17d3-4add-9585-3de660e7d42f tempest-VolumesActionsTest-1356070032 None] Lock "cinder-0ed6528a-6cde-424d-bcef-604e767a81a4-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:37:15 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-ad896f69-17d3-4add-9585-3de660e7d42f tempest-VolumesActionsTest-1356070032 None] Acquiring lock "cinder-quobyte-0ed6528a-6cde-424d-bcef-604e767a81a4" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:37:15 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-19092322-1086-422b-9c54-dd6fb8724722 tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Acquiring lock "cinder-4b621a92-cb64-4ec4-b4e0-8bacd726e2dd-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:37:15 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-ad896f69-17d3-4add-9585-3de660e7d42f tempest-VolumesActionsTest-1356070032 None] Lock "cinder-quobyte-0ed6528a-6cde-424d-bcef-604e767a81a4" acquired by "delete_volume" :: waited 0.036s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:37:15 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-19092322-1086-422b-9c54-dd6fb8724722 tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Lock "cinder-4b621a92-cb64-4ec4-b4e0-8bacd726e2dd-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:37:15 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[97d2bb32-c6d6-4508-a211-5655ffa17c6f]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:37:15 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ad896f69-17d3-4add-9585-3de660e7d42f tempest-VolumesActionsTest-1356070032 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-0ed6528a-6cde-424d-bcef-604e767a81a4 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:37:15 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-19092322-1086-422b-9c54-dd6fb8724722 tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Acquiring lock "cinder-quobyte-4b621a92-cb64-4ec4-b4e0-8bacd726e2dd" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:37:15 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-19092322-1086-422b-9c54-dd6fb8724722 tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Lock "cinder-quobyte-4b621a92-cb64-4ec4-b4e0-8bacd726e2dd" acquired by "delete_volume" :: waited 0.027s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:37:15 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9ce44b6-4ee5-40e4-9124-37818ea6e55c]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:37:15 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-19092322-1086-422b-9c54-dd6fb8724722 tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-4b621a92-cb64-4ec4-b4e0-8bacd726e2dd {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:37:15 devstack sudo[110240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-0ed6528a-6cde-424d-bcef-604e767a81a4 Jun 29 03:37:15 devstack sudo[110240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:37:15 devstack sudo[110241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-4b621a92-cb64-4ec4-b4e0-8bacd726e2dd Jun 29 03:37:15 devstack sudo[110241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:37:16 devstack sudo[110238]: pam_unix(sudo:session): session closed for user root Jun 29 03:37:16 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-fd5c81e5-772a-4c02-9af3-12d15d6e9c56 tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf" returned: 0 in 0.929s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:37:16 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-fd5c81e5-772a-4c02-9af3-12d15d6e9c56 tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:37:16 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-fd5c81e5-772a-4c02-9af3-12d15d6e9c56 tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Deleted volume successfully. Jun 29 03:37:16 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-fd5c81e5-772a-4c02-9af3-12d15d6e9c56 tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Lock "cinder-fbbd084c-3f07-4b2b-8e6f-827a1de4b9c4-delete_volume" released by "delete_volume" :: held 3.260s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:37:16 devstack sudo[110236]: pam_unix(sudo:session): session closed for user root Jun 29 03:37:16 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2e9fb49a-5da1-4428-a4ce-65ae4ca5c67b tempest-VolumeImageDependencyTests-156688489 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_512374c2-bfb4-4fcc-a773-d1be4d15497c_wuvfibwjdevstack@QuobyteHD" returned: 1 in 1.125s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:37:16 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2e9fb49a-5da1-4428-a4ce-65ae4ca5c67b tempest-VolumeImageDependencyTests-156688489 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_512374c2-bfb4-4fcc-a773-d1be4d15497c_wuvfibwjdevstack@QuobyteHD' failed. Not Retrying. {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 29 03:37:16 devstack cinder-volume[93468]: DEBUG cinder.image.image_utils [None req-2e9fb49a-5da1-4428-a4ce-65ae4ca5c67b tempest-VolumeImageDependencyTests-156688489 None] 512374c2-bfb4-4fcc-a773-d1be4d15497c was raw, converting to raw {{(pid=93468) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 29 03:37:16 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2e9fb49a-5da1-4428-a4ce-65ae4ca5c67b tempest-VolumeImageDependencyTests-156688489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_512374c2-bfb4-4fcc-a773-d1be4d15497c_wuvfibwjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-3e6cce25-4339-4f80-967a-77ffe10d426f {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:37:16 devstack sudo[110248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_512374c2-bfb4-4fcc-a773-d1be4d15497c_wuvfibwjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-3e6cce25-4339-4f80-967a-77ffe10d426f Jun 29 03:37:16 devstack sudo[110248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:37:16 devstack sudo[110240]: pam_unix(sudo:session): session closed for user root Jun 29 03:37:16 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ad896f69-17d3-4add-9585-3de660e7d42f tempest-VolumesActionsTest-1356070032 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-0ed6528a-6cde-424d-bcef-604e767a81a4" returned: 0 in 1.098s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:37:16 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ad896f69-17d3-4add-9585-3de660e7d42f tempest-VolumesActionsTest-1356070032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-0ed6528a-6cde-424d-bcef-604e767a81a4 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:37:16 devstack sudo[110256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-0ed6528a-6cde-424d-bcef-604e767a81a4 Jun 29 03:37:16 devstack sudo[110256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:37:16 devstack sudo[110241]: pam_unix(sudo:session): session closed for user root Jun 29 03:37:16 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-19092322-1086-422b-9c54-dd6fb8724722 tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-4b621a92-cb64-4ec4-b4e0-8bacd726e2dd" returned: 0 in 1.083s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:37:16 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-19092322-1086-422b-9c54-dd6fb8724722 tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-4b621a92-cb64-4ec4-b4e0-8bacd726e2dd {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:37:16 devstack sudo[110259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-4b621a92-cb64-4ec4-b4e0-8bacd726e2dd Jun 29 03:37:16 devstack sudo[110259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:37:16 devstack sudo[110248]: pam_unix(sudo:session): session closed for user root Jun 29 03:37:16 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2e9fb49a-5da1-4428-a4ce-65ae4ca5c67b tempest-VolumeImageDependencyTests-156688489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_512374c2-bfb4-4fcc-a773-d1be4d15497c_wuvfibwjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-3e6cce25-4339-4f80-967a-77ffe10d426f" returned: 0 in 0.823s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:37:16 devstack cinder-volume[93468]: DEBUG cinder.image.image_utils [None req-2e9fb49a-5da1-4428-a4ce-65ae4ca5c67b tempest-VolumeImageDependencyTests-156688489 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_512374c2-bfb4-4fcc-a773-d1be4d15497c_wuvfibwjdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-3e6cce25-4339-4f80-967a-77ffe10d426f {{(pid=93468) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 29 03:37:16 devstack cinder-volume[93468]: INFO cinder.image.image_utils [None req-2e9fb49a-5da1-4428-a4ce-65ae4ca5c67b tempest-VolumeImageDependencyTests-156688489 None] Converted 0.00 MB image at 0.00 MB/s Jun 29 03:37:16 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2e9fb49a-5da1-4428-a4ce-65ae4ca5c67b tempest-VolumeImageDependencyTests-156688489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-3e6cce25-4339-4f80-967a-77ffe10d426f 1G {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:37:17 devstack sudo[110265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-3e6cce25-4339-4f80-967a-77ffe10d426f 1G Jun 29 03:37:17 devstack sudo[110265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:37:17 devstack sudo[110256]: pam_unix(sudo:session): session closed for user root Jun 29 03:37:17 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ad896f69-17d3-4add-9585-3de660e7d42f tempest-VolumesActionsTest-1356070032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-0ed6528a-6cde-424d-bcef-604e767a81a4" returned: 0 in 0.785s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:37:17 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-ad896f69-17d3-4add-9585-3de660e7d42f tempest-VolumesActionsTest-1356070032 None] Lock "cinder-quobyte-0ed6528a-6cde-424d-bcef-604e767a81a4" released by "delete_volume" :: held 1.971s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:37:17 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-ad896f69-17d3-4add-9585-3de660e7d42f tempest-VolumesActionsTest-1356070032 None] Created reservations ['771e3f0f-bffa-4174-9de4-ed1bb8f22c91', 'cc2710d1-de74-4313-9ccd-2213f8591007', '793451bc-59b2-4bcc-8242-481ad85fe97d', '7293d503-dd28-4f2c-a430-64b2a58da4f6'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:37:17 devstack sudo[110259]: pam_unix(sudo:session): session closed for user root Jun 29 03:37:17 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-19092322-1086-422b-9c54-dd6fb8724722 tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-4b621a92-cb64-4ec4-b4e0-8bacd726e2dd" returned: 0 in 0.765s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:37:17 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-19092322-1086-422b-9c54-dd6fb8724722 tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Lock "cinder-quobyte-4b621a92-cb64-4ec4-b4e0-8bacd726e2dd" released by "delete_volume" :: held 1.910s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:37:17 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-ad896f69-17d3-4add-9585-3de660e7d42f tempest-VolumesActionsTest-1356070032 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:37:17 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-ad896f69-17d3-4add-9585-3de660e7d42f tempest-VolumesActionsTest-1356070032 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:37:17 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-ad896f69-17d3-4add-9585-3de660e7d42f tempest-VolumesActionsTest-1356070032 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:37:17 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-ad896f69-17d3-4add-9585-3de660e7d42f tempest-VolumesActionsTest-1356070032 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:37:17 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-ad896f69-17d3-4add-9585-3de660e7d42f tempest-VolumesActionsTest-1356070032 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:37:17 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ad896f69-17d3-4add-9585-3de660e7d42f tempest-VolumesActionsTest-1356070032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:37:17 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-19092322-1086-422b-9c54-dd6fb8724722 tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Created reservations ['4660e53c-a9b5-4797-aa6e-d0b450a62eb6', 'b51fe162-dfde-45e2-ad5b-e94f37fd0ca7', '50edbaea-df96-48c2-903a-ea69c955c9fc', 'ee146246-82d0-42a2-b279-19cd2288794f'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:37:17 devstack sudo[110272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf Jun 29 03:37:17 devstack sudo[110272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:37:17 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-19092322-1086-422b-9c54-dd6fb8724722 tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:37:17 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-19092322-1086-422b-9c54-dd6fb8724722 tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:37:17 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-19092322-1086-422b-9c54-dd6fb8724722 tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:37:17 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-19092322-1086-422b-9c54-dd6fb8724722 tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:37:17 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-19092322-1086-422b-9c54-dd6fb8724722 tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:37:17 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-19092322-1086-422b-9c54-dd6fb8724722 tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:37:17 devstack sudo[110274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf Jun 29 03:37:17 devstack sudo[110274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:37:17 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-b0c711fb-504b-4204-a118-ca12efcd10e9 tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Acquiring lock "cinder-9ccc07ab-a8d0-40af-8eae-296645be7caa-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:37:17 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-b0c711fb-504b-4204-a118-ca12efcd10e9 tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Lock "cinder-9ccc07ab-a8d0-40af-8eae-296645be7caa-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:37:17 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-b0c711fb-504b-4204-a118-ca12efcd10e9 tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Acquiring lock "cinder-quobyte-9ccc07ab-a8d0-40af-8eae-296645be7caa" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:37:17 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-b0c711fb-504b-4204-a118-ca12efcd10e9 tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Lock "cinder-quobyte-9ccc07ab-a8d0-40af-8eae-296645be7caa" acquired by "delete_volume" :: waited 0.026s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:37:17 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[cecb57b1-373d-4662-85ac-3f414d6dd803]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:37:17 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b0c711fb-504b-4204-a118-ca12efcd10e9 tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9ccc07ab-a8d0-40af-8eae-296645be7caa {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:37:17 devstack sudo[110265]: pam_unix(sudo:session): session closed for user root Jun 29 03:37:17 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2e9fb49a-5da1-4428-a4ce-65ae4ca5c67b tempest-VolumeImageDependencyTests-156688489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-3e6cce25-4339-4f80-967a-77ffe10d426f 1G" returned: 0 in 0.860s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:37:17 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[db0c282c-1caf-4435-a45f-ed88ed6aaf56]: (4, 'raw') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:37:17 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2e9fb49a-5da1-4428-a4ce-65ae4ca5c67b tempest-VolumeImageDependencyTests-156688489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-3e6cce25-4339-4f80-967a-77ffe10d426f {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:37:17 devstack sudo[110279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9ccc07ab-a8d0-40af-8eae-296645be7caa Jun 29 03:37:17 devstack sudo[110279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:37:18 devstack sudo[110280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-3e6cce25-4339-4f80-967a-77ffe10d426f Jun 29 03:37:18 devstack sudo[110280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:37:18 devstack sudo[110272]: pam_unix(sudo:session): session closed for user root Jun 29 03:37:18 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ad896f69-17d3-4add-9585-3de660e7d42f tempest-VolumesActionsTest-1356070032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf" returned: 0 in 0.763s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:37:18 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-ad896f69-17d3-4add-9585-3de660e7d42f tempest-VolumesActionsTest-1356070032 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:37:18 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-ad896f69-17d3-4add-9585-3de660e7d42f tempest-VolumesActionsTest-1356070032 None] Deleted volume successfully. Jun 29 03:37:18 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-ad896f69-17d3-4add-9585-3de660e7d42f tempest-VolumesActionsTest-1356070032 None] Lock "cinder-0ed6528a-6cde-424d-bcef-604e767a81a4-delete_volume" released by "delete_volume" :: held 3.027s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:37:18 devstack sudo[110274]: pam_unix(sudo:session): session closed for user root Jun 29 03:37:18 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-19092322-1086-422b-9c54-dd6fb8724722 tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf" returned: 0 in 0.792s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:37:18 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-19092322-1086-422b-9c54-dd6fb8724722 tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:37:18 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-19092322-1086-422b-9c54-dd6fb8724722 tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Deleted volume successfully. Jun 29 03:37:18 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-19092322-1086-422b-9c54-dd6fb8724722 tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Lock "cinder-4b621a92-cb64-4ec4-b4e0-8bacd726e2dd-delete_volume" released by "delete_volume" :: held 3.003s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:37:18 devstack sudo[110279]: pam_unix(sudo:session): session closed for user root Jun 29 03:37:18 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b0c711fb-504b-4204-a118-ca12efcd10e9 tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9ccc07ab-a8d0-40af-8eae-296645be7caa" returned: 0 in 0.888s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:37:18 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b0c711fb-504b-4204-a118-ca12efcd10e9 tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9ccc07ab-a8d0-40af-8eae-296645be7caa {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:37:18 devstack sudo[110293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9ccc07ab-a8d0-40af-8eae-296645be7caa Jun 29 03:37:18 devstack sudo[110293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:37:18 devstack sudo[110280]: pam_unix(sudo:session): session closed for user root Jun 29 03:37:18 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2e9fb49a-5da1-4428-a4ce-65ae4ca5c67b tempest-VolumeImageDependencyTests-156688489 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-3e6cce25-4339-4f80-967a-77ffe10d426f" returned: 0 in 0.902s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:37:18 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2e9fb49a-5da1-4428-a4ce-65ae4ca5c67b tempest-VolumeImageDependencyTests-156688489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-3e6cce25-4339-4f80-967a-77ffe10d426f {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:37:18 devstack sudo[110295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-3e6cce25-4339-4f80-967a-77ffe10d426f Jun 29 03:37:18 devstack sudo[110295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:37:19 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-87fab547-c7ce-4e5a-b524-04b3cdd51881 tempest-VolumesActionsTest-613223606 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:37:19 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-87fab547-c7ce-4e5a-b524-04b3cdd51881 tempest-VolumesActionsTest-613223606 None] Flow 'volume_create_manager' (0356b567-5dc1-4c7c-8334-ab8ec3945d5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:37:19 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-87fab547-c7ce-4e5a-b524-04b3cdd51881 tempest-VolumesActionsTest-613223606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b34ca507-52d8-45d4-97bb-2d55d30509f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:37:19 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-87fab547-c7ce-4e5a-b524-04b3cdd51881 tempest-VolumesActionsTest-613223606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b34ca507-52d8-45d4-97bb-2d55d30509f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:37:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1684562432',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f00ead80-86e5-4287-be9e-b93cc35d3328,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1532758db6b54b66a2e5c4709e8cfdf7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:37:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:37:19Z,use_quota=True,user_id='b5900938aa1642a58d248cc9fd4c336a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:37:19 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-87fab547-c7ce-4e5a-b524-04b3cdd51881 tempest-VolumesActionsTest-613223606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c8c5c85-b6be-49a2-8085-ebe501a01940) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:37:19 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-87fab547-c7ce-4e5a-b524-04b3cdd51881 tempest-VolumesActionsTest-613223606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c8c5c85-b6be-49a2-8085-ebe501a01940) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:37:19 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-87fab547-c7ce-4e5a-b524-04b3cdd51881 tempest-VolumesActionsTest-613223606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33fa78ff-a72a-4076-9764-669d8d7d1498) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:37:19 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-87fab547-c7ce-4e5a-b524-04b3cdd51881 tempest-VolumesActionsTest-613223606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33fa78ff-a72a-4076-9764-669d8d7d1498) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f00ead80-86e5-4287-be9e-b93cc35d3328', 'volume_name': 'volume-f00ead80-86e5-4287-be9e-b93cc35d3328', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:37:19 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-87fab547-c7ce-4e5a-b524-04b3cdd51881 tempest-VolumesActionsTest-613223606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f19fff57-e43b-4d4b-b5ac-c5a4139b4226) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:37:19 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-87fab547-c7ce-4e5a-b524-04b3cdd51881 tempest-VolumesActionsTest-613223606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f19fff57-e43b-4d4b-b5ac-c5a4139b4226) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:37:19 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-87fab547-c7ce-4e5a-b524-04b3cdd51881 tempest-VolumesActionsTest-613223606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cfd249f-4524-46fc-9bcf-1f24e6941584) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:37:19 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-87fab547-c7ce-4e5a-b524-04b3cdd51881 tempest-VolumesActionsTest-613223606 None] Volume f00ead80-86e5-4287-be9e-b93cc35d3328: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f00ead80-86e5-4287-be9e-b93cc35d3328', 'volume_size': 1} Jun 29 03:37:19 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-87fab547-c7ce-4e5a-b524-04b3cdd51881 tempest-VolumesActionsTest-613223606 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:37:19 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-87fab547-c7ce-4e5a-b524-04b3cdd51881 tempest-VolumesActionsTest-613223606 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:37:19 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-87fab547-c7ce-4e5a-b524-04b3cdd51881 tempest-VolumesActionsTest-613223606 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:37:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1684562432',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f00ead80-86e5-4287-be9e-b93cc35d3328,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1532758db6b54b66a2e5c4709e8cfdf7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:37:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:37:19Z,use_quota=True,user_id='b5900938aa1642a58d248cc9fd4c336a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:37:19 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-87fab547-c7ce-4e5a-b524-04b3cdd51881 tempest-VolumesActionsTest-613223606 None] Creating volume f00ead80-86e5-4287-be9e-b93cc35d3328 {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:37:19 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-87fab547-c7ce-4e5a-b524-04b3cdd51881 tempest-VolumesActionsTest-613223606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:37:19 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-87fab547-c7ce-4e5a-b524-04b3cdd51881 tempest-VolumesActionsTest-613223606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:37:19 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-87fab547-c7ce-4e5a-b524-04b3cdd51881 tempest-VolumesActionsTest-613223606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:37:19 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-87fab547-c7ce-4e5a-b524-04b3cdd51881 tempest-VolumesActionsTest-613223606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:37:19 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-87fab547-c7ce-4e5a-b524-04b3cdd51881 tempest-VolumesActionsTest-613223606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:37:19 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-87fab547-c7ce-4e5a-b524-04b3cdd51881 tempest-VolumesActionsTest-613223606 None] Selected osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:37:19 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-87fab547-c7ce-4e5a-b524-04b3cdd51881 tempest-VolumesActionsTest-613223606 None] casted to osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f Jun 29 03:37:19 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-87fab547-c7ce-4e5a-b524-04b3cdd51881 tempest-VolumesActionsTest-613223606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-f00ead80-86e5-4287-be9e-b93cc35d3328 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:37:19 devstack sudo[110308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-f00ead80-86e5-4287-be9e-b93cc35d3328 1073741824 Jun 29 03:37:19 devstack sudo[110308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:37:19 devstack sudo[110293]: pam_unix(sudo:session): session closed for user root Jun 29 03:37:19 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b0c711fb-504b-4204-a118-ca12efcd10e9 tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9ccc07ab-a8d0-40af-8eae-296645be7caa" returned: 0 in 0.889s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:37:19 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-b0c711fb-504b-4204-a118-ca12efcd10e9 tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Lock "cinder-quobyte-9ccc07ab-a8d0-40af-8eae-296645be7caa" released by "delete_volume" :: held 1.846s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:37:19 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-b0c711fb-504b-4204-a118-ca12efcd10e9 tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Created reservations ['d67dd779-de19-48d1-b011-ac7b828c2549', '98c5c3b6-4b58-4137-a28b-5637bcb0ae89', 'd21ae30f-411d-4ae0-a906-68fe1f59f5b2', 'a1cd3f85-6e3d-4f5a-aea0-4ef4ad36dce1'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:37:19 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-b0c711fb-504b-4204-a118-ca12efcd10e9 tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:37:19 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-b0c711fb-504b-4204-a118-ca12efcd10e9 tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:37:19 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-b0c711fb-504b-4204-a118-ca12efcd10e9 tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:37:19 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-b0c711fb-504b-4204-a118-ca12efcd10e9 tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:37:19 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-b0c711fb-504b-4204-a118-ca12efcd10e9 tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:37:19 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b0c711fb-504b-4204-a118-ca12efcd10e9 tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:37:19 devstack sudo[110354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf Jun 29 03:37:19 devstack sudo[110354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:37:20 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-2ac80bb6-3fe3-4653-8815-03af06a0e478 tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Acquiring lock "cinder-1a4c9cfd-96cf-4c12-9a22-18a278a490aa-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:37:20 devstack sudo[110295]: pam_unix(sudo:session): session closed for user root Jun 29 03:37:20 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-2ac80bb6-3fe3-4653-8815-03af06a0e478 tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Lock "cinder-1a4c9cfd-96cf-4c12-9a22-18a278a490aa-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:37:20 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2e9fb49a-5da1-4428-a4ce-65ae4ca5c67b tempest-VolumeImageDependencyTests-156688489 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-3e6cce25-4339-4f80-967a-77ffe10d426f" returned: 1 in 1.321s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:37:20 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2e9fb49a-5da1-4428-a4ce-65ae4ca5c67b tempest-VolumeImageDependencyTests-156688489 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-3e6cce25-4339-4f80-967a-77ffe10d426f' failed. Not Retrying. {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 29 03:37:20 devstack cinder-volume[93468]: DEBUG cinder.volume.volume_utils [None req-2e9fb49a-5da1-4428-a4ce-65ae4ca5c67b tempest-VolumeImageDependencyTests-156688489 None] Downloaded image 512374c2-bfb4-4fcc-a773-d1be4d15497c ((None, [{'url': 'file:///opt/stack/data/glance/images/512374c2-bfb4-4fcc-a773-d1be4d15497c', 'metadata': {}}])) to volume 3e6cce25-4339-4f80-967a-77ffe10d426f successfully. {{(pid=93468) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 29 03:37:20 devstack cinder-volume[93468]: DEBUG cinder.image.image_utils [None req-2e9fb49a-5da1-4428-a4ce-65ae4ca5c67b tempest-VolumeImageDependencyTests-156688489 None] Temporary image 512374c2-bfb4-4fcc-a773-d1be4d15497c for user 226f091b4a0a46fe9634804b98346582 is deleted. {{(pid=93468) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 29 03:37:20 devstack cinder-volume[93468]: DEBUG cinder.volume.volume_utils [None req-2e9fb49a-5da1-4428-a4ce-65ae4ca5c67b tempest-VolumeImageDependencyTests-156688489 None] Marking volume 3e6cce25-4339-4f80-967a-77ffe10d426f as bootable. {{(pid=93468) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 29 03:37:20 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e9fb49a-5da1-4428-a4ce-65ae4ca5c67b tempest-VolumeImageDependencyTests-156688489 None] Copying metadata from image 512374c2-bfb4-4fcc-a773-d1be4d15497c to 3e6cce25-4339-4f80-967a-77ffe10d426f. {{(pid=93468) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 29 03:37:20 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e9fb49a-5da1-4428-a4ce-65ae4ca5c67b tempest-VolumeImageDependencyTests-156688489 None] Creating volume glance metadata for volume 3e6cce25-4339-4f80-967a-77ffe10d426f backed by image 512374c2-bfb4-4fcc-a773-d1be4d15497c with: {'image_id': '512374c2-bfb4-4fcc-a773-d1be4d15497c', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '2e95569c82e8581e8a78998413a97abb', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=93468) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 29 03:37:20 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-2ac80bb6-3fe3-4653-8815-03af06a0e478 tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Acquiring lock "cinder-quobyte-1a4c9cfd-96cf-4c12-9a22-18a278a490aa" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:37:20 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-2ac80bb6-3fe3-4653-8815-03af06a0e478 tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Lock "cinder-quobyte-1a4c9cfd-96cf-4c12-9a22-18a278a490aa" acquired by "delete_volume" :: waited 0.051s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:37:20 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-2e9fb49a-5da1-4428-a4ce-65ae4ca5c67b tempest-VolumeImageDependencyTests-156688489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2774b0b3-80d1-485f-ba4e-8b83350777a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e6cce25-4339-4f80-967a-77ffe10d426f', 'volume_size': 1, 'image_id': '512374c2-bfb4-4fcc-a773-d1be4d15497c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/512374c2-bfb4-4fcc-a773-d1be4d15497c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '2e95569c82e8581e8a78998413a97abb', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '032dc17188674e20909b693006f713fd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '8615f78943aec56918ae706766a22280ac258cedfc07bd7ac81f7571a9ff5676368d4b8a5bdeac5189449bc16428b01446728a6e0311dff5849bdf5bbea1834e', 'id': '512374c2-bfb4-4fcc-a773-d1be4d15497c', 'created_at': datetime.datetime(2026, 6, 29, 1, 37, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 29, 1, 37, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/512374c2-bfb4-4fcc-a773-d1be4d15497c/file', 'properties': {}}, 'image_service': }' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:37:20 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-2e9fb49a-5da1-4428-a4ce-65ae4ca5c67b tempest-VolumeImageDependencyTests-156688489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c2e6aa1-d044-478c-9ee2-aeb1af06da36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:37:20 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[18860203-9650-4bf4-97cc-5254c57dfb90]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:37:20 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2ac80bb6-3fe3-4653-8815-03af06a0e478 tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-1a4c9cfd-96cf-4c12-9a22-18a278a490aa {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:37:20 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-2e9fb49a-5da1-4428-a4ce-65ae4ca5c67b tempest-VolumeImageDependencyTests-156688489 None] Volume volume-3e6cce25-4339-4f80-967a-77ffe10d426f (3e6cce25-4339-4f80-967a-77ffe10d426f): created successfully Jun 29 03:37:20 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-2e9fb49a-5da1-4428-a4ce-65ae4ca5c67b tempest-VolumeImageDependencyTests-156688489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c2e6aa1-d044-478c-9ee2-aeb1af06da36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:37:20 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-2e9fb49a-5da1-4428-a4ce-65ae4ca5c67b tempest-VolumeImageDependencyTests-156688489 None] Flow 'volume_create_manager' (ae23f868-b4b3-4148-bd6b-24156e74bc2b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:37:20 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-2e9fb49a-5da1-4428-a4ce-65ae4ca5c67b tempest-VolumeImageDependencyTests-156688489 None] Created volume successfully. Jun 29 03:37:20 devstack sudo[110371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-1a4c9cfd-96cf-4c12-9a22-18a278a490aa Jun 29 03:37:20 devstack sudo[110371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:37:21 devstack sudo[110308]: pam_unix(sudo:session): session closed for user root Jun 29 03:37:21 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-87fab547-c7ce-4e5a-b524-04b3cdd51881 tempest-VolumesActionsTest-613223606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-f00ead80-86e5-4287-be9e-b93cc35d3328 1073741824" returned: 0 in 2.131s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:37:21 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-87fab547-c7ce-4e5a-b524-04b3cdd51881 tempest-VolumesActionsTest-613223606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-f00ead80-86e5-4287-be9e-b93cc35d3328 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:37:21 devstack sudo[110354]: pam_unix(sudo:session): session closed for user root Jun 29 03:37:21 devstack sudo[110392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-f00ead80-86e5-4287-be9e-b93cc35d3328 Jun 29 03:37:21 devstack sudo[110392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:37:21 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b0c711fb-504b-4204-a118-ca12efcd10e9 tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf" returned: 0 in 1.710s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:37:21 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-b0c711fb-504b-4204-a118-ca12efcd10e9 tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:37:21 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-b0c711fb-504b-4204-a118-ca12efcd10e9 tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Deleted volume successfully. Jun 29 03:37:21 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-b0c711fb-504b-4204-a118-ca12efcd10e9 tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Lock "cinder-9ccc07ab-a8d0-40af-8eae-296645be7caa-delete_volume" released by "delete_volume" :: held 3.946s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:37:21 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-ac4c0ffc-7645-429a-816e-1f32e07acfd2 tempest-VolumeImageDependencyTests-156688489 None] Acquiring lock "cinder-3e6cce25-4339-4f80-967a-77ffe10d426f-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:37:21 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-ac4c0ffc-7645-429a-816e-1f32e07acfd2 tempest-VolumeImageDependencyTests-156688489 None] Lock "cinder-3e6cce25-4339-4f80-967a-77ffe10d426f-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:37:21 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-ac4c0ffc-7645-429a-816e-1f32e07acfd2 tempest-VolumeImageDependencyTests-156688489 None] Acquiring lock "cinder-quobyte-3e6cce25-4339-4f80-967a-77ffe10d426f" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:37:21 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-ac4c0ffc-7645-429a-816e-1f32e07acfd2 tempest-VolumeImageDependencyTests-156688489 None] Lock "cinder-quobyte-3e6cce25-4339-4f80-967a-77ffe10d426f" acquired by "delete_volume" :: waited 0.021s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:37:21 devstack sudo[110371]: pam_unix(sudo:session): session closed for user root Jun 29 03:37:21 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2ac80bb6-3fe3-4653-8815-03af06a0e478 tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-1a4c9cfd-96cf-4c12-9a22-18a278a490aa" returned: 0 in 1.503s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:37:21 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2ac80bb6-3fe3-4653-8815-03af06a0e478 tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-1a4c9cfd-96cf-4c12-9a22-18a278a490aa {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:37:21 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c0b1554-284b-4c68-b059-0a446870a3db]: (4, 'raw') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:37:21 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ac4c0ffc-7645-429a-816e-1f32e07acfd2 tempest-VolumeImageDependencyTests-156688489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-3e6cce25-4339-4f80-967a-77ffe10d426f {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:37:21 devstack sudo[110398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-1a4c9cfd-96cf-4c12-9a22-18a278a490aa Jun 29 03:37:21 devstack sudo[110398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:37:22 devstack sudo[110400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-3e6cce25-4339-4f80-967a-77ffe10d426f Jun 29 03:37:22 devstack sudo[110400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:37:22 devstack sudo[110392]: pam_unix(sudo:session): session closed for user root Jun 29 03:37:22 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-87fab547-c7ce-4e5a-b524-04b3cdd51881 tempest-VolumesActionsTest-613223606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-f00ead80-86e5-4287-be9e-b93cc35d3328" returned: 0 in 1.041s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:37:22 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-87fab547-c7ce-4e5a-b524-04b3cdd51881 tempest-VolumesActionsTest-613223606 None] <== create_volume: return (3282ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:37:22 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-87fab547-c7ce-4e5a-b524-04b3cdd51881 tempest-VolumesActionsTest-613223606 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.286s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:37:22 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-87fab547-c7ce-4e5a-b524-04b3cdd51881 tempest-VolumesActionsTest-613223606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cfd249f-4524-46fc-9bcf-1f24e6941584) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f00ead80-86e5-4287-be9e-b93cc35d3328', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:37:22 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-87fab547-c7ce-4e5a-b524-04b3cdd51881 tempest-VolumesActionsTest-613223606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9436ab1-9896-4289-bcb5-80353393540b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:37:22 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-87fab547-c7ce-4e5a-b524-04b3cdd51881 tempest-VolumesActionsTest-613223606 None] Volume volume-f00ead80-86e5-4287-be9e-b93cc35d3328 (f00ead80-86e5-4287-be9e-b93cc35d3328): created successfully Jun 29 03:37:22 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-87fab547-c7ce-4e5a-b524-04b3cdd51881 tempest-VolumesActionsTest-613223606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9436ab1-9896-4289-bcb5-80353393540b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:37:22 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-87fab547-c7ce-4e5a-b524-04b3cdd51881 tempest-VolumesActionsTest-613223606 None] Flow 'volume_create_manager' (0356b567-5dc1-4c7c-8334-ab8ec3945d5a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:37:22 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-87fab547-c7ce-4e5a-b524-04b3cdd51881 tempest-VolumesActionsTest-613223606 None] Created volume successfully. Jun 29 03:37:22 devstack sudo[110398]: pam_unix(sudo:session): session closed for user root Jun 29 03:37:22 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2ac80bb6-3fe3-4653-8815-03af06a0e478 tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-1a4c9cfd-96cf-4c12-9a22-18a278a490aa" returned: 0 in 0.895s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:37:22 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-2ac80bb6-3fe3-4653-8815-03af06a0e478 tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Lock "cinder-quobyte-1a4c9cfd-96cf-4c12-9a22-18a278a490aa" released by "delete_volume" :: held 2.483s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:37:22 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-2ac80bb6-3fe3-4653-8815-03af06a0e478 tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Created reservations ['fd2c061b-0457-4cf9-80bd-b6c19a5da749', '1000bbdb-e629-4d16-96d8-88c05357036c', 'e8ae4a11-cc6b-444c-aa3c-6c1dec0c1868', '918eee26-dbb4-4aac-9fba-9dbd0dc536cb'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:37:22 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-2ac80bb6-3fe3-4653-8815-03af06a0e478 tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:37:22 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-2ac80bb6-3fe3-4653-8815-03af06a0e478 tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:37:22 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-2ac80bb6-3fe3-4653-8815-03af06a0e478 tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:37:22 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-2ac80bb6-3fe3-4653-8815-03af06a0e478 tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:37:22 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-2ac80bb6-3fe3-4653-8815-03af06a0e478 tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:37:22 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2ac80bb6-3fe3-4653-8815-03af06a0e478 tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:37:23 devstack sudo[110406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf Jun 29 03:37:23 devstack sudo[110406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:37:23 devstack sudo[110400]: pam_unix(sudo:session): session closed for user root Jun 29 03:37:23 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ac4c0ffc-7645-429a-816e-1f32e07acfd2 tempest-VolumeImageDependencyTests-156688489 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-3e6cce25-4339-4f80-967a-77ffe10d426f" returned: 0 in 1.267s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:37:23 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ac4c0ffc-7645-429a-816e-1f32e07acfd2 tempest-VolumeImageDependencyTests-156688489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-3e6cce25-4339-4f80-967a-77ffe10d426f {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:37:23 devstack sudo[110408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-3e6cce25-4339-4f80-967a-77ffe10d426f Jun 29 03:37:23 devstack sudo[110408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:37:24 devstack sudo[110406]: pam_unix(sudo:session): session closed for user root Jun 29 03:37:24 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2ac80bb6-3fe3-4653-8815-03af06a0e478 tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf" returned: 0 in 1.063s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:37:24 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-2ac80bb6-3fe3-4653-8815-03af06a0e478 tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:37:24 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-2ac80bb6-3fe3-4653-8815-03af06a0e478 tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Deleted volume successfully. Jun 29 03:37:24 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-2ac80bb6-3fe3-4653-8815-03af06a0e478 tempest-CreateVolumesFromSourceVolumeTest-1870387930 None] Lock "cinder-1a4c9cfd-96cf-4c12-9a22-18a278a490aa-delete_volume" released by "delete_volume" :: held 4.034s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:37:24 devstack sudo[110408]: pam_unix(sudo:session): session closed for user root Jun 29 03:37:24 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ac4c0ffc-7645-429a-816e-1f32e07acfd2 tempest-VolumeImageDependencyTests-156688489 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-3e6cce25-4339-4f80-967a-77ffe10d426f" returned: 1 in 1.212s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:37:24 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ac4c0ffc-7645-429a-816e-1f32e07acfd2 tempest-VolumeImageDependencyTests-156688489 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-3e6cce25-4339-4f80-967a-77ffe10d426f' failed. Not Retrying. {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 29 03:37:24 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ac4c0ffc-7645-429a-816e-1f32e07acfd2 tempest-VolumeImageDependencyTests-156688489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-3e6cce25-4339-4f80-967a-77ffe10d426f {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:37:24 devstack sudo[110414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-3e6cce25-4339-4f80-967a-77ffe10d426f Jun 29 03:37:24 devstack sudo[110414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:37:24 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-d9c5e4b6-637a-4460-829b-80a52c85f8dd tempest-VolumesActionsTest-613223606 None] Acquiring lock "cinder-f00ead80-86e5-4287-be9e-b93cc35d3328-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:37:24 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-d9c5e4b6-637a-4460-829b-80a52c85f8dd tempest-VolumesActionsTest-613223606 None] Lock "cinder-f00ead80-86e5-4287-be9e-b93cc35d3328-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:37:24 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-d9c5e4b6-637a-4460-829b-80a52c85f8dd tempest-VolumesActionsTest-613223606 None] Acquiring lock "cinder-quobyte-f00ead80-86e5-4287-be9e-b93cc35d3328" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:37:24 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-d9c5e4b6-637a-4460-829b-80a52c85f8dd tempest-VolumesActionsTest-613223606 None] Lock "cinder-quobyte-f00ead80-86e5-4287-be9e-b93cc35d3328" acquired by "delete_volume" :: waited 0.025s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:37:25 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3e641cd-f933-4d98-9381-8f6ff6afa3b2]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:37:25 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d9c5e4b6-637a-4460-829b-80a52c85f8dd tempest-VolumesActionsTest-613223606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-f00ead80-86e5-4287-be9e-b93cc35d3328 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:37:25 devstack sudo[110416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-f00ead80-86e5-4287-be9e-b93cc35d3328 Jun 29 03:37:25 devstack sudo[110416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:37:25 devstack sudo[110414]: pam_unix(sudo:session): session closed for user root Jun 29 03:37:25 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ac4c0ffc-7645-429a-816e-1f32e07acfd2 tempest-VolumeImageDependencyTests-156688489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-3e6cce25-4339-4f80-967a-77ffe10d426f" returned: 0 in 1.319s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:37:25 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-ac4c0ffc-7645-429a-816e-1f32e07acfd2 tempest-VolumeImageDependencyTests-156688489 None] Lock "cinder-quobyte-3e6cce25-4339-4f80-967a-77ffe10d426f" released by "delete_volume" :: held 3.931s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:37:25 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-ac4c0ffc-7645-429a-816e-1f32e07acfd2 tempest-VolumeImageDependencyTests-156688489 None] Created reservations ['7d200fe8-2720-46dc-a6b4-ef5305d0636c', '9a608d9b-76d0-422a-a625-18f81ec7c00b', '1e4b1c4f-b01c-4b4f-a08d-238462b8757a', '704c4b5a-643f-4c5b-9488-7c82ab44db62'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:37:25 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-ac4c0ffc-7645-429a-816e-1f32e07acfd2 tempest-VolumeImageDependencyTests-156688489 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:37:25 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-ac4c0ffc-7645-429a-816e-1f32e07acfd2 tempest-VolumeImageDependencyTests-156688489 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:37:25 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-ac4c0ffc-7645-429a-816e-1f32e07acfd2 tempest-VolumeImageDependencyTests-156688489 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:37:25 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-ac4c0ffc-7645-429a-816e-1f32e07acfd2 tempest-VolumeImageDependencyTests-156688489 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:37:25 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-ac4c0ffc-7645-429a-816e-1f32e07acfd2 tempest-VolumeImageDependencyTests-156688489 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:37:25 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ac4c0ffc-7645-429a-816e-1f32e07acfd2 tempest-VolumeImageDependencyTests-156688489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:37:26 devstack sudo[110425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf Jun 29 03:37:26 devstack sudo[110425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:37:26 devstack sudo[110416]: pam_unix(sudo:session): session closed for user root Jun 29 03:37:26 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d9c5e4b6-637a-4460-829b-80a52c85f8dd tempest-VolumesActionsTest-613223606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-f00ead80-86e5-4287-be9e-b93cc35d3328" returned: 0 in 1.726s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:37:26 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d9c5e4b6-637a-4460-829b-80a52c85f8dd tempest-VolumesActionsTest-613223606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-f00ead80-86e5-4287-be9e-b93cc35d3328 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:37:26 devstack sudo[110430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-f00ead80-86e5-4287-be9e-b93cc35d3328 Jun 29 03:37:26 devstack sudo[110430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:37:27 devstack sudo[110425]: pam_unix(sudo:session): session closed for user root Jun 29 03:37:27 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ac4c0ffc-7645-429a-816e-1f32e07acfd2 tempest-VolumeImageDependencyTests-156688489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf" returned: 0 in 1.489s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:37:27 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-ac4c0ffc-7645-429a-816e-1f32e07acfd2 tempest-VolumeImageDependencyTests-156688489 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:37:27 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-ac4c0ffc-7645-429a-816e-1f32e07acfd2 tempest-VolumeImageDependencyTests-156688489 None] Deleted volume successfully. Jun 29 03:37:27 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-ac4c0ffc-7645-429a-816e-1f32e07acfd2 tempest-VolumeImageDependencyTests-156688489 None] Lock "cinder-3e6cce25-4339-4f80-967a-77ffe10d426f-delete_volume" released by "delete_volume" :: held 5.842s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:37:27 devstack sudo[110430]: pam_unix(sudo:session): session closed for user root Jun 29 03:37:27 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d9c5e4b6-637a-4460-829b-80a52c85f8dd tempest-VolumesActionsTest-613223606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-f00ead80-86e5-4287-be9e-b93cc35d3328" returned: 0 in 0.963s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:37:27 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-d9c5e4b6-637a-4460-829b-80a52c85f8dd tempest-VolumesActionsTest-613223606 None] Lock "cinder-quobyte-f00ead80-86e5-4287-be9e-b93cc35d3328" released by "delete_volume" :: held 2.765s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:37:27 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-d9c5e4b6-637a-4460-829b-80a52c85f8dd tempest-VolumesActionsTest-613223606 None] Created reservations ['44118ec9-e616-475e-bbc7-64538a4d001d', '33db4fe1-246b-4eb2-a8a4-00e18aa92bf9', 'ae979937-bdf7-415b-ad2b-ee002bfe93b0', 'ac4e830a-6593-4e40-b2aa-2ce6ea90aff0'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:37:27 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-d9c5e4b6-637a-4460-829b-80a52c85f8dd tempest-VolumesActionsTest-613223606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:37:27 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-d9c5e4b6-637a-4460-829b-80a52c85f8dd tempest-VolumesActionsTest-613223606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:37:27 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-d9c5e4b6-637a-4460-829b-80a52c85f8dd tempest-VolumesActionsTest-613223606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:37:27 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-d9c5e4b6-637a-4460-829b-80a52c85f8dd tempest-VolumesActionsTest-613223606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:37:27 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-d9c5e4b6-637a-4460-829b-80a52c85f8dd tempest-VolumesActionsTest-613223606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:37:27 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d9c5e4b6-637a-4460-829b-80a52c85f8dd tempest-VolumesActionsTest-613223606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:37:27 devstack sudo[110436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf Jun 29 03:37:27 devstack sudo[110436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:37:28 devstack sudo[110436]: pam_unix(sudo:session): session closed for user root Jun 29 03:37:28 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d9c5e4b6-637a-4460-829b-80a52c85f8dd tempest-VolumesActionsTest-613223606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf" returned: 0 in 0.803s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:37:28 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-d9c5e4b6-637a-4460-829b-80a52c85f8dd tempest-VolumesActionsTest-613223606 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:37:28 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-d9c5e4b6-637a-4460-829b-80a52c85f8dd tempest-VolumesActionsTest-613223606 None] Deleted volume successfully. Jun 29 03:37:28 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-d9c5e4b6-637a-4460-829b-80a52c85f8dd tempest-VolumesActionsTest-613223606 None] Lock "cinder-f00ead80-86e5-4287-be9e-b93cc35d3328-delete_volume" released by "delete_volume" :: held 3.891s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:37:37 devstack cinder-volume[93468]: DEBUG dbcounter [-] [93468] Writing DB stats cinder:SELECT=112,cinder:UPDATE=149,cinder:INSERT=38,cinder:DELETE=9 {{(pid=93468) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 29 03:37:38 devstack cinder-volume[93468]: DEBUG dbcounter [-] [93468] Writing DB stats cinder:UPDATE=171,cinder:DELETE=19,cinder:SELECT=104,cinder:INSERT=44 {{(pid=93468) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 29 03:37:39 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc159d0a-c31e-489e-8918-fd7fef593be8 tempest-VolumesListAdminTestJSON-712967746 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:37:39 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-fc159d0a-c31e-489e-8918-fd7fef593be8 tempest-VolumesListAdminTestJSON-712967746 None] Flow 'volume_create_manager' (8b29f646-69f1-4035-ac16-b91c9eb7784b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:37:39 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-fc159d0a-c31e-489e-8918-fd7fef593be8 tempest-VolumesListAdminTestJSON-712967746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f45218a-e594-438a-b1af-eef865b24d69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:37:39 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-fc159d0a-c31e-489e-8918-fd7fef593be8 tempest-VolumesListAdminTestJSON-712967746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f45218a-e594-438a-b1af-eef865b24d69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:37:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1537695732',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ac336ef-9f60-4ef7-8e41-5082dd108ad6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8cc264059f74815b28dcaff1f75bb06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:37:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:37:40Z,use_quota=True,user_id='5b8490ad1a954182b32c1707cfc34922',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:37:39 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-fc159d0a-c31e-489e-8918-fd7fef593be8 tempest-VolumesListAdminTestJSON-712967746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (187ac453-d5cf-4ab2-bbfa-980068371a1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:37:39 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-fc159d0a-c31e-489e-8918-fd7fef593be8 tempest-VolumesListAdminTestJSON-712967746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (187ac453-d5cf-4ab2-bbfa-980068371a1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:37:39 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-fc159d0a-c31e-489e-8918-fd7fef593be8 tempest-VolumesListAdminTestJSON-712967746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99d64108-fb26-476c-9bca-808e6eecd1e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:37:39 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-fc159d0a-c31e-489e-8918-fd7fef593be8 tempest-VolumesListAdminTestJSON-712967746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99d64108-fb26-476c-9bca-808e6eecd1e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ac336ef-9f60-4ef7-8e41-5082dd108ad6', 'volume_name': 'volume-6ac336ef-9f60-4ef7-8e41-5082dd108ad6', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:37:39 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-fc159d0a-c31e-489e-8918-fd7fef593be8 tempest-VolumesListAdminTestJSON-712967746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d868b6c8-a95b-41b8-ba4b-561f645f714a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:37:39 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-fc159d0a-c31e-489e-8918-fd7fef593be8 tempest-VolumesListAdminTestJSON-712967746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d868b6c8-a95b-41b8-ba4b-561f645f714a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:37:39 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-fc159d0a-c31e-489e-8918-fd7fef593be8 tempest-VolumesListAdminTestJSON-712967746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09e58e56-af35-485e-9ff3-e5dea16c716b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:37:39 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-fc159d0a-c31e-489e-8918-fd7fef593be8 tempest-VolumesListAdminTestJSON-712967746 None] Volume 6ac336ef-9f60-4ef7-8e41-5082dd108ad6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ac336ef-9f60-4ef7-8e41-5082dd108ad6', 'volume_size': 1} Jun 29 03:37:39 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-fc159d0a-c31e-489e-8918-fd7fef593be8 tempest-VolumesListAdminTestJSON-712967746 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:37:39 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-fc159d0a-c31e-489e-8918-fd7fef593be8 tempest-VolumesListAdminTestJSON-712967746 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:37:39 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-fc159d0a-c31e-489e-8918-fd7fef593be8 tempest-VolumesListAdminTestJSON-712967746 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:37:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1537695732',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ac336ef-9f60-4ef7-8e41-5082dd108ad6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8cc264059f74815b28dcaff1f75bb06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:37:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:37:40Z,use_quota=True,user_id='5b8490ad1a954182b32c1707cfc34922',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:37:39 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-fc159d0a-c31e-489e-8918-fd7fef593be8 tempest-VolumesListAdminTestJSON-712967746 None] Creating volume 6ac336ef-9f60-4ef7-8e41-5082dd108ad6 {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:37:39 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-fc159d0a-c31e-489e-8918-fd7fef593be8 tempest-VolumesListAdminTestJSON-712967746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:37:39 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-fc159d0a-c31e-489e-8918-fd7fef593be8 tempest-VolumesListAdminTestJSON-712967746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:37:39 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-fc159d0a-c31e-489e-8918-fd7fef593be8 tempest-VolumesListAdminTestJSON-712967746 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:37:39 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-fc159d0a-c31e-489e-8918-fd7fef593be8 tempest-VolumesListAdminTestJSON-712967746 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:37:39 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-fc159d0a-c31e-489e-8918-fd7fef593be8 tempest-VolumesListAdminTestJSON-712967746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:37:39 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-fc159d0a-c31e-489e-8918-fd7fef593be8 tempest-VolumesListAdminTestJSON-712967746 None] Selected osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:37:39 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-fc159d0a-c31e-489e-8918-fd7fef593be8 tempest-VolumesListAdminTestJSON-712967746 None] casted to osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f Jun 29 03:37:39 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-fc159d0a-c31e-489e-8918-fd7fef593be8 tempest-VolumesListAdminTestJSON-712967746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-6ac336ef-9f60-4ef7-8e41-5082dd108ad6 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:37:39 devstack sudo[110469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-6ac336ef-9f60-4ef7-8e41-5082dd108ad6 1073741824 Jun 29 03:37:39 devstack sudo[110469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:37:40 devstack sudo[110469]: pam_unix(sudo:session): session closed for user root Jun 29 03:37:40 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-fc159d0a-c31e-489e-8918-fd7fef593be8 tempest-VolumesListAdminTestJSON-712967746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-6ac336ef-9f60-4ef7-8e41-5082dd108ad6 1073741824" returned: 0 in 0.829s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:37:40 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-fc159d0a-c31e-489e-8918-fd7fef593be8 tempest-VolumesListAdminTestJSON-712967746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-6ac336ef-9f60-4ef7-8e41-5082dd108ad6 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:37:40 devstack sudo[110474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-6ac336ef-9f60-4ef7-8e41-5082dd108ad6 Jun 29 03:37:40 devstack sudo[110474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:37:41 devstack sudo[110474]: pam_unix(sudo:session): session closed for user root Jun 29 03:37:41 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-fc159d0a-c31e-489e-8918-fd7fef593be8 tempest-VolumesListAdminTestJSON-712967746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-6ac336ef-9f60-4ef7-8e41-5082dd108ad6" returned: 0 in 0.660s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:37:41 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-fc159d0a-c31e-489e-8918-fd7fef593be8 tempest-VolumesListAdminTestJSON-712967746 None] <== create_volume: return (1533ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:37:41 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-fc159d0a-c31e-489e-8918-fd7fef593be8 tempest-VolumesListAdminTestJSON-712967746 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.535s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:37:41 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-fc159d0a-c31e-489e-8918-fd7fef593be8 tempest-VolumesListAdminTestJSON-712967746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09e58e56-af35-485e-9ff3-e5dea16c716b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ac336ef-9f60-4ef7-8e41-5082dd108ad6', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:37:41 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-fc159d0a-c31e-489e-8918-fd7fef593be8 tempest-VolumesListAdminTestJSON-712967746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52d8c9c1-ca3f-48a2-b249-afd13ce11da2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:37:41 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-fc159d0a-c31e-489e-8918-fd7fef593be8 tempest-VolumesListAdminTestJSON-712967746 None] Volume volume-6ac336ef-9f60-4ef7-8e41-5082dd108ad6 (6ac336ef-9f60-4ef7-8e41-5082dd108ad6): created successfully Jun 29 03:37:41 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-fc159d0a-c31e-489e-8918-fd7fef593be8 tempest-VolumesListAdminTestJSON-712967746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52d8c9c1-ca3f-48a2-b249-afd13ce11da2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:37:41 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-fc159d0a-c31e-489e-8918-fd7fef593be8 tempest-VolumesListAdminTestJSON-712967746 None] Flow 'volume_create_manager' (8b29f646-69f1-4035-ac16-b91c9eb7784b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:37:41 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-fc159d0a-c31e-489e-8918-fd7fef593be8 tempest-VolumesListAdminTestJSON-712967746 None] Created volume successfully. Jun 29 03:37:42 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-dbb98145-b6d1-40ba-91f5-8506c3070199 tempest-VolumesListAdminTestJSON-712967746 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:37:42 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-dbb98145-b6d1-40ba-91f5-8506c3070199 tempest-VolumesListAdminTestJSON-712967746 None] Flow 'volume_create_manager' (101984d5-9f51-4a42-9ec3-6934ac5bfee4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:37:42 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-dbb98145-b6d1-40ba-91f5-8506c3070199 tempest-VolumesListAdminTestJSON-712967746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7737cd1-4858-46b0-8f3f-7324d0c78c9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:37:42 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-dbb98145-b6d1-40ba-91f5-8506c3070199 tempest-VolumesListAdminTestJSON-712967746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7737cd1-4858-46b0-8f3f-7324d0c78c9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:37:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1197363176',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08e4ce01-9f00-4878-8d94-015d01620579,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8cc264059f74815b28dcaff1f75bb06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:37:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:37:42Z,use_quota=True,user_id='5b8490ad1a954182b32c1707cfc34922',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:37:42 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-dbb98145-b6d1-40ba-91f5-8506c3070199 tempest-VolumesListAdminTestJSON-712967746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9385acdd-9526-4d3a-ac92-b46550e52fad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:37:42 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-dbb98145-b6d1-40ba-91f5-8506c3070199 tempest-VolumesListAdminTestJSON-712967746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9385acdd-9526-4d3a-ac92-b46550e52fad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:37:42 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-dbb98145-b6d1-40ba-91f5-8506c3070199 tempest-VolumesListAdminTestJSON-712967746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ecad25b-c6ab-47d2-b12d-476901c042ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:37:42 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-dbb98145-b6d1-40ba-91f5-8506c3070199 tempest-VolumesListAdminTestJSON-712967746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ecad25b-c6ab-47d2-b12d-476901c042ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '08e4ce01-9f00-4878-8d94-015d01620579', 'volume_name': 'volume-08e4ce01-9f00-4878-8d94-015d01620579', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:37:42 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-dbb98145-b6d1-40ba-91f5-8506c3070199 tempest-VolumesListAdminTestJSON-712967746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4cb338e-6473-4b18-95d5-43ee426db8ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:37:42 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-dbb98145-b6d1-40ba-91f5-8506c3070199 tempest-VolumesListAdminTestJSON-712967746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4cb338e-6473-4b18-95d5-43ee426db8ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:37:42 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-dbb98145-b6d1-40ba-91f5-8506c3070199 tempest-VolumesListAdminTestJSON-712967746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e5a4a06-837b-4497-b09c-59cc84f87fc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:37:42 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-dbb98145-b6d1-40ba-91f5-8506c3070199 tempest-VolumesListAdminTestJSON-712967746 None] Volume 08e4ce01-9f00-4878-8d94-015d01620579: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-08e4ce01-9f00-4878-8d94-015d01620579', 'volume_size': 1} Jun 29 03:37:42 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-dbb98145-b6d1-40ba-91f5-8506c3070199 tempest-VolumesListAdminTestJSON-712967746 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:37:42 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-dbb98145-b6d1-40ba-91f5-8506c3070199 tempest-VolumesListAdminTestJSON-712967746 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:37:42 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-dbb98145-b6d1-40ba-91f5-8506c3070199 tempest-VolumesListAdminTestJSON-712967746 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:37:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1197363176',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08e4ce01-9f00-4878-8d94-015d01620579,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8cc264059f74815b28dcaff1f75bb06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:37:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:37:42Z,use_quota=True,user_id='5b8490ad1a954182b32c1707cfc34922',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:37:42 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-dbb98145-b6d1-40ba-91f5-8506c3070199 tempest-VolumesListAdminTestJSON-712967746 None] Creating volume 08e4ce01-9f00-4878-8d94-015d01620579 {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:37:42 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-dbb98145-b6d1-40ba-91f5-8506c3070199 tempest-VolumesListAdminTestJSON-712967746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:37:42 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-dbb98145-b6d1-40ba-91f5-8506c3070199 tempest-VolumesListAdminTestJSON-712967746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:37:42 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-dbb98145-b6d1-40ba-91f5-8506c3070199 tempest-VolumesListAdminTestJSON-712967746 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:37:42 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-dbb98145-b6d1-40ba-91f5-8506c3070199 tempest-VolumesListAdminTestJSON-712967746 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:37:42 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-dbb98145-b6d1-40ba-91f5-8506c3070199 tempest-VolumesListAdminTestJSON-712967746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:37:42 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-dbb98145-b6d1-40ba-91f5-8506c3070199 tempest-VolumesListAdminTestJSON-712967746 None] Selected osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:37:42 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-dbb98145-b6d1-40ba-91f5-8506c3070199 tempest-VolumesListAdminTestJSON-712967746 None] casted to osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f Jun 29 03:37:42 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-dbb98145-b6d1-40ba-91f5-8506c3070199 tempest-VolumesListAdminTestJSON-712967746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-08e4ce01-9f00-4878-8d94-015d01620579 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:37:42 devstack sudo[110478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-08e4ce01-9f00-4878-8d94-015d01620579 1073741824 Jun 29 03:37:42 devstack sudo[110478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:37:43 devstack sudo[110478]: pam_unix(sudo:session): session closed for user root Jun 29 03:37:43 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-dbb98145-b6d1-40ba-91f5-8506c3070199 tempest-VolumesListAdminTestJSON-712967746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-08e4ce01-9f00-4878-8d94-015d01620579 1073741824" returned: 0 in 0.827s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:37:43 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-dbb98145-b6d1-40ba-91f5-8506c3070199 tempest-VolumesListAdminTestJSON-712967746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-08e4ce01-9f00-4878-8d94-015d01620579 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:37:43 devstack sudo[110483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-08e4ce01-9f00-4878-8d94-015d01620579 Jun 29 03:37:43 devstack sudo[110483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:37:43 devstack sudo[110483]: pam_unix(sudo:session): session closed for user root Jun 29 03:37:43 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-dbb98145-b6d1-40ba-91f5-8506c3070199 tempest-VolumesListAdminTestJSON-712967746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-08e4ce01-9f00-4878-8d94-015d01620579" returned: 0 in 0.655s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:37:43 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-dbb98145-b6d1-40ba-91f5-8506c3070199 tempest-VolumesListAdminTestJSON-712967746 None] <== create_volume: return (1522ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:37:43 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-dbb98145-b6d1-40ba-91f5-8506c3070199 tempest-VolumesListAdminTestJSON-712967746 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.524s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:37:43 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-dbb98145-b6d1-40ba-91f5-8506c3070199 tempest-VolumesListAdminTestJSON-712967746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e5a4a06-837b-4497-b09c-59cc84f87fc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08e4ce01-9f00-4878-8d94-015d01620579', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:37:43 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-dbb98145-b6d1-40ba-91f5-8506c3070199 tempest-VolumesListAdminTestJSON-712967746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d758193-e555-4b42-937e-fd23964b7619) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:37:44 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-dbb98145-b6d1-40ba-91f5-8506c3070199 tempest-VolumesListAdminTestJSON-712967746 None] Volume volume-08e4ce01-9f00-4878-8d94-015d01620579 (08e4ce01-9f00-4878-8d94-015d01620579): created successfully Jun 29 03:37:44 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-dbb98145-b6d1-40ba-91f5-8506c3070199 tempest-VolumesListAdminTestJSON-712967746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d758193-e555-4b42-937e-fd23964b7619) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:37:44 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-dbb98145-b6d1-40ba-91f5-8506c3070199 tempest-VolumesListAdminTestJSON-712967746 None] Flow 'volume_create_manager' (101984d5-9f51-4a42-9ec3-6934ac5bfee4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:37:44 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-dbb98145-b6d1-40ba-91f5-8506c3070199 tempest-VolumesListAdminTestJSON-712967746 None] Created volume successfully. Jun 29 03:37:44 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab7e5947-5463-4da6-9e94-905148294740 tempest-VolumesListAdminTestJSON-712967746 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:37:44 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-ab7e5947-5463-4da6-9e94-905148294740 tempest-VolumesListAdminTestJSON-712967746 None] Flow 'volume_create_manager' (2d1148aa-1a01-4ec1-b57b-af776e330655) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:37:44 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-ab7e5947-5463-4da6-9e94-905148294740 tempest-VolumesListAdminTestJSON-712967746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8abdf7ba-d6dc-4561-b522-62ac0b10d489) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:37:44 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-ab7e5947-5463-4da6-9e94-905148294740 tempest-VolumesListAdminTestJSON-712967746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8abdf7ba-d6dc-4561-b522-62ac0b10d489) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:37:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-608983773',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1f6abf1-b20d-4c88-9b45-222ebafecc66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8cc264059f74815b28dcaff1f75bb06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:37:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:37:45Z,use_quota=True,user_id='5b8490ad1a954182b32c1707cfc34922',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:37:44 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-ab7e5947-5463-4da6-9e94-905148294740 tempest-VolumesListAdminTestJSON-712967746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34f02db4-fe86-4dd4-aaca-871037928b3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:37:44 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-ab7e5947-5463-4da6-9e94-905148294740 tempest-VolumesListAdminTestJSON-712967746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34f02db4-fe86-4dd4-aaca-871037928b3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:37:44 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-ab7e5947-5463-4da6-9e94-905148294740 tempest-VolumesListAdminTestJSON-712967746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bc9be00-c5b8-492b-bb27-7c1efbd102a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:37:44 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-ab7e5947-5463-4da6-9e94-905148294740 tempest-VolumesListAdminTestJSON-712967746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bc9be00-c5b8-492b-bb27-7c1efbd102a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e1f6abf1-b20d-4c88-9b45-222ebafecc66', 'volume_name': 'volume-e1f6abf1-b20d-4c88-9b45-222ebafecc66', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:37:44 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-ab7e5947-5463-4da6-9e94-905148294740 tempest-VolumesListAdminTestJSON-712967746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb5d7b39-4dc3-48a3-9fb2-141ca5b13fe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:37:44 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-ab7e5947-5463-4da6-9e94-905148294740 tempest-VolumesListAdminTestJSON-712967746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb5d7b39-4dc3-48a3-9fb2-141ca5b13fe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:37:45 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-ab7e5947-5463-4da6-9e94-905148294740 tempest-VolumesListAdminTestJSON-712967746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e071b68-ddbf-4057-9701-6215a1c7745e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:37:45 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-ab7e5947-5463-4da6-9e94-905148294740 tempest-VolumesListAdminTestJSON-712967746 None] Volume e1f6abf1-b20d-4c88-9b45-222ebafecc66: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e1f6abf1-b20d-4c88-9b45-222ebafecc66', 'volume_size': 1} Jun 29 03:37:45 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-ab7e5947-5463-4da6-9e94-905148294740 tempest-VolumesListAdminTestJSON-712967746 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:37:45 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-ab7e5947-5463-4da6-9e94-905148294740 tempest-VolumesListAdminTestJSON-712967746 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:37:45 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-ab7e5947-5463-4da6-9e94-905148294740 tempest-VolumesListAdminTestJSON-712967746 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:37:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-608983773',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1f6abf1-b20d-4c88-9b45-222ebafecc66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8cc264059f74815b28dcaff1f75bb06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:37:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:37:45Z,use_quota=True,user_id='5b8490ad1a954182b32c1707cfc34922',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:37:45 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-ab7e5947-5463-4da6-9e94-905148294740 tempest-VolumesListAdminTestJSON-712967746 None] Creating volume e1f6abf1-b20d-4c88-9b45-222ebafecc66 {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:37:45 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-ab7e5947-5463-4da6-9e94-905148294740 tempest-VolumesListAdminTestJSON-712967746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:37:45 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-ab7e5947-5463-4da6-9e94-905148294740 tempest-VolumesListAdminTestJSON-712967746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:37:45 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-ab7e5947-5463-4da6-9e94-905148294740 tempest-VolumesListAdminTestJSON-712967746 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:37:45 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-ab7e5947-5463-4da6-9e94-905148294740 tempest-VolumesListAdminTestJSON-712967746 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:37:45 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-ab7e5947-5463-4da6-9e94-905148294740 tempest-VolumesListAdminTestJSON-712967746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:37:45 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-ab7e5947-5463-4da6-9e94-905148294740 tempest-VolumesListAdminTestJSON-712967746 None] Selected osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:37:45 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-ab7e5947-5463-4da6-9e94-905148294740 tempest-VolumesListAdminTestJSON-712967746 None] casted to osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f Jun 29 03:37:45 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ab7e5947-5463-4da6-9e94-905148294740 tempest-VolumesListAdminTestJSON-712967746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-e1f6abf1-b20d-4c88-9b45-222ebafecc66 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:37:45 devstack sudo[110521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-e1f6abf1-b20d-4c88-9b45-222ebafecc66 1073741824 Jun 29 03:37:45 devstack sudo[110521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:37:45 devstack sudo[110521]: pam_unix(sudo:session): session closed for user root Jun 29 03:37:45 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ab7e5947-5463-4da6-9e94-905148294740 tempest-VolumesListAdminTestJSON-712967746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-e1f6abf1-b20d-4c88-9b45-222ebafecc66 1073741824" returned: 0 in 0.844s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:37:45 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ab7e5947-5463-4da6-9e94-905148294740 tempest-VolumesListAdminTestJSON-712967746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-e1f6abf1-b20d-4c88-9b45-222ebafecc66 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:37:45 devstack sudo[110529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-e1f6abf1-b20d-4c88-9b45-222ebafecc66 Jun 29 03:37:45 devstack sudo[110529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:37:46 devstack sudo[110529]: pam_unix(sudo:session): session closed for user root Jun 29 03:37:46 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ab7e5947-5463-4da6-9e94-905148294740 tempest-VolumesListAdminTestJSON-712967746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-e1f6abf1-b20d-4c88-9b45-222ebafecc66" returned: 0 in 0.636s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:37:46 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-ab7e5947-5463-4da6-9e94-905148294740 tempest-VolumesListAdminTestJSON-712967746 None] <== create_volume: return (1519ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:37:46 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-ab7e5947-5463-4da6-9e94-905148294740 tempest-VolumesListAdminTestJSON-712967746 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.521s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:37:46 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-ab7e5947-5463-4da6-9e94-905148294740 tempest-VolumesListAdminTestJSON-712967746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e071b68-ddbf-4057-9701-6215a1c7745e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1f6abf1-b20d-4c88-9b45-222ebafecc66', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:37:46 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-ab7e5947-5463-4da6-9e94-905148294740 tempest-VolumesListAdminTestJSON-712967746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bc72d3f-3dcd-4799-a78b-049b030f4203) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:37:46 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-ab7e5947-5463-4da6-9e94-905148294740 tempest-VolumesListAdminTestJSON-712967746 None] Volume volume-e1f6abf1-b20d-4c88-9b45-222ebafecc66 (e1f6abf1-b20d-4c88-9b45-222ebafecc66): created successfully Jun 29 03:37:46 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-ab7e5947-5463-4da6-9e94-905148294740 tempest-VolumesListAdminTestJSON-712967746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bc72d3f-3dcd-4799-a78b-049b030f4203) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:37:46 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-ab7e5947-5463-4da6-9e94-905148294740 tempest-VolumesListAdminTestJSON-712967746 None] Flow 'volume_create_manager' (2d1148aa-1a01-4ec1-b57b-af776e330655) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:37:46 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-ab7e5947-5463-4da6-9e94-905148294740 tempest-VolumesListAdminTestJSON-712967746 None] Created volume successfully. Jun 29 03:37:47 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d4678ae-7f9a-4245-982b-be3c1564f63e tempest-VolumesListAdminTestJSON-1618239401 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:37:47 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-4d4678ae-7f9a-4245-982b-be3c1564f63e tempest-VolumesListAdminTestJSON-1618239401 None] Flow 'volume_create_manager' (832a1a46-0e2d-43f4-8ecd-f02f0015396f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:37:47 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-4d4678ae-7f9a-4245-982b-be3c1564f63e tempest-VolumesListAdminTestJSON-1618239401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52603c0e-fc63-4f61-85ad-4d0199e7d69c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:37:47 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-4d4678ae-7f9a-4245-982b-be3c1564f63e tempest-VolumesListAdminTestJSON-1618239401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52603c0e-fc63-4f61-85ad-4d0199e7d69c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:37:47Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=093a9844-894e-4aff-8280-5b8518e581f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac7ce510d7374462b8a1d74056a6d5e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:37:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:37:47Z,use_quota=True,user_id='e690e9ccde7246838aba1c7255a0f089',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:37:47 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-4d4678ae-7f9a-4245-982b-be3c1564f63e tempest-VolumesListAdminTestJSON-1618239401 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3852a9ed-1efd-46a0-80ee-3d762d547b2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:37:47 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-4d4678ae-7f9a-4245-982b-be3c1564f63e tempest-VolumesListAdminTestJSON-1618239401 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3852a9ed-1efd-46a0-80ee-3d762d547b2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:37:47 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-4d4678ae-7f9a-4245-982b-be3c1564f63e tempest-VolumesListAdminTestJSON-1618239401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7535f8f3-749e-4f17-b97a-20fb579987cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:37:47 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-4d4678ae-7f9a-4245-982b-be3c1564f63e tempest-VolumesListAdminTestJSON-1618239401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7535f8f3-749e-4f17-b97a-20fb579987cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '093a9844-894e-4aff-8280-5b8518e581f2', 'volume_name': 'volume-093a9844-894e-4aff-8280-5b8518e581f2', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:37:47 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-4d4678ae-7f9a-4245-982b-be3c1564f63e tempest-VolumesListAdminTestJSON-1618239401 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7326fca-ed95-4c0f-a7c7-81cbc66e3811) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:37:47 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-4d4678ae-7f9a-4245-982b-be3c1564f63e tempest-VolumesListAdminTestJSON-1618239401 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7326fca-ed95-4c0f-a7c7-81cbc66e3811) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:37:47 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-4d4678ae-7f9a-4245-982b-be3c1564f63e tempest-VolumesListAdminTestJSON-1618239401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea63869e-e291-4be9-abee-714556ddba33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:37:47 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-4d4678ae-7f9a-4245-982b-be3c1564f63e tempest-VolumesListAdminTestJSON-1618239401 None] Volume 093a9844-894e-4aff-8280-5b8518e581f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-093a9844-894e-4aff-8280-5b8518e581f2', 'volume_size': 1} Jun 29 03:37:47 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-4d4678ae-7f9a-4245-982b-be3c1564f63e tempest-VolumesListAdminTestJSON-1618239401 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:37:47 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-4d4678ae-7f9a-4245-982b-be3c1564f63e tempest-VolumesListAdminTestJSON-1618239401 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:37:47 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-4d4678ae-7f9a-4245-982b-be3c1564f63e tempest-VolumesListAdminTestJSON-1618239401 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:37:47Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=093a9844-894e-4aff-8280-5b8518e581f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac7ce510d7374462b8a1d74056a6d5e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:37:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:37:47Z,use_quota=True,user_id='e690e9ccde7246838aba1c7255a0f089',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:37:47 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-4d4678ae-7f9a-4245-982b-be3c1564f63e tempest-VolumesListAdminTestJSON-1618239401 None] Creating volume 093a9844-894e-4aff-8280-5b8518e581f2 {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:37:47 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-4d4678ae-7f9a-4245-982b-be3c1564f63e tempest-VolumesListAdminTestJSON-1618239401 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:37:47 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-4d4678ae-7f9a-4245-982b-be3c1564f63e tempest-VolumesListAdminTestJSON-1618239401 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:37:47 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-4d4678ae-7f9a-4245-982b-be3c1564f63e tempest-VolumesListAdminTestJSON-1618239401 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:37:47 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-4d4678ae-7f9a-4245-982b-be3c1564f63e tempest-VolumesListAdminTestJSON-1618239401 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:37:47 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-4d4678ae-7f9a-4245-982b-be3c1564f63e tempest-VolumesListAdminTestJSON-1618239401 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:37:47 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-4d4678ae-7f9a-4245-982b-be3c1564f63e tempest-VolumesListAdminTestJSON-1618239401 None] Selected osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:37:47 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-4d4678ae-7f9a-4245-982b-be3c1564f63e tempest-VolumesListAdminTestJSON-1618239401 None] casted to osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f Jun 29 03:37:47 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-4d4678ae-7f9a-4245-982b-be3c1564f63e tempest-VolumesListAdminTestJSON-1618239401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-093a9844-894e-4aff-8280-5b8518e581f2 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:37:47 devstack sudo[110536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-093a9844-894e-4aff-8280-5b8518e581f2 1073741824 Jun 29 03:37:47 devstack sudo[110536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:37:48 devstack sudo[110536]: pam_unix(sudo:session): session closed for user root Jun 29 03:37:48 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-4d4678ae-7f9a-4245-982b-be3c1564f63e tempest-VolumesListAdminTestJSON-1618239401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-093a9844-894e-4aff-8280-5b8518e581f2 1073741824" returned: 0 in 0.833s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:37:48 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-4d4678ae-7f9a-4245-982b-be3c1564f63e tempest-VolumesListAdminTestJSON-1618239401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-093a9844-894e-4aff-8280-5b8518e581f2 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:37:48 devstack sudo[110545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-093a9844-894e-4aff-8280-5b8518e581f2 Jun 29 03:37:48 devstack sudo[110545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:37:49 devstack sudo[110545]: pam_unix(sudo:session): session closed for user root Jun 29 03:37:49 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-4d4678ae-7f9a-4245-982b-be3c1564f63e tempest-VolumesListAdminTestJSON-1618239401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-093a9844-894e-4aff-8280-5b8518e581f2" returned: 0 in 0.638s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:37:49 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-4d4678ae-7f9a-4245-982b-be3c1564f63e tempest-VolumesListAdminTestJSON-1618239401 None] <== create_volume: return (1510ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:37:49 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-4d4678ae-7f9a-4245-982b-be3c1564f63e tempest-VolumesListAdminTestJSON-1618239401 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.513s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:37:49 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-4d4678ae-7f9a-4245-982b-be3c1564f63e tempest-VolumesListAdminTestJSON-1618239401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea63869e-e291-4be9-abee-714556ddba33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-093a9844-894e-4aff-8280-5b8518e581f2', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:37:49 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-4d4678ae-7f9a-4245-982b-be3c1564f63e tempest-VolumesListAdminTestJSON-1618239401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82900ff3-050d-4083-92d8-636af6bfa97e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:37:49 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-4d4678ae-7f9a-4245-982b-be3c1564f63e tempest-VolumesListAdminTestJSON-1618239401 None] Volume volume-093a9844-894e-4aff-8280-5b8518e581f2 (093a9844-894e-4aff-8280-5b8518e581f2): created successfully Jun 29 03:37:49 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-4d4678ae-7f9a-4245-982b-be3c1564f63e tempest-VolumesListAdminTestJSON-1618239401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82900ff3-050d-4083-92d8-636af6bfa97e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:37:49 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-4d4678ae-7f9a-4245-982b-be3c1564f63e tempest-VolumesListAdminTestJSON-1618239401 None] Flow 'volume_create_manager' (832a1a46-0e2d-43f4-8ecd-f02f0015396f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:37:49 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-4d4678ae-7f9a-4245-982b-be3c1564f63e tempest-VolumesListAdminTestJSON-1618239401 None] Created volume successfully. Jun 29 03:37:49 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-7e5ef431-08ea-4780-b073-fe71fa682ac1 tempest-VolumesListAdminTestJSON-1618239401 None] Acquiring lock "cinder-093a9844-894e-4aff-8280-5b8518e581f2-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:37:49 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-7e5ef431-08ea-4780-b073-fe71fa682ac1 tempest-VolumesListAdminTestJSON-1618239401 None] Lock "cinder-093a9844-894e-4aff-8280-5b8518e581f2-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:37:49 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-7e5ef431-08ea-4780-b073-fe71fa682ac1 tempest-VolumesListAdminTestJSON-1618239401 None] Acquiring lock "cinder-quobyte-093a9844-894e-4aff-8280-5b8518e581f2" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:37:49 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-7e5ef431-08ea-4780-b073-fe71fa682ac1 tempest-VolumesListAdminTestJSON-1618239401 None] Lock "cinder-quobyte-093a9844-894e-4aff-8280-5b8518e581f2" acquired by "delete_volume" :: waited 0.012s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:37:49 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe46fbe0-1423-426d-90e5-bc7218f546c8]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:37:49 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-7e5ef431-08ea-4780-b073-fe71fa682ac1 tempest-VolumesListAdminTestJSON-1618239401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-093a9844-894e-4aff-8280-5b8518e581f2 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:37:49 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-6e8030d7-b50d-497f-aafa-97a2b63d7f4b tempest-VolumesListAdminTestJSON-712967746 None] Acquiring lock "cinder-e1f6abf1-b20d-4c88-9b45-222ebafecc66-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:37:49 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-6e8030d7-b50d-497f-aafa-97a2b63d7f4b tempest-VolumesListAdminTestJSON-712967746 None] Lock "cinder-e1f6abf1-b20d-4c88-9b45-222ebafecc66-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:37:49 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-6e8030d7-b50d-497f-aafa-97a2b63d7f4b tempest-VolumesListAdminTestJSON-712967746 None] Acquiring lock "cinder-quobyte-e1f6abf1-b20d-4c88-9b45-222ebafecc66" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:37:49 devstack sudo[110548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-093a9844-894e-4aff-8280-5b8518e581f2 Jun 29 03:37:49 devstack sudo[110548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:37:49 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-6e8030d7-b50d-497f-aafa-97a2b63d7f4b tempest-VolumesListAdminTestJSON-712967746 None] Lock "cinder-quobyte-e1f6abf1-b20d-4c88-9b45-222ebafecc66" acquired by "delete_volume" :: waited 0.018s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:37:49 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c7b4fb7-267d-49a9-b11f-1c30edc29fe7]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:37:49 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-6e8030d7-b50d-497f-aafa-97a2b63d7f4b tempest-VolumesListAdminTestJSON-712967746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-e1f6abf1-b20d-4c88-9b45-222ebafecc66 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:37:50 devstack sudo[110550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-e1f6abf1-b20d-4c88-9b45-222ebafecc66 Jun 29 03:37:50 devstack sudo[110550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:37:50 devstack sudo[110548]: pam_unix(sudo:session): session closed for user root Jun 29 03:37:50 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-7e5ef431-08ea-4780-b073-fe71fa682ac1 tempest-VolumesListAdminTestJSON-1618239401 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-093a9844-894e-4aff-8280-5b8518e581f2" returned: 0 in 0.836s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:37:50 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-7e5ef431-08ea-4780-b073-fe71fa682ac1 tempest-VolumesListAdminTestJSON-1618239401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-093a9844-894e-4aff-8280-5b8518e581f2 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:37:50 devstack sudo[110562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-093a9844-894e-4aff-8280-5b8518e581f2 Jun 29 03:37:50 devstack sudo[110562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:37:50 devstack sudo[110550]: pam_unix(sudo:session): session closed for user root Jun 29 03:37:50 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-6e8030d7-b50d-497f-aafa-97a2b63d7f4b tempest-VolumesListAdminTestJSON-712967746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-e1f6abf1-b20d-4c88-9b45-222ebafecc66" returned: 0 in 0.816s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:37:50 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-6e8030d7-b50d-497f-aafa-97a2b63d7f4b tempest-VolumesListAdminTestJSON-712967746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-e1f6abf1-b20d-4c88-9b45-222ebafecc66 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:37:50 devstack sudo[110568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-e1f6abf1-b20d-4c88-9b45-222ebafecc66 Jun 29 03:37:50 devstack sudo[110568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:37:50 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [req-e678efc0-8f8b-48f0-a78c-d58d303dbfbb req-770ca168-81b2-4b35-8987-262f1952fc94 tempest-TestStampPattern-670457191 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:37:50 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [req-e678efc0-8f8b-48f0-a78c-d58d303dbfbb req-770ca168-81b2-4b35-8987-262f1952fc94 tempest-TestStampPattern-670457191 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:37:50 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[68b469a0-bd09-4ee7-a7e3-b6ea67621fa7]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:37:50 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [req-e678efc0-8f8b-48f0-a78c-d58d303dbfbb req-770ca168-81b2-4b35-8987-262f1952fc94 tempest-TestStampPattern-670457191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-27bc308b-b543-4d10-a580-b570f71d8866 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:37:50 devstack sudo[110570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-27bc308b-b543-4d10-a580-b570f71d8866 Jun 29 03:37:50 devstack sudo[110570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:37:51 devstack sudo[110562]: pam_unix(sudo:session): session closed for user root Jun 29 03:37:51 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-7e5ef431-08ea-4780-b073-fe71fa682ac1 tempest-VolumesListAdminTestJSON-1618239401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-093a9844-894e-4aff-8280-5b8518e581f2" returned: 0 in 0.687s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:37:51 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-7e5ef431-08ea-4780-b073-fe71fa682ac1 tempest-VolumesListAdminTestJSON-1618239401 None] Lock "cinder-quobyte-093a9844-894e-4aff-8280-5b8518e581f2" released by "delete_volume" :: held 1.574s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:37:51 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-7e5ef431-08ea-4780-b073-fe71fa682ac1 tempest-VolumesListAdminTestJSON-1618239401 None] Created reservations ['e373c6f4-cd58-4bce-82d0-7d6864fb99a0', '2538e2b6-9dde-4391-99ad-1cac329aa932', '47afe921-3e8b-4b39-9961-528b8e18ac94', 'f98d28ff-f207-4aef-9725-6c18795d9e02'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:37:51 devstack sudo[110568]: pam_unix(sudo:session): session closed for user root Jun 29 03:37:51 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-6e8030d7-b50d-497f-aafa-97a2b63d7f4b tempest-VolumesListAdminTestJSON-712967746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-e1f6abf1-b20d-4c88-9b45-222ebafecc66" returned: 0 in 0.684s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:37:51 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-6e8030d7-b50d-497f-aafa-97a2b63d7f4b tempest-VolumesListAdminTestJSON-712967746 None] Lock "cinder-quobyte-e1f6abf1-b20d-4c88-9b45-222ebafecc66" released by "delete_volume" :: held 1.559s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:37:51 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-7e5ef431-08ea-4780-b073-fe71fa682ac1 tempest-VolumesListAdminTestJSON-1618239401 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:37:51 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-7e5ef431-08ea-4780-b073-fe71fa682ac1 tempest-VolumesListAdminTestJSON-1618239401 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:37:51 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-7e5ef431-08ea-4780-b073-fe71fa682ac1 tempest-VolumesListAdminTestJSON-1618239401 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:37:51 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-7e5ef431-08ea-4780-b073-fe71fa682ac1 tempest-VolumesListAdminTestJSON-1618239401 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:37:51 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-7e5ef431-08ea-4780-b073-fe71fa682ac1 tempest-VolumesListAdminTestJSON-1618239401 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:37:51 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-7e5ef431-08ea-4780-b073-fe71fa682ac1 tempest-VolumesListAdminTestJSON-1618239401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:37:51 devstack sudo[110575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf Jun 29 03:37:51 devstack sudo[110575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:37:51 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-6e8030d7-b50d-497f-aafa-97a2b63d7f4b tempest-VolumesListAdminTestJSON-712967746 None] Created reservations ['9c402bc0-7c26-4834-a93d-f3bcfeb4320c', '659de718-9997-4532-8bf3-d224e8588850', '2dd69b98-d3af-4186-a0af-676356ef1e65', 'da11769d-55e5-4b15-9cd8-b8b9b0b4de2d'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:37:51 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-6e8030d7-b50d-497f-aafa-97a2b63d7f4b tempest-VolumesListAdminTestJSON-712967746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:37:51 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-6e8030d7-b50d-497f-aafa-97a2b63d7f4b tempest-VolumesListAdminTestJSON-712967746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:37:51 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-6e8030d7-b50d-497f-aafa-97a2b63d7f4b tempest-VolumesListAdminTestJSON-712967746 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:37:51 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-6e8030d7-b50d-497f-aafa-97a2b63d7f4b tempest-VolumesListAdminTestJSON-712967746 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:37:51 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-6e8030d7-b50d-497f-aafa-97a2b63d7f4b tempest-VolumesListAdminTestJSON-712967746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:37:51 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-6e8030d7-b50d-497f-aafa-97a2b63d7f4b tempest-VolumesListAdminTestJSON-712967746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:37:51 devstack sudo[110579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf Jun 29 03:37:51 devstack sudo[110570]: pam_unix(sudo:session): session closed for user root Jun 29 03:37:51 devstack sudo[110579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:37:51 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [req-e678efc0-8f8b-48f0-a78c-d58d303dbfbb req-770ca168-81b2-4b35-8987-262f1952fc94 tempest-TestStampPattern-670457191 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-27bc308b-b543-4d10-a580-b570f71d8866" returned: 0 in 0.818s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:37:51 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [req-e678efc0-8f8b-48f0-a78c-d58d303dbfbb req-770ca168-81b2-4b35-8987-262f1952fc94 tempest-TestStampPattern-670457191 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.846s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:37:51 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [req-e678efc0-8f8b-48f0-a78c-d58d303dbfbb req-770ca168-81b2-4b35-8987-262f1952fc94 tempest-TestStampPattern-670457191 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f', 'name': 'volume-27bc308b-b543-4d10-a580-b570f71d8866', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3897f78b-8c96-4a09-aaaf-90a1c5316ce7', 'enforce_multipath': True} {{(pid=93468) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 29 03:37:51 devstack cinder-volume[93468]: INFO cinder.volume.manager [req-e678efc0-8f8b-48f0-a78c-d58d303dbfbb req-770ca168-81b2-4b35-8987-262f1952fc94 tempest-TestStampPattern-670457191 None] attachment_update completed successfully. Jun 29 03:37:52 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-85560103-059e-4ec0-91d6-5f2f4fdcbc2d tempest-VolumesListAdminTestJSON-712967746 None] Acquiring lock "cinder-08e4ce01-9f00-4878-8d94-015d01620579-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:37:52 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-85560103-059e-4ec0-91d6-5f2f4fdcbc2d tempest-VolumesListAdminTestJSON-712967746 None] Lock "cinder-08e4ce01-9f00-4878-8d94-015d01620579-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:37:52 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-85560103-059e-4ec0-91d6-5f2f4fdcbc2d tempest-VolumesListAdminTestJSON-712967746 None] Acquiring lock "cinder-quobyte-08e4ce01-9f00-4878-8d94-015d01620579" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:37:52 devstack sudo[110575]: pam_unix(sudo:session): session closed for user root Jun 29 03:37:52 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-7e5ef431-08ea-4780-b073-fe71fa682ac1 tempest-VolumesListAdminTestJSON-1618239401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf" returned: 0 in 0.766s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:37:52 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-7e5ef431-08ea-4780-b073-fe71fa682ac1 tempest-VolumesListAdminTestJSON-1618239401 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:37:52 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-85560103-059e-4ec0-91d6-5f2f4fdcbc2d tempest-VolumesListAdminTestJSON-712967746 None] Lock "cinder-quobyte-08e4ce01-9f00-4878-8d94-015d01620579" acquired by "delete_volume" :: waited 0.024s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:37:52 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-7e5ef431-08ea-4780-b073-fe71fa682ac1 tempest-VolumesListAdminTestJSON-1618239401 None] Deleted volume successfully. Jun 29 03:37:52 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa9c55d5-899a-40e3-96be-7162a5a8e76a]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:37:52 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-85560103-059e-4ec0-91d6-5f2f4fdcbc2d tempest-VolumesListAdminTestJSON-712967746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-08e4ce01-9f00-4878-8d94-015d01620579 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:37:52 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-7e5ef431-08ea-4780-b073-fe71fa682ac1 tempest-VolumesListAdminTestJSON-1618239401 None] Lock "cinder-093a9844-894e-4aff-8280-5b8518e581f2-delete_volume" released by "delete_volume" :: held 2.598s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:37:52 devstack sudo[110579]: pam_unix(sudo:session): session closed for user root Jun 29 03:37:52 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-6e8030d7-b50d-497f-aafa-97a2b63d7f4b tempest-VolumesListAdminTestJSON-712967746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf" returned: 0 in 0.719s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:37:52 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-6e8030d7-b50d-497f-aafa-97a2b63d7f4b tempest-VolumesListAdminTestJSON-712967746 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:37:52 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-6e8030d7-b50d-497f-aafa-97a2b63d7f4b tempest-VolumesListAdminTestJSON-712967746 None] Deleted volume successfully. Jun 29 03:37:52 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-6e8030d7-b50d-497f-aafa-97a2b63d7f4b tempest-VolumesListAdminTestJSON-712967746 None] Lock "cinder-e1f6abf1-b20d-4c88-9b45-222ebafecc66-delete_volume" released by "delete_volume" :: held 2.512s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:37:52 devstack sudo[110651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-08e4ce01-9f00-4878-8d94-015d01620579 Jun 29 03:37:52 devstack sudo[110651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:37:53 devstack sudo[110651]: pam_unix(sudo:session): session closed for user root Jun 29 03:37:53 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-85560103-059e-4ec0-91d6-5f2f4fdcbc2d tempest-VolumesListAdminTestJSON-712967746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-08e4ce01-9f00-4878-8d94-015d01620579" returned: 0 in 0.805s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:37:53 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-85560103-059e-4ec0-91d6-5f2f4fdcbc2d tempest-VolumesListAdminTestJSON-712967746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-08e4ce01-9f00-4878-8d94-015d01620579 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:37:53 devstack sudo[110974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-08e4ce01-9f00-4878-8d94-015d01620579 Jun 29 03:37:53 devstack sudo[110974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:37:53 devstack sudo[110974]: pam_unix(sudo:session): session closed for user root Jun 29 03:37:53 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-85560103-059e-4ec0-91d6-5f2f4fdcbc2d tempest-VolumesListAdminTestJSON-712967746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-08e4ce01-9f00-4878-8d94-015d01620579" returned: 0 in 0.652s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:37:53 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-85560103-059e-4ec0-91d6-5f2f4fdcbc2d tempest-VolumesListAdminTestJSON-712967746 None] Lock "cinder-quobyte-08e4ce01-9f00-4878-8d94-015d01620579" released by "delete_volume" :: held 1.505s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:37:53 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-85560103-059e-4ec0-91d6-5f2f4fdcbc2d tempest-VolumesListAdminTestJSON-712967746 None] Created reservations ['a4380c76-469d-422e-a43a-2c4dcab1b761', '2a1dfe93-66f0-4418-b556-717fd0046168', '76b03e39-ef5f-409e-b1af-5a5c3823db7a', '14549e95-30b5-4458-b8a1-8cb6d3d89b00'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:37:53 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-85560103-059e-4ec0-91d6-5f2f4fdcbc2d tempest-VolumesListAdminTestJSON-712967746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:37:53 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-85560103-059e-4ec0-91d6-5f2f4fdcbc2d tempest-VolumesListAdminTestJSON-712967746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:37:53 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-85560103-059e-4ec0-91d6-5f2f4fdcbc2d tempest-VolumesListAdminTestJSON-712967746 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:37:53 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-85560103-059e-4ec0-91d6-5f2f4fdcbc2d tempest-VolumesListAdminTestJSON-712967746 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:37:53 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-85560103-059e-4ec0-91d6-5f2f4fdcbc2d tempest-VolumesListAdminTestJSON-712967746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:37:53 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-85560103-059e-4ec0-91d6-5f2f4fdcbc2d tempest-VolumesListAdminTestJSON-712967746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:37:53 devstack sudo[110977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf Jun 29 03:37:53 devstack sudo[110977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:37:54 devstack sudo[110977]: pam_unix(sudo:session): session closed for user root Jun 29 03:37:54 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-85560103-059e-4ec0-91d6-5f2f4fdcbc2d tempest-VolumesListAdminTestJSON-712967746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf" returned: 0 in 0.634s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:37:54 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-85560103-059e-4ec0-91d6-5f2f4fdcbc2d tempest-VolumesListAdminTestJSON-712967746 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:37:54 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-85560103-059e-4ec0-91d6-5f2f4fdcbc2d tempest-VolumesListAdminTestJSON-712967746 None] Deleted volume successfully. Jun 29 03:37:54 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-85560103-059e-4ec0-91d6-5f2f4fdcbc2d tempest-VolumesListAdminTestJSON-712967746 None] Lock "cinder-08e4ce01-9f00-4878-8d94-015d01620579-delete_volume" released by "delete_volume" :: held 2.335s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:37:54 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-0408ae59-bfc5-4274-a951-04893fc520c0 tempest-VolumesListAdminTestJSON-712967746 None] Acquiring lock "cinder-6ac336ef-9f60-4ef7-8e41-5082dd108ad6-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:37:54 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-0408ae59-bfc5-4274-a951-04893fc520c0 tempest-VolumesListAdminTestJSON-712967746 None] Lock "cinder-6ac336ef-9f60-4ef7-8e41-5082dd108ad6-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:37:54 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-0408ae59-bfc5-4274-a951-04893fc520c0 tempest-VolumesListAdminTestJSON-712967746 None] Acquiring lock "cinder-quobyte-6ac336ef-9f60-4ef7-8e41-5082dd108ad6" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:37:54 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-0408ae59-bfc5-4274-a951-04893fc520c0 tempest-VolumesListAdminTestJSON-712967746 None] Lock "cinder-quobyte-6ac336ef-9f60-4ef7-8e41-5082dd108ad6" acquired by "delete_volume" :: waited 0.019s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:37:54 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[29e5573d-2d27-4246-bff3-374c4df3f365]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:37:54 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-0408ae59-bfc5-4274-a951-04893fc520c0 tempest-VolumesListAdminTestJSON-712967746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-6ac336ef-9f60-4ef7-8e41-5082dd108ad6 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:37:54 devstack sudo[110980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-6ac336ef-9f60-4ef7-8e41-5082dd108ad6 Jun 29 03:37:54 devstack sudo[110980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:37:55 devstack sudo[110980]: pam_unix(sudo:session): session closed for user root Jun 29 03:37:55 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-0408ae59-bfc5-4274-a951-04893fc520c0 tempest-VolumesListAdminTestJSON-712967746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-6ac336ef-9f60-4ef7-8e41-5082dd108ad6" returned: 0 in 0.766s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:37:55 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-0408ae59-bfc5-4274-a951-04893fc520c0 tempest-VolumesListAdminTestJSON-712967746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-6ac336ef-9f60-4ef7-8e41-5082dd108ad6 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:37:55 devstack sudo[110985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-6ac336ef-9f60-4ef7-8e41-5082dd108ad6 Jun 29 03:37:55 devstack sudo[110985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:37:56 devstack sudo[110985]: pam_unix(sudo:session): session closed for user root Jun 29 03:37:56 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-0408ae59-bfc5-4274-a951-04893fc520c0 tempest-VolumesListAdminTestJSON-712967746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-6ac336ef-9f60-4ef7-8e41-5082dd108ad6" returned: 0 in 0.674s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:37:56 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-0408ae59-bfc5-4274-a951-04893fc520c0 tempest-VolumesListAdminTestJSON-712967746 None] Lock "cinder-quobyte-6ac336ef-9f60-4ef7-8e41-5082dd108ad6" released by "delete_volume" :: held 1.479s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:37:56 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-0408ae59-bfc5-4274-a951-04893fc520c0 tempest-VolumesListAdminTestJSON-712967746 None] Created reservations ['2196478d-0011-419c-8b63-8210b98fbfd7', '6d0a726a-cc8f-4b3c-8ab7-381c87dd1a14', 'ebb56c9f-cff6-40ef-886b-68af0f3416da', 'e9f63792-ce74-445a-9ebd-22c232d6a77a'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:37:56 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-0408ae59-bfc5-4274-a951-04893fc520c0 tempest-VolumesListAdminTestJSON-712967746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:37:56 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-0408ae59-bfc5-4274-a951-04893fc520c0 tempest-VolumesListAdminTestJSON-712967746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:37:56 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-0408ae59-bfc5-4274-a951-04893fc520c0 tempest-VolumesListAdminTestJSON-712967746 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:37:56 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-0408ae59-bfc5-4274-a951-04893fc520c0 tempest-VolumesListAdminTestJSON-712967746 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:37:56 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-0408ae59-bfc5-4274-a951-04893fc520c0 tempest-VolumesListAdminTestJSON-712967746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:37:56 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-0408ae59-bfc5-4274-a951-04893fc520c0 tempest-VolumesListAdminTestJSON-712967746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:37:56 devstack sudo[110998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf Jun 29 03:37:56 devstack sudo[110998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:37:57 devstack sudo[110998]: pam_unix(sudo:session): session closed for user root Jun 29 03:37:57 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-0408ae59-bfc5-4274-a951-04893fc520c0 tempest-VolumesListAdminTestJSON-712967746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf" returned: 0 in 0.646s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:37:57 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-0408ae59-bfc5-4274-a951-04893fc520c0 tempest-VolumesListAdminTestJSON-712967746 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:37:57 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-0408ae59-bfc5-4274-a951-04893fc520c0 tempest-VolumesListAdminTestJSON-712967746 None] Deleted volume successfully. Jun 29 03:37:57 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-0408ae59-bfc5-4274-a951-04893fc520c0 tempest-VolumesListAdminTestJSON-712967746 None] Lock "cinder-6ac336ef-9f60-4ef7-8e41-5082dd108ad6-delete_volume" released by "delete_volume" :: held 2.335s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:38:00 devstack cinder-volume[93468]: INFO cinder.volume.manager [req-43adde5f-8e2c-4e80-a6d5-11691e1f414d req-0ae50775-3dbe-4bb7-8ad5-c301b1f70914 tempest-TestStampPattern-670457191 None] Terminate volume connection completed successfully. Jun 29 03:38:00 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [req-43adde5f-8e2c-4e80-a6d5-11691e1f414d req-0ae50775-3dbe-4bb7-8ad5-c301b1f70914 tempest-TestStampPattern-670457191 None] Deleting attachment 3897f78b-8c96-4a09-aaaf-90a1c5316ce7. {{(pid=93468) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 29 03:38:01 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-b963ea3b-f566-4b57-b7e3-2ce21928d003 tempest-VolumesMetadataTest-740787546 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:38:01 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-b963ea3b-f566-4b57-b7e3-2ce21928d003 tempest-VolumesMetadataTest-740787546 None] Flow 'volume_create_manager' (c2125cae-b7fc-4f1d-964e-8a365f084f92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:38:01 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-b963ea3b-f566-4b57-b7e3-2ce21928d003 tempest-VolumesMetadataTest-740787546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2c97f9d-c829-4b79-a3e4-0387a15260d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:38:01 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-b963ea3b-f566-4b57-b7e3-2ce21928d003 tempest-VolumesMetadataTest-740787546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2c97f9d-c829-4b79-a3e4-0387a15260d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:38:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1663154230',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4823b66-2c37-4535-8964-ba9cef3153df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6249980106c848cb84430b73954747d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:38:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:38:01Z,use_quota=True,user_id='c77ef20297374eae9712a3ea50391dce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:38:01 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-b963ea3b-f566-4b57-b7e3-2ce21928d003 tempest-VolumesMetadataTest-740787546 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51264346-268c-4d42-bd9c-8d8c6550c09f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:38:01 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-b963ea3b-f566-4b57-b7e3-2ce21928d003 tempest-VolumesMetadataTest-740787546 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51264346-268c-4d42-bd9c-8d8c6550c09f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:38:01 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-b963ea3b-f566-4b57-b7e3-2ce21928d003 tempest-VolumesMetadataTest-740787546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c7f5b2b-a1e2-4d2a-8cc0-46b3fb9ace3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:38:01 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-b963ea3b-f566-4b57-b7e3-2ce21928d003 tempest-VolumesMetadataTest-740787546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c7f5b2b-a1e2-4d2a-8cc0-46b3fb9ace3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd4823b66-2c37-4535-8964-ba9cef3153df', 'volume_name': 'volume-d4823b66-2c37-4535-8964-ba9cef3153df', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:38:01 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-b963ea3b-f566-4b57-b7e3-2ce21928d003 tempest-VolumesMetadataTest-740787546 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1329515-d10c-4af0-9206-3bf1ff30c437) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:38:01 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-b963ea3b-f566-4b57-b7e3-2ce21928d003 tempest-VolumesMetadataTest-740787546 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1329515-d10c-4af0-9206-3bf1ff30c437) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:38:01 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-b963ea3b-f566-4b57-b7e3-2ce21928d003 tempest-VolumesMetadataTest-740787546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04537c93-6efe-4d67-b089-23fb93073484) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:38:01 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-b963ea3b-f566-4b57-b7e3-2ce21928d003 tempest-VolumesMetadataTest-740787546 None] Volume d4823b66-2c37-4535-8964-ba9cef3153df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d4823b66-2c37-4535-8964-ba9cef3153df', 'volume_size': 1} Jun 29 03:38:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-b963ea3b-f566-4b57-b7e3-2ce21928d003 tempest-VolumesMetadataTest-740787546 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:38:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-b963ea3b-f566-4b57-b7e3-2ce21928d003 tempest-VolumesMetadataTest-740787546 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:38:01 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-b963ea3b-f566-4b57-b7e3-2ce21928d003 tempest-VolumesMetadataTest-740787546 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:38:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1663154230',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4823b66-2c37-4535-8964-ba9cef3153df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6249980106c848cb84430b73954747d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:38:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:38:01Z,use_quota=True,user_id='c77ef20297374eae9712a3ea50391dce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:38:01 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-b963ea3b-f566-4b57-b7e3-2ce21928d003 tempest-VolumesMetadataTest-740787546 None] Creating volume d4823b66-2c37-4535-8964-ba9cef3153df {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:38:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-b963ea3b-f566-4b57-b7e3-2ce21928d003 tempest-VolumesMetadataTest-740787546 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:38:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-b963ea3b-f566-4b57-b7e3-2ce21928d003 tempest-VolumesMetadataTest-740787546 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:38:01 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-b963ea3b-f566-4b57-b7e3-2ce21928d003 tempest-VolumesMetadataTest-740787546 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:38:01 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-b963ea3b-f566-4b57-b7e3-2ce21928d003 tempest-VolumesMetadataTest-740787546 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:38:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-b963ea3b-f566-4b57-b7e3-2ce21928d003 tempest-VolumesMetadataTest-740787546 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:38:01 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-b963ea3b-f566-4b57-b7e3-2ce21928d003 tempest-VolumesMetadataTest-740787546 None] Selected osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:38:01 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-b963ea3b-f566-4b57-b7e3-2ce21928d003 tempest-VolumesMetadataTest-740787546 None] casted to osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f Jun 29 03:38:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b963ea3b-f566-4b57-b7e3-2ce21928d003 tempest-VolumesMetadataTest-740787546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-d4823b66-2c37-4535-8964-ba9cef3153df 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:38:01 devstack sudo[111043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-d4823b66-2c37-4535-8964-ba9cef3153df 1073741824 Jun 29 03:38:01 devstack sudo[111043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:38:02 devstack sudo[111043]: pam_unix(sudo:session): session closed for user root Jun 29 03:38:02 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b963ea3b-f566-4b57-b7e3-2ce21928d003 tempest-VolumesMetadataTest-740787546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-d4823b66-2c37-4535-8964-ba9cef3153df 1073741824" returned: 0 in 0.850s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:38:02 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b963ea3b-f566-4b57-b7e3-2ce21928d003 tempest-VolumesMetadataTest-740787546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-d4823b66-2c37-4535-8964-ba9cef3153df {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:38:02 devstack sudo[111050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-d4823b66-2c37-4535-8964-ba9cef3153df Jun 29 03:38:02 devstack sudo[111050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:38:02 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-ce4cde28-9d6b-4499-984c-09c1be4b4302 tempest-TestStampPattern-670457191 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:38:02 devstack sudo[111050]: pam_unix(sudo:session): session closed for user root Jun 29 03:38:02 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b963ea3b-f566-4b57-b7e3-2ce21928d003 tempest-VolumesMetadataTest-740787546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-d4823b66-2c37-4535-8964-ba9cef3153df" returned: 0 in 0.662s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:38:02 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-b963ea3b-f566-4b57-b7e3-2ce21928d003 tempest-VolumesMetadataTest-740787546 None] <== create_volume: return (1559ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:38:02 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-b963ea3b-f566-4b57-b7e3-2ce21928d003 tempest-VolumesMetadataTest-740787546 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.561s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:38:02 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-ce4cde28-9d6b-4499-984c-09c1be4b4302 tempest-TestStampPattern-670457191 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.595s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:38:02 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-ce4cde28-9d6b-4499-984c-09c1be4b4302 tempest-TestStampPattern-670457191 None] Creating offline snapshot 065975ec-b392-48bc-88f2-5ec9a9d0e5bd of volume 27bc308b-b543-4d10-a580-b570f71d8866 {{(pid=93468) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 29 03:38:02 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-b963ea3b-f566-4b57-b7e3-2ce21928d003 tempest-VolumesMetadataTest-740787546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04537c93-6efe-4d67-b089-23fb93073484) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4823b66-2c37-4535-8964-ba9cef3153df', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:38:02 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-b963ea3b-f566-4b57-b7e3-2ce21928d003 tempest-VolumesMetadataTest-740787546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e2c8da7-c536-4413-9f8f-9489c0187bd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:38:02 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[722effff-f94d-4b48-9452-f50caf5d7688]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:38:02 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ce4cde28-9d6b-4499-984c-09c1be4b4302 tempest-TestStampPattern-670457191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-27bc308b-b543-4d10-a580-b570f71d8866 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:38:02 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-b963ea3b-f566-4b57-b7e3-2ce21928d003 tempest-VolumesMetadataTest-740787546 None] Volume volume-d4823b66-2c37-4535-8964-ba9cef3153df (d4823b66-2c37-4535-8964-ba9cef3153df): created successfully Jun 29 03:38:02 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-b963ea3b-f566-4b57-b7e3-2ce21928d003 tempest-VolumesMetadataTest-740787546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e2c8da7-c536-4413-9f8f-9489c0187bd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:38:02 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-b963ea3b-f566-4b57-b7e3-2ce21928d003 tempest-VolumesMetadataTest-740787546 None] Flow 'volume_create_manager' (c2125cae-b7fc-4f1d-964e-8a365f084f92) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:38:02 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-b963ea3b-f566-4b57-b7e3-2ce21928d003 tempest-VolumesMetadataTest-740787546 None] Created volume successfully. Jun 29 03:38:02 devstack sudo[111053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-27bc308b-b543-4d10-a580-b570f71d8866 Jun 29 03:38:02 devstack sudo[111053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:38:03 devstack sudo[111053]: pam_unix(sudo:session): session closed for user root Jun 29 03:38:03 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ce4cde28-9d6b-4499-984c-09c1be4b4302 tempest-TestStampPattern-670457191 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-27bc308b-b543-4d10-a580-b570f71d8866" returned: 0 in 0.765s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:38:03 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ce4cde28-9d6b-4499-984c-09c1be4b4302 tempest-TestStampPattern-670457191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-27bc308b-b543-4d10-a580-b570f71d8866,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-27bc308b-b543-4d10-a580-b570f71d8866.065975ec-b392-48bc-88f2-5ec9a9d0e5bd 1G {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:38:03 devstack sudo[111058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-27bc308b-b543-4d10-a580-b570f71d8866,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-27bc308b-b543-4d10-a580-b570f71d8866.065975ec-b392-48bc-88f2-5ec9a9d0e5bd 1G Jun 29 03:38:03 devstack sudo[111058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:38:03 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-0d66033c-ea3c-44d3-b50c-7b74166933bb tempest-VolumesMetadataTest-740787546 None] Acquiring lock "cinder-d4823b66-2c37-4535-8964-ba9cef3153df-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:38:03 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-0d66033c-ea3c-44d3-b50c-7b74166933bb tempest-VolumesMetadataTest-740787546 None] Lock "cinder-d4823b66-2c37-4535-8964-ba9cef3153df-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:38:03 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-0d66033c-ea3c-44d3-b50c-7b74166933bb tempest-VolumesMetadataTest-740787546 None] Acquiring lock "cinder-quobyte-d4823b66-2c37-4535-8964-ba9cef3153df" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:38:03 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-0d66033c-ea3c-44d3-b50c-7b74166933bb tempest-VolumesMetadataTest-740787546 None] Lock "cinder-quobyte-d4823b66-2c37-4535-8964-ba9cef3153df" acquired by "delete_volume" :: waited 0.018s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:38:03 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3535880-1fdb-4e2f-9a4b-b29fcaa188d3]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:38:03 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-0d66033c-ea3c-44d3-b50c-7b74166933bb tempest-VolumesMetadataTest-740787546 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-d4823b66-2c37-4535-8964-ba9cef3153df {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:38:03 devstack sudo[111060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-d4823b66-2c37-4535-8964-ba9cef3153df Jun 29 03:38:03 devstack sudo[111060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:38:04 devstack sudo[111058]: pam_unix(sudo:session): session closed for user root Jun 29 03:38:04 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ce4cde28-9d6b-4499-984c-09c1be4b4302 tempest-TestStampPattern-670457191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-27bc308b-b543-4d10-a580-b570f71d8866,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-27bc308b-b543-4d10-a580-b570f71d8866.065975ec-b392-48bc-88f2-5ec9a9d0e5bd 1G" returned: 0 in 0.843s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:38:04 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ce4cde28-9d6b-4499-984c-09c1be4b4302 tempest-TestStampPattern-670457191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-27bc308b-b543-4d10-a580-b570f71d8866 -F qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-27bc308b-b543-4d10-a580-b570f71d8866.065975ec-b392-48bc-88f2-5ec9a9d0e5bd {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:38:04 devstack sudo[111065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-27bc308b-b543-4d10-a580-b570f71d8866 -F qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-27bc308b-b543-4d10-a580-b570f71d8866.065975ec-b392-48bc-88f2-5ec9a9d0e5bd Jun 29 03:38:04 devstack sudo[111065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:38:04 devstack sudo[111060]: pam_unix(sudo:session): session closed for user root Jun 29 03:38:04 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-0d66033c-ea3c-44d3-b50c-7b74166933bb tempest-VolumesMetadataTest-740787546 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-d4823b66-2c37-4535-8964-ba9cef3153df" returned: 0 in 0.766s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:38:04 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-0d66033c-ea3c-44d3-b50c-7b74166933bb tempest-VolumesMetadataTest-740787546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-d4823b66-2c37-4535-8964-ba9cef3153df {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:38:04 devstack sudo[111070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-d4823b66-2c37-4535-8964-ba9cef3153df Jun 29 03:38:04 devstack sudo[111070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:38:05 devstack sudo[111065]: pam_unix(sudo:session): session closed for user root Jun 29 03:38:05 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ce4cde28-9d6b-4499-984c-09c1be4b4302 tempest-TestStampPattern-670457191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-27bc308b-b543-4d10-a580-b570f71d8866 -F qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-27bc308b-b543-4d10-a580-b570f71d8866.065975ec-b392-48bc-88f2-5ec9a9d0e5bd" returned: 0 in 0.699s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:38:05 devstack cinder-volume[93468]: WARNING cinder.volume.drivers.remotefs [None req-ce4cde28-9d6b-4499-984c-09c1be4b4302 tempest-TestStampPattern-670457191 None] /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-27bc308b-b543-4d10-a580-b570f71d8866.065975ec-b392-48bc-88f2-5ec9a9d0e5bd is being set with open permissions: ugo+rw Jun 29 03:38:05 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ce4cde28-9d6b-4499-984c-09c1be4b4302 tempest-TestStampPattern-670457191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-27bc308b-b543-4d10-a580-b570f71d8866.065975ec-b392-48bc-88f2-5ec9a9d0e5bd {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:38:05 devstack sudo[111075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-27bc308b-b543-4d10-a580-b570f71d8866.065975ec-b392-48bc-88f2-5ec9a9d0e5bd Jun 29 03:38:05 devstack sudo[111075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:38:05 devstack sudo[111070]: pam_unix(sudo:session): session closed for user root Jun 29 03:38:05 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-0d66033c-ea3c-44d3-b50c-7b74166933bb tempest-VolumesMetadataTest-740787546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-d4823b66-2c37-4535-8964-ba9cef3153df" returned: 0 in 0.686s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:38:05 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-0d66033c-ea3c-44d3-b50c-7b74166933bb tempest-VolumesMetadataTest-740787546 None] Lock "cinder-quobyte-d4823b66-2c37-4535-8964-ba9cef3153df" released by "delete_volume" :: held 1.495s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:38:05 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-0d66033c-ea3c-44d3-b50c-7b74166933bb tempest-VolumesMetadataTest-740787546 None] Created reservations ['2b873368-24e6-47ab-9e8e-816acf4d9317', 'aced9901-057c-4bcd-9af1-601a8653d00b', '893931f4-780a-4b62-bf8f-8c447d414023', '762a51c4-d3ed-45da-abe0-614063b9102d'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:38:05 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-0d66033c-ea3c-44d3-b50c-7b74166933bb tempest-VolumesMetadataTest-740787546 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:38:05 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-0d66033c-ea3c-44d3-b50c-7b74166933bb tempest-VolumesMetadataTest-740787546 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:38:05 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-0d66033c-ea3c-44d3-b50c-7b74166933bb tempest-VolumesMetadataTest-740787546 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:38:05 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-0d66033c-ea3c-44d3-b50c-7b74166933bb tempest-VolumesMetadataTest-740787546 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:38:05 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-0d66033c-ea3c-44d3-b50c-7b74166933bb tempest-VolumesMetadataTest-740787546 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:38:05 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-0d66033c-ea3c-44d3-b50c-7b74166933bb tempest-VolumesMetadataTest-740787546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:38:05 devstack sudo[111078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf Jun 29 03:38:05 devstack sudo[111078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:38:05 devstack sudo[111075]: pam_unix(sudo:session): session closed for user root Jun 29 03:38:05 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ce4cde28-9d6b-4499-984c-09c1be4b4302 tempest-TestStampPattern-670457191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-27bc308b-b543-4d10-a580-b570f71d8866.065975ec-b392-48bc-88f2-5ec9a9d0e5bd" returned: 0 in 0.644s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:38:05 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ce4cde28-9d6b-4499-984c-09c1be4b4302 tempest-TestStampPattern-670457191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-27bc308b-b543-4d10-a580-b570f71d8866.info {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:38:05 devstack sudo[111081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-27bc308b-b543-4d10-a580-b570f71d8866.info Jun 29 03:38:05 devstack sudo[111081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:38:06 devstack sudo[111078]: pam_unix(sudo:session): session closed for user root Jun 29 03:38:06 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-0d66033c-ea3c-44d3-b50c-7b74166933bb tempest-VolumesMetadataTest-740787546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf" returned: 0 in 0.657s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:38:06 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-0d66033c-ea3c-44d3-b50c-7b74166933bb tempest-VolumesMetadataTest-740787546 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:38:06 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-0d66033c-ea3c-44d3-b50c-7b74166933bb tempest-VolumesMetadataTest-740787546 None] Deleted volume successfully. Jun 29 03:38:06 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-0d66033c-ea3c-44d3-b50c-7b74166933bb tempest-VolumesMetadataTest-740787546 None] Lock "cinder-d4823b66-2c37-4535-8964-ba9cef3153df-delete_volume" released by "delete_volume" :: held 2.361s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:38:06 devstack sudo[111081]: pam_unix(sudo:session): session closed for user root Jun 29 03:38:06 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ce4cde28-9d6b-4499-984c-09c1be4b4302 tempest-TestStampPattern-670457191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-27bc308b-b543-4d10-a580-b570f71d8866.info" returned: 0 in 0.722s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:38:06 devstack cinder-volume[93468]: WARNING cinder.volume.drivers.remotefs [None req-ce4cde28-9d6b-4499-984c-09c1be4b4302 tempest-TestStampPattern-670457191 None] /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-27bc308b-b543-4d10-a580-b570f71d8866.info is being set with open permissions: ugo+rw Jun 29 03:38:06 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ce4cde28-9d6b-4499-984c-09c1be4b4302 tempest-TestStampPattern-670457191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-27bc308b-b543-4d10-a580-b570f71d8866.info {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:38:06 devstack sudo[111085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-27bc308b-b543-4d10-a580-b570f71d8866.info Jun 29 03:38:06 devstack sudo[111085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:38:07 devstack sudo[111085]: pam_unix(sudo:session): session closed for user root Jun 29 03:38:07 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ce4cde28-9d6b-4499-984c-09c1be4b4302 tempest-TestStampPattern-670457191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-27bc308b-b543-4d10-a580-b570f71d8866.info" returned: 0 in 0.720s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:38:07 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-ce4cde28-9d6b-4499-984c-09c1be4b4302 tempest-TestStampPattern-670457191 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.492s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:38:07 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-ce4cde28-9d6b-4499-984c-09c1be4b4302 tempest-TestStampPattern-670457191 None] Create snapshot completed successfully Jun 29 03:38:10 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-373a1630-4fb7-482a-9c96-b889bece0b9d tempest-VolumesTransfersV357Test-380237430 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:38:10 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-373a1630-4fb7-482a-9c96-b889bece0b9d tempest-VolumesTransfersV357Test-380237430 None] Flow 'volume_create_manager' (39d727d4-f894-4f79-acdd-2fdbaec8448b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:38:10 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-373a1630-4fb7-482a-9c96-b889bece0b9d tempest-VolumesTransfersV357Test-380237430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8279be93-eaa4-46bc-9e1b-cbe28085eeb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:38:10 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-373a1630-4fb7-482a-9c96-b889bece0b9d tempest-VolumesTransfersV357Test-380237430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8279be93-eaa4-46bc-9e1b-cbe28085eeb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:38:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1402289205',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=047ff515-3573-4070-92c0-1dfb8ccebafe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd36c746a9c24982895114353c08206b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:38:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:38:10Z,use_quota=True,user_id='539bf87fcd8440cfa9df3625116ffc9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:38:10 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-373a1630-4fb7-482a-9c96-b889bece0b9d tempest-VolumesTransfersV357Test-380237430 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (973c0beb-7761-4a96-8041-ee9f85f45c44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:38:10 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-373a1630-4fb7-482a-9c96-b889bece0b9d tempest-VolumesTransfersV357Test-380237430 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (973c0beb-7761-4a96-8041-ee9f85f45c44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:38:10 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-373a1630-4fb7-482a-9c96-b889bece0b9d tempest-VolumesTransfersV357Test-380237430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55283e8e-5a7a-4acb-8676-c30a78f86571) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:38:10 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-373a1630-4fb7-482a-9c96-b889bece0b9d tempest-VolumesTransfersV357Test-380237430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55283e8e-5a7a-4acb-8676-c30a78f86571) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '047ff515-3573-4070-92c0-1dfb8ccebafe', 'volume_name': 'volume-047ff515-3573-4070-92c0-1dfb8ccebafe', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:38:10 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-373a1630-4fb7-482a-9c96-b889bece0b9d tempest-VolumesTransfersV357Test-380237430 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (264a7985-17eb-4c38-b0a7-6b8883cbec39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:38:10 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-373a1630-4fb7-482a-9c96-b889bece0b9d tempest-VolumesTransfersV357Test-380237430 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (264a7985-17eb-4c38-b0a7-6b8883cbec39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:38:10 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-373a1630-4fb7-482a-9c96-b889bece0b9d tempest-VolumesTransfersV357Test-380237430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1d4324c-c9e8-4d60-819b-c2abbd52e342) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:38:10 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-373a1630-4fb7-482a-9c96-b889bece0b9d tempest-VolumesTransfersV357Test-380237430 None] Volume 047ff515-3573-4070-92c0-1dfb8ccebafe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-047ff515-3573-4070-92c0-1dfb8ccebafe', 'volume_size': 1} Jun 29 03:38:10 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-373a1630-4fb7-482a-9c96-b889bece0b9d tempest-VolumesTransfersV357Test-380237430 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:38:10 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-373a1630-4fb7-482a-9c96-b889bece0b9d tempest-VolumesTransfersV357Test-380237430 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:38:10 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-373a1630-4fb7-482a-9c96-b889bece0b9d tempest-VolumesTransfersV357Test-380237430 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:38:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1402289205',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=047ff515-3573-4070-92c0-1dfb8ccebafe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd36c746a9c24982895114353c08206b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:38:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:38:10Z,use_quota=True,user_id='539bf87fcd8440cfa9df3625116ffc9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:38:10 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-373a1630-4fb7-482a-9c96-b889bece0b9d tempest-VolumesTransfersV357Test-380237430 None] Creating volume 047ff515-3573-4070-92c0-1dfb8ccebafe {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:38:10 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-373a1630-4fb7-482a-9c96-b889bece0b9d tempest-VolumesTransfersV357Test-380237430 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:38:10 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-373a1630-4fb7-482a-9c96-b889bece0b9d tempest-VolumesTransfersV357Test-380237430 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:38:10 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-373a1630-4fb7-482a-9c96-b889bece0b9d tempest-VolumesTransfersV357Test-380237430 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:38:10 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-373a1630-4fb7-482a-9c96-b889bece0b9d tempest-VolumesTransfersV357Test-380237430 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:38:10 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-373a1630-4fb7-482a-9c96-b889bece0b9d tempest-VolumesTransfersV357Test-380237430 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:38:10 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-373a1630-4fb7-482a-9c96-b889bece0b9d tempest-VolumesTransfersV357Test-380237430 None] Selected osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:38:10 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-373a1630-4fb7-482a-9c96-b889bece0b9d tempest-VolumesTransfersV357Test-380237430 None] casted to osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f Jun 29 03:38:10 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-373a1630-4fb7-482a-9c96-b889bece0b9d tempest-VolumesTransfersV357Test-380237430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-047ff515-3573-4070-92c0-1dfb8ccebafe 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:38:10 devstack sudo[111088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-047ff515-3573-4070-92c0-1dfb8ccebafe 1073741824 Jun 29 03:38:10 devstack sudo[111088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:38:10 devstack sudo[111088]: pam_unix(sudo:session): session closed for user root Jun 29 03:38:10 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-373a1630-4fb7-482a-9c96-b889bece0b9d tempest-VolumesTransfersV357Test-380237430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-047ff515-3573-4070-92c0-1dfb8ccebafe 1073741824" returned: 0 in 0.815s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:38:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-373a1630-4fb7-482a-9c96-b889bece0b9d tempest-VolumesTransfersV357Test-380237430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-047ff515-3573-4070-92c0-1dfb8ccebafe {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:38:11 devstack sudo[111094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-047ff515-3573-4070-92c0-1dfb8ccebafe Jun 29 03:38:11 devstack sudo[111094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:38:11 devstack sudo[111094]: pam_unix(sudo:session): session closed for user root Jun 29 03:38:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-373a1630-4fb7-482a-9c96-b889bece0b9d tempest-VolumesTransfersV357Test-380237430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-047ff515-3573-4070-92c0-1dfb8ccebafe" returned: 0 in 0.646s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:38:11 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-373a1630-4fb7-482a-9c96-b889bece0b9d tempest-VolumesTransfersV357Test-380237430 None] <== create_volume: return (1502ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:38:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-373a1630-4fb7-482a-9c96-b889bece0b9d tempest-VolumesTransfersV357Test-380237430 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.505s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:38:11 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-373a1630-4fb7-482a-9c96-b889bece0b9d tempest-VolumesTransfersV357Test-380237430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1d4324c-c9e8-4d60-819b-c2abbd52e342) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-047ff515-3573-4070-92c0-1dfb8ccebafe', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:38:11 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-373a1630-4fb7-482a-9c96-b889bece0b9d tempest-VolumesTransfersV357Test-380237430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a7e1882-fce8-4dc0-9e40-3e4cb2d052b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:38:11 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-373a1630-4fb7-482a-9c96-b889bece0b9d tempest-VolumesTransfersV357Test-380237430 None] Volume volume-047ff515-3573-4070-92c0-1dfb8ccebafe (047ff515-3573-4070-92c0-1dfb8ccebafe): created successfully Jun 29 03:38:11 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-373a1630-4fb7-482a-9c96-b889bece0b9d tempest-VolumesTransfersV357Test-380237430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a7e1882-fce8-4dc0-9e40-3e4cb2d052b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:38:11 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-373a1630-4fb7-482a-9c96-b889bece0b9d tempest-VolumesTransfersV357Test-380237430 None] Flow 'volume_create_manager' (39d727d4-f894-4f79-acdd-2fdbaec8448b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:38:11 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-373a1630-4fb7-482a-9c96-b889bece0b9d tempest-VolumesTransfersV357Test-380237430 None] Created volume successfully. Jun 29 03:38:11 devstack cinder-volume[93468]: DEBUG oslo_service.periodic_task [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93468) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 29 03:38:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:38:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:38:11 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:38:11 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:38:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:38:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:38:11 devstack sudo[111116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf Jun 29 03:38:11 devstack sudo[111116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:38:12 devstack sudo[111116]: pam_unix(sudo:session): session closed for user root Jun 29 03:38:12 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf" returned: 0 in 0.701s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:38:12 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:38:12 devstack cinder-volume[93468]: DEBUG oslo_service.periodic_task [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Running periodic task VolumeManager._thread_info {{(pid=93468) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 29 03:38:12 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] thread count: 28 {{(pid=93468) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 29 03:38:12 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] thread info: [<_MainThread(MainThread, started 132331377287296)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93468) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 29 03:38:12 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-c710ab30-85fa-490e-9a75-4a7dcc9b46d6 tempest-VolumesTransfersV357Test-730147105 None] Transfer volume completed successfully. Jun 29 03:38:13 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-ca9d69cd-c7d3-4130-890c-fea3d9c29b8f tempest-VolumesTransfersV357Test-1653506971 None] Acquiring lock "cinder-047ff515-3573-4070-92c0-1dfb8ccebafe-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:38:13 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-ca9d69cd-c7d3-4130-890c-fea3d9c29b8f tempest-VolumesTransfersV357Test-1653506971 None] Lock "cinder-047ff515-3573-4070-92c0-1dfb8ccebafe-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:38:13 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-ca9d69cd-c7d3-4130-890c-fea3d9c29b8f tempest-VolumesTransfersV357Test-1653506971 None] Acquiring lock "cinder-quobyte-047ff515-3573-4070-92c0-1dfb8ccebafe" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:38:13 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-ca9d69cd-c7d3-4130-890c-fea3d9c29b8f tempest-VolumesTransfersV357Test-1653506971 None] Lock "cinder-quobyte-047ff515-3573-4070-92c0-1dfb8ccebafe" acquired by "delete_volume" :: waited 0.024s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:38:13 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[294ffe2d-5eea-4d80-98e6-bbd134b7ff5e]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:38:13 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ca9d69cd-c7d3-4130-890c-fea3d9c29b8f tempest-VolumesTransfersV357Test-1653506971 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-047ff515-3573-4070-92c0-1dfb8ccebafe {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:38:13 devstack sudo[111143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-047ff515-3573-4070-92c0-1dfb8ccebafe Jun 29 03:38:13 devstack sudo[111143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:38:14 devstack sudo[111143]: pam_unix(sudo:session): session closed for user root Jun 29 03:38:14 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ca9d69cd-c7d3-4130-890c-fea3d9c29b8f tempest-VolumesTransfersV357Test-1653506971 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-047ff515-3573-4070-92c0-1dfb8ccebafe" returned: 0 in 0.819s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:38:14 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ca9d69cd-c7d3-4130-890c-fea3d9c29b8f tempest-VolumesTransfersV357Test-1653506971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-047ff515-3573-4070-92c0-1dfb8ccebafe {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:38:14 devstack sudo[111153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-047ff515-3573-4070-92c0-1dfb8ccebafe Jun 29 03:38:14 devstack sudo[111153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:38:15 devstack sudo[111153]: pam_unix(sudo:session): session closed for user root Jun 29 03:38:15 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ca9d69cd-c7d3-4130-890c-fea3d9c29b8f tempest-VolumesTransfersV357Test-1653506971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-047ff515-3573-4070-92c0-1dfb8ccebafe" returned: 0 in 0.651s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:38:15 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-ca9d69cd-c7d3-4130-890c-fea3d9c29b8f tempest-VolumesTransfersV357Test-1653506971 None] Lock "cinder-quobyte-047ff515-3573-4070-92c0-1dfb8ccebafe" released by "delete_volume" :: held 1.516s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:38:15 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-ca9d69cd-c7d3-4130-890c-fea3d9c29b8f tempest-VolumesTransfersV357Test-1653506971 None] Created reservations ['95104fcd-61d0-4192-981a-e7b3729ca9c8', '56d33c51-2e5f-4f16-b8f9-4ef76af2ca19', 'a7d3542c-1913-4575-93cd-0ceb662ebd2d', '77c74ca3-8723-4169-a6e8-86d9418a7399'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:38:15 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-ca9d69cd-c7d3-4130-890c-fea3d9c29b8f tempest-VolumesTransfersV357Test-1653506971 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:38:15 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-ca9d69cd-c7d3-4130-890c-fea3d9c29b8f tempest-VolumesTransfersV357Test-1653506971 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:38:15 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-ca9d69cd-c7d3-4130-890c-fea3d9c29b8f tempest-VolumesTransfersV357Test-1653506971 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:38:15 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-ca9d69cd-c7d3-4130-890c-fea3d9c29b8f tempest-VolumesTransfersV357Test-1653506971 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:38:15 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-ca9d69cd-c7d3-4130-890c-fea3d9c29b8f tempest-VolumesTransfersV357Test-1653506971 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:38:15 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ca9d69cd-c7d3-4130-890c-fea3d9c29b8f tempest-VolumesTransfersV357Test-1653506971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:38:15 devstack sudo[111156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf Jun 29 03:38:15 devstack sudo[111156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:38:16 devstack sudo[111156]: pam_unix(sudo:session): session closed for user root Jun 29 03:38:16 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ca9d69cd-c7d3-4130-890c-fea3d9c29b8f tempest-VolumesTransfersV357Test-1653506971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf" returned: 0 in 0.707s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:38:16 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-ca9d69cd-c7d3-4130-890c-fea3d9c29b8f tempest-VolumesTransfersV357Test-1653506971 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:38:16 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-ca9d69cd-c7d3-4130-890c-fea3d9c29b8f tempest-VolumesTransfersV357Test-1653506971 None] Deleted volume successfully. Jun 29 03:38:16 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-ca9d69cd-c7d3-4130-890c-fea3d9c29b8f tempest-VolumesTransfersV357Test-1653506971 None] Lock "cinder-047ff515-3573-4070-92c0-1dfb8ccebafe-delete_volume" released by "delete_volume" :: held 2.468s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:38:16 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-95f5ee88-2a36-45c2-b457-6939fd701527 tempest-VolumesTransfersV357Test-380237430 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:38:16 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-95f5ee88-2a36-45c2-b457-6939fd701527 tempest-VolumesTransfersV357Test-380237430 None] Flow 'volume_create_manager' (57ff8b13-d342-41c0-b136-ff4dc35621d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:38:16 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-95f5ee88-2a36-45c2-b457-6939fd701527 tempest-VolumesTransfersV357Test-380237430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a0ac1c5-07b1-4a00-93b5-b82982734367) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:38:16 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-95f5ee88-2a36-45c2-b457-6939fd701527 tempest-VolumesTransfersV357Test-380237430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a0ac1c5-07b1-4a00-93b5-b82982734367) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:38:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1416614909',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be1c4711-a954-44aa-9014-5221926d5967,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd36c746a9c24982895114353c08206b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:38:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:38:16Z,use_quota=True,user_id='539bf87fcd8440cfa9df3625116ffc9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:38:16 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-95f5ee88-2a36-45c2-b457-6939fd701527 tempest-VolumesTransfersV357Test-380237430 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3dd3502-7c44-4cda-a303-dccdfeca8be6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:38:16 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-95f5ee88-2a36-45c2-b457-6939fd701527 tempest-VolumesTransfersV357Test-380237430 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3dd3502-7c44-4cda-a303-dccdfeca8be6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:38:16 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-95f5ee88-2a36-45c2-b457-6939fd701527 tempest-VolumesTransfersV357Test-380237430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ed86145-551a-41f6-844a-e379d95be0f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:38:16 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-95f5ee88-2a36-45c2-b457-6939fd701527 tempest-VolumesTransfersV357Test-380237430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ed86145-551a-41f6-844a-e379d95be0f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be1c4711-a954-44aa-9014-5221926d5967', 'volume_name': 'volume-be1c4711-a954-44aa-9014-5221926d5967', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:38:16 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-95f5ee88-2a36-45c2-b457-6939fd701527 tempest-VolumesTransfersV357Test-380237430 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d82ce560-feae-4622-a6c3-2a6f1fb6f0f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:38:16 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-95f5ee88-2a36-45c2-b457-6939fd701527 tempest-VolumesTransfersV357Test-380237430 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d82ce560-feae-4622-a6c3-2a6f1fb6f0f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:38:16 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-95f5ee88-2a36-45c2-b457-6939fd701527 tempest-VolumesTransfersV357Test-380237430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79e100a9-c002-4a80-8fe2-bf6db44b4f66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:38:16 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-95f5ee88-2a36-45c2-b457-6939fd701527 tempest-VolumesTransfersV357Test-380237430 None] Volume be1c4711-a954-44aa-9014-5221926d5967: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be1c4711-a954-44aa-9014-5221926d5967', 'volume_size': 1} Jun 29 03:38:16 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-95f5ee88-2a36-45c2-b457-6939fd701527 tempest-VolumesTransfersV357Test-380237430 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:38:16 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-95f5ee88-2a36-45c2-b457-6939fd701527 tempest-VolumesTransfersV357Test-380237430 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:38:16 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-95f5ee88-2a36-45c2-b457-6939fd701527 tempest-VolumesTransfersV357Test-380237430 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:38:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1416614909',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be1c4711-a954-44aa-9014-5221926d5967,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd36c746a9c24982895114353c08206b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:38:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:38:16Z,use_quota=True,user_id='539bf87fcd8440cfa9df3625116ffc9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:38:16 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-95f5ee88-2a36-45c2-b457-6939fd701527 tempest-VolumesTransfersV357Test-380237430 None] Creating volume be1c4711-a954-44aa-9014-5221926d5967 {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:38:16 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-95f5ee88-2a36-45c2-b457-6939fd701527 tempest-VolumesTransfersV357Test-380237430 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:38:16 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-95f5ee88-2a36-45c2-b457-6939fd701527 tempest-VolumesTransfersV357Test-380237430 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:38:16 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-95f5ee88-2a36-45c2-b457-6939fd701527 tempest-VolumesTransfersV357Test-380237430 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:38:16 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-95f5ee88-2a36-45c2-b457-6939fd701527 tempest-VolumesTransfersV357Test-380237430 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:38:16 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-95f5ee88-2a36-45c2-b457-6939fd701527 tempest-VolumesTransfersV357Test-380237430 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:38:16 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-95f5ee88-2a36-45c2-b457-6939fd701527 tempest-VolumesTransfersV357Test-380237430 None] Selected osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:38:16 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-95f5ee88-2a36-45c2-b457-6939fd701527 tempest-VolumesTransfersV357Test-380237430 None] casted to osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f Jun 29 03:38:16 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-95f5ee88-2a36-45c2-b457-6939fd701527 tempest-VolumesTransfersV357Test-380237430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-be1c4711-a954-44aa-9014-5221926d5967 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:38:16 devstack sudo[111161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-be1c4711-a954-44aa-9014-5221926d5967 1073741824 Jun 29 03:38:16 devstack sudo[111161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:38:17 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8c0ed6b-4c2d-49fe-92d5-359ddddad94c tempest-TestStampPattern-670457191 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:38:17 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-b8c0ed6b-4c2d-49fe-92d5-359ddddad94c tempest-TestStampPattern-670457191 None] Flow 'volume_create_manager' (a83cbea8-b5a3-4de7-a31a-0666526b8741) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:38:17 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-b8c0ed6b-4c2d-49fe-92d5-359ddddad94c tempest-TestStampPattern-670457191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b932a3a-0518-43dd-9592-ae3a67a8426f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:38:17 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-b8c0ed6b-4c2d-49fe-92d5-359ddddad94c tempest-TestStampPattern-670457191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b932a3a-0518-43dd-9592-ae3a67a8426f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:38:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-889422905',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=761d49fb-954c-4601-bcb1-74dfb0935794,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34f0cf688f5c4bd186883e488d8efed3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:38:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=065975ec-b392-48bc-88f2-5ec9a9d0e5bd,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:38:17Z,use_quota=True,user_id='2d01311273684c5dbec9dc9f2c877f9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:38:17 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-b8c0ed6b-4c2d-49fe-92d5-359ddddad94c tempest-TestStampPattern-670457191 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (783aa661-a1dc-469e-91bf-a2e5dcf78da5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:38:17 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-b8c0ed6b-4c2d-49fe-92d5-359ddddad94c tempest-TestStampPattern-670457191 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (783aa661-a1dc-469e-91bf-a2e5dcf78da5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:38:17 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-b8c0ed6b-4c2d-49fe-92d5-359ddddad94c tempest-TestStampPattern-670457191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a186dceb-f551-49b6-8b8c-318c6e5de176) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:38:17 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-b8c0ed6b-4c2d-49fe-92d5-359ddddad94c tempest-TestStampPattern-670457191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a186dceb-f551-49b6-8b8c-318c6e5de176) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '761d49fb-954c-4601-bcb1-74dfb0935794', 'volume_name': 'volume-761d49fb-954c-4601-bcb1-74dfb0935794', 'volume_size': 1, 'snapshot_id': '065975ec-b392-48bc-88f2-5ec9a9d0e5bd'}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:38:17 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-b8c0ed6b-4c2d-49fe-92d5-359ddddad94c tempest-TestStampPattern-670457191 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc1bfb4c-436a-4a9b-b518-0b258e0d70cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:38:17 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-b8c0ed6b-4c2d-49fe-92d5-359ddddad94c tempest-TestStampPattern-670457191 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc1bfb4c-436a-4a9b-b518-0b258e0d70cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:38:17 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-b8c0ed6b-4c2d-49fe-92d5-359ddddad94c tempest-TestStampPattern-670457191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fba2f9d-124b-4651-b6ed-625a22a41e04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:38:17 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-b8c0ed6b-4c2d-49fe-92d5-359ddddad94c tempest-TestStampPattern-670457191 None] Volume 761d49fb-954c-4601-bcb1-74dfb0935794: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-761d49fb-954c-4601-bcb1-74dfb0935794', 'volume_size': 1, 'snapshot_id': '065975ec-b392-48bc-88f2-5ec9a9d0e5bd'} Jun 29 03:38:17 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-b8c0ed6b-4c2d-49fe-92d5-359ddddad94c tempest-TestStampPattern-670457191 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:38:17 devstack sudo[111161]: pam_unix(sudo:session): session closed for user root Jun 29 03:38:17 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-95f5ee88-2a36-45c2-b457-6939fd701527 tempest-VolumesTransfersV357Test-380237430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-be1c4711-a954-44aa-9014-5221926d5967 1073741824" returned: 0 in 0.893s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:38:17 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-95f5ee88-2a36-45c2-b457-6939fd701527 tempest-VolumesTransfersV357Test-380237430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-be1c4711-a954-44aa-9014-5221926d5967 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:38:17 devstack sudo[111167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-be1c4711-a954-44aa-9014-5221926d5967 Jun 29 03:38:17 devstack sudo[111167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:38:18 devstack sudo[111167]: pam_unix(sudo:session): session closed for user root Jun 29 03:38:18 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-95f5ee88-2a36-45c2-b457-6939fd701527 tempest-VolumesTransfersV357Test-380237430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-be1c4711-a954-44aa-9014-5221926d5967" returned: 0 in 0.667s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:38:18 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-95f5ee88-2a36-45c2-b457-6939fd701527 tempest-VolumesTransfersV357Test-380237430 None] <== create_volume: return (1619ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:38:18 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-95f5ee88-2a36-45c2-b457-6939fd701527 tempest-VolumesTransfersV357Test-380237430 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.622s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:38:18 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-b8c0ed6b-4c2d-49fe-92d5-359ddddad94c tempest-TestStampPattern-670457191 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.974s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:38:18 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-b8c0ed6b-4c2d-49fe-92d5-359ddddad94c tempest-TestStampPattern-670457191 None] Acquiring lock "cinder-quobyte-065975ec-b392-48bc-88f2-5ec9a9d0e5bd-761d49fb-954c-4601-bcb1-74dfb0935794" by "_create_volume_from_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:38:18 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-95f5ee88-2a36-45c2-b457-6939fd701527 tempest-VolumesTransfersV357Test-380237430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79e100a9-c002-4a80-8fe2-bf6db44b4f66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be1c4711-a954-44aa-9014-5221926d5967', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:38:18 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-95f5ee88-2a36-45c2-b457-6939fd701527 tempest-VolumesTransfersV357Test-380237430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95e14605-e450-4c07-8c94-45eaaa0e209d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:38:18 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-b8c0ed6b-4c2d-49fe-92d5-359ddddad94c tempest-TestStampPattern-670457191 None] Lock "cinder-quobyte-065975ec-b392-48bc-88f2-5ec9a9d0e5bd-761d49fb-954c-4601-bcb1-74dfb0935794" acquired by "_create_volume_from_snapshot" :: waited 0.029s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:38:18 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-b8c0ed6b-4c2d-49fe-92d5-359ddddad94c tempest-TestStampPattern-670457191 None] Creating volume 761d49fb-954c-4601-bcb1-74dfb0935794 from snapshot 065975ec-b392-48bc-88f2-5ec9a9d0e5bd {{(pid=93468) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 29 03:38:18 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-b8c0ed6b-4c2d-49fe-92d5-359ddddad94c tempest-TestStampPattern-670457191 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:38:18 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-b8c0ed6b-4c2d-49fe-92d5-359ddddad94c tempest-TestStampPattern-670457191 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:38:18 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-b8c0ed6b-4c2d-49fe-92d5-359ddddad94c tempest-TestStampPattern-670457191 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:38:18 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-b8c0ed6b-4c2d-49fe-92d5-359ddddad94c tempest-TestStampPattern-670457191 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:38:18 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-b8c0ed6b-4c2d-49fe-92d5-359ddddad94c tempest-TestStampPattern-670457191 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:38:18 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-b8c0ed6b-4c2d-49fe-92d5-359ddddad94c tempest-TestStampPattern-670457191 None] Selected osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:38:18 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-b8c0ed6b-4c2d-49fe-92d5-359ddddad94c tempest-TestStampPattern-670457191 None] Acquiring lock "cinder-quobyte-761d49fb-954c-4601-bcb1-74dfb0935794" by "_copy_volume_from_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:38:18 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-95f5ee88-2a36-45c2-b457-6939fd701527 tempest-VolumesTransfersV357Test-380237430 None] Volume volume-be1c4711-a954-44aa-9014-5221926d5967 (be1c4711-a954-44aa-9014-5221926d5967): created successfully Jun 29 03:38:18 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-95f5ee88-2a36-45c2-b457-6939fd701527 tempest-VolumesTransfersV357Test-380237430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95e14605-e450-4c07-8c94-45eaaa0e209d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:38:18 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-95f5ee88-2a36-45c2-b457-6939fd701527 tempest-VolumesTransfersV357Test-380237430 None] Flow 'volume_create_manager' (57ff8b13-d342-41c0-b136-ff4dc35621d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:38:18 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-b8c0ed6b-4c2d-49fe-92d5-359ddddad94c tempest-TestStampPattern-670457191 None] Lock "cinder-quobyte-761d49fb-954c-4601-bcb1-74dfb0935794" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:38:18 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-b8c0ed6b-4c2d-49fe-92d5-359ddddad94c tempest-TestStampPattern-670457191 None] snapshot: 065975ec-b392-48bc-88f2-5ec9a9d0e5bd, volume: 761d49fb-954c-4601-bcb1-74dfb0935794, {{(pid=93468) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 29 03:38:18 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-95f5ee88-2a36-45c2-b457-6939fd701527 tempest-VolumesTransfersV357Test-380237430 None] Created volume successfully. Jun 29 03:38:18 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-b8c0ed6b-4c2d-49fe-92d5-359ddddad94c tempest-TestStampPattern-670457191 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:38:18 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-b8c0ed6b-4c2d-49fe-92d5-359ddddad94c tempest-TestStampPattern-670457191 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:38:18 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-b8c0ed6b-4c2d-49fe-92d5-359ddddad94c tempest-TestStampPattern-670457191 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:38:18 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-b8c0ed6b-4c2d-49fe-92d5-359ddddad94c tempest-TestStampPattern-670457191 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:38:18 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-b8c0ed6b-4c2d-49fe-92d5-359ddddad94c tempest-TestStampPattern-670457191 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:38:18 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fbec071-fde8-454b-81f4-9fb3866c661c]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:38:18 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b8c0ed6b-4c2d-49fe-92d5-359ddddad94c tempest-TestStampPattern-670457191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-27bc308b-b543-4d10-a580-b570f71d8866.065975ec-b392-48bc-88f2-5ec9a9d0e5bd {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:38:18 devstack sudo[111173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-27bc308b-b543-4d10-a580-b570f71d8866.065975ec-b392-48bc-88f2-5ec9a9d0e5bd Jun 29 03:38:18 devstack sudo[111173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:38:18 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-9d236fae-c193-42c6-8349-03a75835c2bf tempest-VolumesTransfersV357Test-1653506971 None] Acquiring lock "cinder-be1c4711-a954-44aa-9014-5221926d5967-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:38:18 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-9d236fae-c193-42c6-8349-03a75835c2bf tempest-VolumesTransfersV357Test-1653506971 None] Lock "cinder-be1c4711-a954-44aa-9014-5221926d5967-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:38:18 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-9d236fae-c193-42c6-8349-03a75835c2bf tempest-VolumesTransfersV357Test-1653506971 None] Acquiring lock "cinder-quobyte-be1c4711-a954-44aa-9014-5221926d5967" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:38:18 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-9d236fae-c193-42c6-8349-03a75835c2bf tempest-VolumesTransfersV357Test-1653506971 None] Lock "cinder-quobyte-be1c4711-a954-44aa-9014-5221926d5967" acquired by "delete_volume" :: waited 0.015s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:38:19 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a9d2580-898c-4b7e-b312-082ae87e06cd]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:38:19 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-9d236fae-c193-42c6-8349-03a75835c2bf tempest-VolumesTransfersV357Test-1653506971 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-be1c4711-a954-44aa-9014-5221926d5967 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:38:19 devstack sudo[111175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-be1c4711-a954-44aa-9014-5221926d5967 Jun 29 03:38:19 devstack sudo[111175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:38:19 devstack sudo[111173]: pam_unix(sudo:session): session closed for user root Jun 29 03:38:19 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b8c0ed6b-4c2d-49fe-92d5-359ddddad94c tempest-TestStampPattern-670457191 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-27bc308b-b543-4d10-a580-b570f71d8866.065975ec-b392-48bc-88f2-5ec9a9d0e5bd" returned: 0 in 0.821s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:38:19 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-b8c0ed6b-4c2d-49fe-92d5-359ddddad94c tempest-TestStampPattern-670457191 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-27bc308b-b543-4d10-a580-b570f71d8866(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93468) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 29 03:38:19 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-b8c0ed6b-4c2d-49fe-92d5-359ddddad94c tempest-TestStampPattern-670457191 None] will copy from snapshot at /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-27bc308b-b543-4d10-a580-b570f71d8866 {{(pid=93468) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 29 03:38:19 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-b8c0ed6b-4c2d-49fe-92d5-359ddddad94c tempest-TestStampPattern-670457191 None] Creating direct copy from snapshot {{(pid=93468) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 29 03:38:19 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3ba2c2d-39da-47d7-964d-2b42cf364657]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:38:19 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b8c0ed6b-4c2d-49fe-92d5-359ddddad94c tempest-TestStampPattern-670457191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-27bc308b-b543-4d10-a580-b570f71d8866 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:38:19 devstack sudo[111181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-27bc308b-b543-4d10-a580-b570f71d8866 Jun 29 03:38:19 devstack sudo[111181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:38:19 devstack sudo[111175]: pam_unix(sudo:session): session closed for user root Jun 29 03:38:19 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-9d236fae-c193-42c6-8349-03a75835c2bf tempest-VolumesTransfersV357Test-1653506971 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-be1c4711-a954-44aa-9014-5221926d5967" returned: 0 in 0.768s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:38:19 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-9d236fae-c193-42c6-8349-03a75835c2bf tempest-VolumesTransfersV357Test-1653506971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-be1c4711-a954-44aa-9014-5221926d5967 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:38:19 devstack sudo[111186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-be1c4711-a954-44aa-9014-5221926d5967 Jun 29 03:38:19 devstack sudo[111186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:38:20 devstack sudo[111181]: pam_unix(sudo:session): session closed for user root Jun 29 03:38:20 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b8c0ed6b-4c2d-49fe-92d5-359ddddad94c tempest-TestStampPattern-670457191 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-27bc308b-b543-4d10-a580-b570f71d8866" returned: 0 in 0.795s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:38:20 devstack cinder-volume[93468]: DEBUG cinder.utils [None req-b8c0ed6b-4c2d-49fe-92d5-359ddddad94c tempest-TestStampPattern-670457191 None] Path /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-761d49fb-954c-4601-bcb1-74dfb0935794 not found in is_blk_device check {{(pid=93468) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 29 03:38:20 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b8c0ed6b-4c2d-49fe-92d5-359ddddad94c tempest-TestStampPattern-670457191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-27bc308b-b543-4d10-a580-b570f71d8866 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-761d49fb-954c-4601-bcb1-74dfb0935794 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:38:20 devstack sudo[111191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-27bc308b-b543-4d10-a580-b570f71d8866 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-761d49fb-954c-4601-bcb1-74dfb0935794 Jun 29 03:38:20 devstack sudo[111191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:38:20 devstack sudo[111186]: pam_unix(sudo:session): session closed for user root Jun 29 03:38:20 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-9d236fae-c193-42c6-8349-03a75835c2bf tempest-VolumesTransfersV357Test-1653506971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-be1c4711-a954-44aa-9014-5221926d5967" returned: 0 in 0.669s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:38:20 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-9d236fae-c193-42c6-8349-03a75835c2bf tempest-VolumesTransfersV357Test-1653506971 None] Lock "cinder-quobyte-be1c4711-a954-44aa-9014-5221926d5967" released by "delete_volume" :: held 1.481s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:38:20 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-9d236fae-c193-42c6-8349-03a75835c2bf tempest-VolumesTransfersV357Test-1653506971 None] Created reservations ['78cef376-28d1-4cad-b131-60c90f4ef125', '192327b2-9752-49c4-938e-2719d200e5e6', 'cbc75858-30cd-4e41-ba60-0d33fc100e04', '7dafa368-067a-45d8-9602-c03f7e50b66c'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:38:20 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-9d236fae-c193-42c6-8349-03a75835c2bf tempest-VolumesTransfersV357Test-1653506971 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:38:20 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-9d236fae-c193-42c6-8349-03a75835c2bf tempest-VolumesTransfersV357Test-1653506971 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:38:20 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-9d236fae-c193-42c6-8349-03a75835c2bf tempest-VolumesTransfersV357Test-1653506971 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:38:20 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-9d236fae-c193-42c6-8349-03a75835c2bf tempest-VolumesTransfersV357Test-1653506971 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:38:20 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-9d236fae-c193-42c6-8349-03a75835c2bf tempest-VolumesTransfersV357Test-1653506971 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:38:20 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-9d236fae-c193-42c6-8349-03a75835c2bf tempest-VolumesTransfersV357Test-1653506971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:38:20 devstack sudo[111197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf Jun 29 03:38:20 devstack sudo[111197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:38:22 devstack sudo[111197]: pam_unix(sudo:session): session closed for user root Jun 29 03:38:22 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-9d236fae-c193-42c6-8349-03a75835c2bf tempest-VolumesTransfersV357Test-1653506971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf" returned: 0 in 1.721s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:38:22 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-9d236fae-c193-42c6-8349-03a75835c2bf tempest-VolumesTransfersV357Test-1653506971 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:38:22 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-9d236fae-c193-42c6-8349-03a75835c2bf tempest-VolumesTransfersV357Test-1653506971 None] Deleted volume successfully. Jun 29 03:38:22 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-9d236fae-c193-42c6-8349-03a75835c2bf tempest-VolumesTransfersV357Test-1653506971 None] Lock "cinder-be1c4711-a954-44aa-9014-5221926d5967-delete_volume" released by "delete_volume" :: held 3.446s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:38:26 devstack sudo[111191]: pam_unix(sudo:session): session closed for user root Jun 29 03:38:26 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b8c0ed6b-4c2d-49fe-92d5-359ddddad94c tempest-TestStampPattern-670457191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-27bc308b-b543-4d10-a580-b570f71d8866 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-761d49fb-954c-4601-bcb1-74dfb0935794" returned: 0 in 6.639s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:38:26 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[727ea790-3328-438d-83ab-7be5cc95c5a7]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:38:26 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b8c0ed6b-4c2d-49fe-92d5-359ddddad94c tempest-TestStampPattern-670457191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-27bc308b-b543-4d10-a580-b570f71d8866 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:38:26 devstack sudo[111216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-27bc308b-b543-4d10-a580-b570f71d8866 Jun 29 03:38:26 devstack sudo[111216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:38:28 devstack sudo[111216]: pam_unix(sudo:session): session closed for user root Jun 29 03:38:28 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b8c0ed6b-4c2d-49fe-92d5-359ddddad94c tempest-TestStampPattern-670457191 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-27bc308b-b543-4d10-a580-b570f71d8866" returned: 0 in 1.491s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:38:28 devstack cinder-volume[93468]: DEBUG cinder.image.image_utils [None req-b8c0ed6b-4c2d-49fe-92d5-359ddddad94c tempest-TestStampPattern-670457191 None] Image conversion details: src /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-27bc308b-b543-4d10-a580-b570f71d8866, size 1024.00 MB, duration 6.64 sec, destination /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-761d49fb-954c-4601-bcb1-74dfb0935794 {{(pid=93468) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 29 03:38:28 devstack cinder-volume[93468]: INFO cinder.image.image_utils [None req-b8c0ed6b-4c2d-49fe-92d5-359ddddad94c tempest-TestStampPattern-670457191 None] Converted 1024.00 MB image at 154.22 MB/s Jun 29 03:38:28 devstack cinder-volume[93468]: WARNING cinder.volume.drivers.remotefs [None req-b8c0ed6b-4c2d-49fe-92d5-359ddddad94c tempest-TestStampPattern-670457191 None] /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-761d49fb-954c-4601-bcb1-74dfb0935794 is being set with open permissions: ugo+rw Jun 29 03:38:28 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b8c0ed6b-4c2d-49fe-92d5-359ddddad94c tempest-TestStampPattern-670457191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-761d49fb-954c-4601-bcb1-74dfb0935794 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:38:28 devstack sudo[111235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-761d49fb-954c-4601-bcb1-74dfb0935794 Jun 29 03:38:28 devstack sudo[111235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:38:28 devstack sudo[111235]: pam_unix(sudo:session): session closed for user root Jun 29 03:38:28 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b8c0ed6b-4c2d-49fe-92d5-359ddddad94c tempest-TestStampPattern-670457191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-761d49fb-954c-4601-bcb1-74dfb0935794" returned: 0 in 0.742s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:38:28 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-b8c0ed6b-4c2d-49fe-92d5-359ddddad94c tempest-TestStampPattern-670457191 None] Lock "cinder-quobyte-761d49fb-954c-4601-bcb1-74dfb0935794" released by "_copy_volume_from_snapshot" :: held 10.607s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:38:28 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-b8c0ed6b-4c2d-49fe-92d5-359ddddad94c tempest-TestStampPattern-670457191 None] Lock "cinder-quobyte-065975ec-b392-48bc-88f2-5ec9a9d0e5bd-761d49fb-954c-4601-bcb1-74dfb0935794" released by "_create_volume_from_snapshot" :: held 10.650s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:38:28 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-b8c0ed6b-4c2d-49fe-92d5-359ddddad94c tempest-TestStampPattern-670457191 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.680s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:38:28 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-b8c0ed6b-4c2d-49fe-92d5-359ddddad94c tempest-TestStampPattern-670457191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fba2f9d-124b-4651-b6ed-625a22a41e04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-761d49fb-954c-4601-bcb1-74dfb0935794', 'volume_size': 1, 'snapshot_id': '065975ec-b392-48bc-88f2-5ec9a9d0e5bd'}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:38:28 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-b8c0ed6b-4c2d-49fe-92d5-359ddddad94c tempest-TestStampPattern-670457191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c2c0aab-d24d-4514-add8-26b8001b751e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:38:29 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-b8c0ed6b-4c2d-49fe-92d5-359ddddad94c tempest-TestStampPattern-670457191 None] Volume volume-761d49fb-954c-4601-bcb1-74dfb0935794 (761d49fb-954c-4601-bcb1-74dfb0935794): created successfully Jun 29 03:38:29 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-b8c0ed6b-4c2d-49fe-92d5-359ddddad94c tempest-TestStampPattern-670457191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c2c0aab-d24d-4514-add8-26b8001b751e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:38:29 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-b8c0ed6b-4c2d-49fe-92d5-359ddddad94c tempest-TestStampPattern-670457191 None] Flow 'volume_create_manager' (a83cbea8-b5a3-4de7-a31a-0666526b8741) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:38:29 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-b8c0ed6b-4c2d-49fe-92d5-359ddddad94c tempest-TestStampPattern-670457191 None] Created volume successfully. Jun 29 03:38:33 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad01cf56-c4a5-4f3e-a99c-ff6391262274 tempest-VolumesNegativeTest-575644181 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:38:33 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-ad01cf56-c4a5-4f3e-a99c-ff6391262274 tempest-VolumesNegativeTest-575644181 None] Flow 'volume_create_manager' (b29a753a-0792-4e4a-9b9f-1c2ab4f0237c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:38:33 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-ad01cf56-c4a5-4f3e-a99c-ff6391262274 tempest-VolumesNegativeTest-575644181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d000e71a-3729-47a8-8803-104d210a86b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:38:33 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-ad01cf56-c4a5-4f3e-a99c-ff6391262274 tempest-VolumesNegativeTest-575644181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d000e71a-3729-47a8-8803-104d210a86b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:38:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-381625323',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c873281-f44a-4428-b758-445b67a9c0f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36284ee8aad246a6a70a89431431462f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:38:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:38:33Z,use_quota=True,user_id='3ba06485984947938673467a3fdb3559',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:38:33 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-ad01cf56-c4a5-4f3e-a99c-ff6391262274 tempest-VolumesNegativeTest-575644181 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f054649-201b-40a5-92ba-701c64b2482e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:38:33 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-ad01cf56-c4a5-4f3e-a99c-ff6391262274 tempest-VolumesNegativeTest-575644181 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f054649-201b-40a5-92ba-701c64b2482e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:38:33 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-ad01cf56-c4a5-4f3e-a99c-ff6391262274 tempest-VolumesNegativeTest-575644181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69af2242-e291-4020-9227-b3eb64c32f7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:38:33 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-ad01cf56-c4a5-4f3e-a99c-ff6391262274 tempest-VolumesNegativeTest-575644181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69af2242-e291-4020-9227-b3eb64c32f7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c873281-f44a-4428-b758-445b67a9c0f5', 'volume_name': 'volume-1c873281-f44a-4428-b758-445b67a9c0f5', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:38:33 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-ad01cf56-c4a5-4f3e-a99c-ff6391262274 tempest-VolumesNegativeTest-575644181 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (924976d6-5a73-4890-a77f-da36f7dc3e42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:38:33 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-ad01cf56-c4a5-4f3e-a99c-ff6391262274 tempest-VolumesNegativeTest-575644181 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (924976d6-5a73-4890-a77f-da36f7dc3e42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:38:33 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-ad01cf56-c4a5-4f3e-a99c-ff6391262274 tempest-VolumesNegativeTest-575644181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (031375fa-9ddd-4c5a-ba06-8936ae4ca53f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:38:33 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-ad01cf56-c4a5-4f3e-a99c-ff6391262274 tempest-VolumesNegativeTest-575644181 None] Volume 1c873281-f44a-4428-b758-445b67a9c0f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c873281-f44a-4428-b758-445b67a9c0f5', 'volume_size': 1} Jun 29 03:38:33 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-ad01cf56-c4a5-4f3e-a99c-ff6391262274 tempest-VolumesNegativeTest-575644181 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:38:33 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-ad01cf56-c4a5-4f3e-a99c-ff6391262274 tempest-VolumesNegativeTest-575644181 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:38:33 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-ad01cf56-c4a5-4f3e-a99c-ff6391262274 tempest-VolumesNegativeTest-575644181 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:38:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-381625323',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c873281-f44a-4428-b758-445b67a9c0f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36284ee8aad246a6a70a89431431462f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:38:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:38:33Z,use_quota=True,user_id='3ba06485984947938673467a3fdb3559',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:38:33 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-ad01cf56-c4a5-4f3e-a99c-ff6391262274 tempest-VolumesNegativeTest-575644181 None] Creating volume 1c873281-f44a-4428-b758-445b67a9c0f5 {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:38:33 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-ad01cf56-c4a5-4f3e-a99c-ff6391262274 tempest-VolumesNegativeTest-575644181 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:38:33 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-ad01cf56-c4a5-4f3e-a99c-ff6391262274 tempest-VolumesNegativeTest-575644181 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:38:33 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-ad01cf56-c4a5-4f3e-a99c-ff6391262274 tempest-VolumesNegativeTest-575644181 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:38:33 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-ad01cf56-c4a5-4f3e-a99c-ff6391262274 tempest-VolumesNegativeTest-575644181 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:38:33 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-ad01cf56-c4a5-4f3e-a99c-ff6391262274 tempest-VolumesNegativeTest-575644181 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:38:33 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-ad01cf56-c4a5-4f3e-a99c-ff6391262274 tempest-VolumesNegativeTest-575644181 None] Selected osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:38:33 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-ad01cf56-c4a5-4f3e-a99c-ff6391262274 tempest-VolumesNegativeTest-575644181 None] casted to osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f Jun 29 03:38:33 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ad01cf56-c4a5-4f3e-a99c-ff6391262274 tempest-VolumesNegativeTest-575644181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-1c873281-f44a-4428-b758-445b67a9c0f5 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:38:33 devstack sudo[111286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-1c873281-f44a-4428-b758-445b67a9c0f5 1073741824 Jun 29 03:38:33 devstack sudo[111286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:38:34 devstack sudo[111286]: pam_unix(sudo:session): session closed for user root Jun 29 03:38:34 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ad01cf56-c4a5-4f3e-a99c-ff6391262274 tempest-VolumesNegativeTest-575644181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-1c873281-f44a-4428-b758-445b67a9c0f5 1073741824" returned: 0 in 1.011s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:38:34 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ad01cf56-c4a5-4f3e-a99c-ff6391262274 tempest-VolumesNegativeTest-575644181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-1c873281-f44a-4428-b758-445b67a9c0f5 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:38:34 devstack sudo[111314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-1c873281-f44a-4428-b758-445b67a9c0f5 Jun 29 03:38:34 devstack sudo[111314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:38:34 devstack sudo[111314]: pam_unix(sudo:session): session closed for user root Jun 29 03:38:34 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ad01cf56-c4a5-4f3e-a99c-ff6391262274 tempest-VolumesNegativeTest-575644181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-1c873281-f44a-4428-b758-445b67a9c0f5" returned: 0 in 0.681s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:38:34 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-ad01cf56-c4a5-4f3e-a99c-ff6391262274 tempest-VolumesNegativeTest-575644181 None] <== create_volume: return (1733ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:38:34 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-ad01cf56-c4a5-4f3e-a99c-ff6391262274 tempest-VolumesNegativeTest-575644181 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.735s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:38:34 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-ad01cf56-c4a5-4f3e-a99c-ff6391262274 tempest-VolumesNegativeTest-575644181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (031375fa-9ddd-4c5a-ba06-8936ae4ca53f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c873281-f44a-4428-b758-445b67a9c0f5', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:38:34 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-ad01cf56-c4a5-4f3e-a99c-ff6391262274 tempest-VolumesNegativeTest-575644181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c321044c-c089-4046-bec8-4d76f785e114) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:38:34 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-ad01cf56-c4a5-4f3e-a99c-ff6391262274 tempest-VolumesNegativeTest-575644181 None] Volume volume-1c873281-f44a-4428-b758-445b67a9c0f5 (1c873281-f44a-4428-b758-445b67a9c0f5): created successfully Jun 29 03:38:34 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-ad01cf56-c4a5-4f3e-a99c-ff6391262274 tempest-VolumesNegativeTest-575644181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c321044c-c089-4046-bec8-4d76f785e114) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:38:35 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-ad01cf56-c4a5-4f3e-a99c-ff6391262274 tempest-VolumesNegativeTest-575644181 None] Flow 'volume_create_manager' (b29a753a-0792-4e4a-9b9f-1c2ab4f0237c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:38:35 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-ad01cf56-c4a5-4f3e-a99c-ff6391262274 tempest-VolumesNegativeTest-575644181 None] Created volume successfully. Jun 29 03:38:45 devstack cinder-volume[93468]: DEBUG dbcounter [-] [93468] Writing DB stats cinder:SELECT=65,cinder:UPDATE=86,cinder:DELETE=7,cinder:INSERT=16 {{(pid=93468) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 29 03:38:45 devstack cinder-volume[93468]: DEBUG dbcounter [-] [93468] Writing DB stats cinder:UPDATE=84,cinder:SELECT=63,cinder:INSERT=21,cinder:DELETE=10 {{(pid=93468) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 29 03:39:06 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-55011c8a-9c1d-426c-b7c7-ccd5d04446eb tempest-VolumesNegativeTest-575644181 None] Acquiring lock "cinder-1c873281-f44a-4428-b758-445b67a9c0f5-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:39:06 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-55011c8a-9c1d-426c-b7c7-ccd5d04446eb tempest-VolumesNegativeTest-575644181 None] Lock "cinder-1c873281-f44a-4428-b758-445b67a9c0f5-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:39:06 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-55011c8a-9c1d-426c-b7c7-ccd5d04446eb tempest-VolumesNegativeTest-575644181 None] Acquiring lock "cinder-quobyte-1c873281-f44a-4428-b758-445b67a9c0f5" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:39:06 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-55011c8a-9c1d-426c-b7c7-ccd5d04446eb tempest-VolumesNegativeTest-575644181 None] Lock "cinder-quobyte-1c873281-f44a-4428-b758-445b67a9c0f5" acquired by "delete_volume" :: waited 0.016s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:39:06 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b25c914-a4a2-485d-aa9d-b35fcf901724]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:39:06 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-55011c8a-9c1d-426c-b7c7-ccd5d04446eb tempest-VolumesNegativeTest-575644181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-1c873281-f44a-4428-b758-445b67a9c0f5 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:39:06 devstack sudo[111525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-1c873281-f44a-4428-b758-445b67a9c0f5 Jun 29 03:39:06 devstack sudo[111525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:39:07 devstack sudo[111525]: pam_unix(sudo:session): session closed for user root Jun 29 03:39:07 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-55011c8a-9c1d-426c-b7c7-ccd5d04446eb tempest-VolumesNegativeTest-575644181 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-1c873281-f44a-4428-b758-445b67a9c0f5" returned: 0 in 0.745s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:39:07 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-55011c8a-9c1d-426c-b7c7-ccd5d04446eb tempest-VolumesNegativeTest-575644181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-1c873281-f44a-4428-b758-445b67a9c0f5 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:39:07 devstack sudo[111530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-1c873281-f44a-4428-b758-445b67a9c0f5 Jun 29 03:39:07 devstack sudo[111530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:39:07 devstack sudo[111530]: pam_unix(sudo:session): session closed for user root Jun 29 03:39:07 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-55011c8a-9c1d-426c-b7c7-ccd5d04446eb tempest-VolumesNegativeTest-575644181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-1c873281-f44a-4428-b758-445b67a9c0f5" returned: 0 in 0.652s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:39:07 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-55011c8a-9c1d-426c-b7c7-ccd5d04446eb tempest-VolumesNegativeTest-575644181 None] Lock "cinder-quobyte-1c873281-f44a-4428-b758-445b67a9c0f5" released by "delete_volume" :: held 1.440s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:39:07 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-55011c8a-9c1d-426c-b7c7-ccd5d04446eb tempest-VolumesNegativeTest-575644181 None] Created reservations ['e49abe7a-2058-4532-8c6a-e518a1b28135', '3e8c69e8-965a-445f-9238-13a0ee8c1e57', '439e9084-0b1f-45e7-ba34-91525d286856', 'bcf88f01-9f63-4b12-9bd5-9a65e4b79679'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:39:07 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-55011c8a-9c1d-426c-b7c7-ccd5d04446eb tempest-VolumesNegativeTest-575644181 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:39:07 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-55011c8a-9c1d-426c-b7c7-ccd5d04446eb tempest-VolumesNegativeTest-575644181 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:39:07 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-55011c8a-9c1d-426c-b7c7-ccd5d04446eb tempest-VolumesNegativeTest-575644181 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:39:07 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-55011c8a-9c1d-426c-b7c7-ccd5d04446eb tempest-VolumesNegativeTest-575644181 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:39:07 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-55011c8a-9c1d-426c-b7c7-ccd5d04446eb tempest-VolumesNegativeTest-575644181 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:39:07 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-55011c8a-9c1d-426c-b7c7-ccd5d04446eb tempest-VolumesNegativeTest-575644181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:39:07 devstack sudo[111533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf Jun 29 03:39:07 devstack sudo[111533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:39:08 devstack sudo[111533]: pam_unix(sudo:session): session closed for user root Jun 29 03:39:08 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-55011c8a-9c1d-426c-b7c7-ccd5d04446eb tempest-VolumesNegativeTest-575644181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf" returned: 0 in 0.652s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:39:08 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-55011c8a-9c1d-426c-b7c7-ccd5d04446eb tempest-VolumesNegativeTest-575644181 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:39:08 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-55011c8a-9c1d-426c-b7c7-ccd5d04446eb tempest-VolumesNegativeTest-575644181 None] Deleted volume successfully. Jun 29 03:39:08 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-55011c8a-9c1d-426c-b7c7-ccd5d04446eb tempest-VolumesNegativeTest-575644181 None] Lock "cinder-1c873281-f44a-4428-b758-445b67a9c0f5-delete_volume" released by "delete_volume" :: held 2.287s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:39:11 devstack cinder-volume[93468]: DEBUG oslo_service.periodic_task [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93468) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 29 03:39:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:39:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:39:11 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:39:11 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:39:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:39:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:39:11 devstack sudo[111537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf Jun 29 03:39:11 devstack sudo[111537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:39:12 devstack sudo[111537]: pam_unix(sudo:session): session closed for user root Jun 29 03:39:12 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf" returned: 0 in 0.673s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:39:12 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:39:12 devstack cinder-volume[93468]: DEBUG oslo_service.periodic_task [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Running periodic task VolumeManager._thread_info {{(pid=93468) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 29 03:39:12 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] thread count: 28 {{(pid=93468) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 29 03:39:12 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] thread info: [<_MainThread(MainThread, started 132331377287296)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93468) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 29 03:39:17 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [req-782dbfdb-47bc-4788-86c3-234425f8722d req-dd85c3f4-000d-4284-b06c-2cc090233339 tempest-TestStampPattern-670457191 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:39:17 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [req-782dbfdb-47bc-4788-86c3-234425f8722d req-dd85c3f4-000d-4284-b06c-2cc090233339 tempest-TestStampPattern-670457191 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:39:17 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[75396ed8-0c52-4b36-bd91-f42ef351b1e2]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:39:17 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [req-782dbfdb-47bc-4788-86c3-234425f8722d req-dd85c3f4-000d-4284-b06c-2cc090233339 tempest-TestStampPattern-670457191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-761d49fb-954c-4601-bcb1-74dfb0935794 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:39:17 devstack sudo[111574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-761d49fb-954c-4601-bcb1-74dfb0935794 Jun 29 03:39:17 devstack sudo[111574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:39:18 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-35c27d94-9af0-484f-be75-8bf2165850f1 tempest-VolumesSnapshotTestJSON-1995063474 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:39:18 devstack sudo[111574]: pam_unix(sudo:session): session closed for user root Jun 29 03:39:18 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-35c27d94-9af0-484f-be75-8bf2165850f1 tempest-VolumesSnapshotTestJSON-1995063474 None] Flow 'volume_create_manager' (ec4819b1-6b37-4552-8eef-a787a1832a13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:39:18 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-35c27d94-9af0-484f-be75-8bf2165850f1 tempest-VolumesSnapshotTestJSON-1995063474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6f90660-16e6-4e3e-a5e7-7251db9c65e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:39:18 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [req-782dbfdb-47bc-4788-86c3-234425f8722d req-dd85c3f4-000d-4284-b06c-2cc090233339 tempest-TestStampPattern-670457191 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-761d49fb-954c-4601-bcb1-74dfb0935794" returned: 0 in 0.886s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:39:18 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [req-782dbfdb-47bc-4788-86c3-234425f8722d req-dd85c3f4-000d-4284-b06c-2cc090233339 tempest-TestStampPattern-670457191 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.911s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:39:18 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-35c27d94-9af0-484f-be75-8bf2165850f1 tempest-VolumesSnapshotTestJSON-1995063474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6f90660-16e6-4e3e-a5e7-7251db9c65e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:39:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1535570504',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9ee7e20-7480-465f-a536-6b9f78a265f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57e1750da8ab427786e9129ab400acb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:39:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:39:19Z,use_quota=True,user_id='87d6a117819e42218c0e3a501737fab7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:39:18 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-35c27d94-9af0-484f-be75-8bf2165850f1 tempest-VolumesSnapshotTestJSON-1995063474 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82c32478-9712-4212-ba22-41b8a3a4be5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:39:18 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-35c27d94-9af0-484f-be75-8bf2165850f1 tempest-VolumesSnapshotTestJSON-1995063474 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82c32478-9712-4212-ba22-41b8a3a4be5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:39:18 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-35c27d94-9af0-484f-be75-8bf2165850f1 tempest-VolumesSnapshotTestJSON-1995063474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29d4d96c-46da-4cee-9336-ce4a58043065) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:39:18 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-35c27d94-9af0-484f-be75-8bf2165850f1 tempest-VolumesSnapshotTestJSON-1995063474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29d4d96c-46da-4cee-9336-ce4a58043065) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f9ee7e20-7480-465f-a536-6b9f78a265f9', 'volume_name': 'volume-f9ee7e20-7480-465f-a536-6b9f78a265f9', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:39:18 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-35c27d94-9af0-484f-be75-8bf2165850f1 tempest-VolumesSnapshotTestJSON-1995063474 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac7b3a35-96e1-4c42-9171-35b5e4b4a42c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:39:18 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-35c27d94-9af0-484f-be75-8bf2165850f1 tempest-VolumesSnapshotTestJSON-1995063474 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac7b3a35-96e1-4c42-9171-35b5e4b4a42c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:39:18 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-35c27d94-9af0-484f-be75-8bf2165850f1 tempest-VolumesSnapshotTestJSON-1995063474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e18a24cd-507f-4ca0-96ae-4811389f9dd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:39:18 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-35c27d94-9af0-484f-be75-8bf2165850f1 tempest-VolumesSnapshotTestJSON-1995063474 None] Volume f9ee7e20-7480-465f-a536-6b9f78a265f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f9ee7e20-7480-465f-a536-6b9f78a265f9', 'volume_size': 1} Jun 29 03:39:18 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-35c27d94-9af0-484f-be75-8bf2165850f1 tempest-VolumesSnapshotTestJSON-1995063474 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:39:18 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-35c27d94-9af0-484f-be75-8bf2165850f1 tempest-VolumesSnapshotTestJSON-1995063474 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:39:18 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-35c27d94-9af0-484f-be75-8bf2165850f1 tempest-VolumesSnapshotTestJSON-1995063474 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:39:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1535570504',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9ee7e20-7480-465f-a536-6b9f78a265f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57e1750da8ab427786e9129ab400acb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:39:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:39:19Z,use_quota=True,user_id='87d6a117819e42218c0e3a501737fab7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:39:18 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-35c27d94-9af0-484f-be75-8bf2165850f1 tempest-VolumesSnapshotTestJSON-1995063474 None] Creating volume f9ee7e20-7480-465f-a536-6b9f78a265f9 {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:39:18 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-35c27d94-9af0-484f-be75-8bf2165850f1 tempest-VolumesSnapshotTestJSON-1995063474 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:39:18 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-35c27d94-9af0-484f-be75-8bf2165850f1 tempest-VolumesSnapshotTestJSON-1995063474 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:39:18 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-35c27d94-9af0-484f-be75-8bf2165850f1 tempest-VolumesSnapshotTestJSON-1995063474 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:39:18 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-35c27d94-9af0-484f-be75-8bf2165850f1 tempest-VolumesSnapshotTestJSON-1995063474 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:39:18 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-35c27d94-9af0-484f-be75-8bf2165850f1 tempest-VolumesSnapshotTestJSON-1995063474 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:39:18 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-35c27d94-9af0-484f-be75-8bf2165850f1 tempest-VolumesSnapshotTestJSON-1995063474 None] Selected osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:39:18 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-35c27d94-9af0-484f-be75-8bf2165850f1 tempest-VolumesSnapshotTestJSON-1995063474 None] casted to osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f Jun 29 03:39:18 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-35c27d94-9af0-484f-be75-8bf2165850f1 tempest-VolumesSnapshotTestJSON-1995063474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-f9ee7e20-7480-465f-a536-6b9f78a265f9 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:39:18 devstack sudo[111579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-f9ee7e20-7480-465f-a536-6b9f78a265f9 1073741824 Jun 29 03:39:18 devstack sudo[111579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:39:18 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [req-782dbfdb-47bc-4788-86c3-234425f8722d req-dd85c3f4-000d-4284-b06c-2cc090233339 tempest-TestStampPattern-670457191 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f', 'name': 'volume-761d49fb-954c-4601-bcb1-74dfb0935794', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8dd433a5-7d93-4d27-b0ef-d47a1090d617', 'enforce_multipath': True} {{(pid=93468) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 29 03:39:18 devstack cinder-volume[93468]: INFO cinder.volume.manager [req-782dbfdb-47bc-4788-86c3-234425f8722d req-dd85c3f4-000d-4284-b06c-2cc090233339 tempest-TestStampPattern-670457191 None] attachment_update completed successfully. Jun 29 03:39:19 devstack sudo[111579]: pam_unix(sudo:session): session closed for user root Jun 29 03:39:19 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-35c27d94-9af0-484f-be75-8bf2165850f1 tempest-VolumesSnapshotTestJSON-1995063474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-f9ee7e20-7480-465f-a536-6b9f78a265f9 1073741824" returned: 0 in 0.878s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:39:19 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-35c27d94-9af0-484f-be75-8bf2165850f1 tempest-VolumesSnapshotTestJSON-1995063474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-f9ee7e20-7480-465f-a536-6b9f78a265f9 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:39:19 devstack sudo[111651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-f9ee7e20-7480-465f-a536-6b9f78a265f9 Jun 29 03:39:19 devstack sudo[111651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:39:20 devstack sudo[111651]: pam_unix(sudo:session): session closed for user root Jun 29 03:39:20 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-35c27d94-9af0-484f-be75-8bf2165850f1 tempest-VolumesSnapshotTestJSON-1995063474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-f9ee7e20-7480-465f-a536-6b9f78a265f9" returned: 0 in 0.653s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:39:20 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-35c27d94-9af0-484f-be75-8bf2165850f1 tempest-VolumesSnapshotTestJSON-1995063474 None] <== create_volume: return (1571ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:39:20 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-35c27d94-9af0-484f-be75-8bf2165850f1 tempest-VolumesSnapshotTestJSON-1995063474 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.574s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:39:20 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-35c27d94-9af0-484f-be75-8bf2165850f1 tempest-VolumesSnapshotTestJSON-1995063474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e18a24cd-507f-4ca0-96ae-4811389f9dd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9ee7e20-7480-465f-a536-6b9f78a265f9', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:39:20 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-35c27d94-9af0-484f-be75-8bf2165850f1 tempest-VolumesSnapshotTestJSON-1995063474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (416d5545-f717-401b-b494-3f87283b8c4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:39:20 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-35c27d94-9af0-484f-be75-8bf2165850f1 tempest-VolumesSnapshotTestJSON-1995063474 None] Volume volume-f9ee7e20-7480-465f-a536-6b9f78a265f9 (f9ee7e20-7480-465f-a536-6b9f78a265f9): created successfully Jun 29 03:39:20 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-35c27d94-9af0-484f-be75-8bf2165850f1 tempest-VolumesSnapshotTestJSON-1995063474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (416d5545-f717-401b-b494-3f87283b8c4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:39:20 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-35c27d94-9af0-484f-be75-8bf2165850f1 tempest-VolumesSnapshotTestJSON-1995063474 None] Flow 'volume_create_manager' (ec4819b1-6b37-4552-8eef-a787a1832a13) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:39:20 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-35c27d94-9af0-484f-be75-8bf2165850f1 tempest-VolumesSnapshotTestJSON-1995063474 None] Created volume successfully. Jun 29 03:39:20 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-feff8923-96e0-4ae0-b03a-ee31b543f18c tempest-VolumesSnapshotTestJSON-1995063474 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:39:20 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-feff8923-96e0-4ae0-b03a-ee31b543f18c tempest-VolumesSnapshotTestJSON-1995063474 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:39:20 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-feff8923-96e0-4ae0-b03a-ee31b543f18c tempest-VolumesSnapshotTestJSON-1995063474 None] Creating offline snapshot 02f0401d-9c76-4c3c-9031-c92f5f3a0e64 of volume f9ee7e20-7480-465f-a536-6b9f78a265f9 {{(pid=93468) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 29 03:39:21 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bc9077a-8af3-4fa5-87d0-059ef60372bf]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:39:21 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-feff8923-96e0-4ae0-b03a-ee31b543f18c tempest-VolumesSnapshotTestJSON-1995063474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-f9ee7e20-7480-465f-a536-6b9f78a265f9 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:39:21 devstack sudo[111972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-f9ee7e20-7480-465f-a536-6b9f78a265f9 Jun 29 03:39:21 devstack sudo[111972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:39:21 devstack sudo[111972]: pam_unix(sudo:session): session closed for user root Jun 29 03:39:21 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-feff8923-96e0-4ae0-b03a-ee31b543f18c tempest-VolumesSnapshotTestJSON-1995063474 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-f9ee7e20-7480-465f-a536-6b9f78a265f9" returned: 0 in 0.759s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:39:21 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-feff8923-96e0-4ae0-b03a-ee31b543f18c tempest-VolumesSnapshotTestJSON-1995063474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-f9ee7e20-7480-465f-a536-6b9f78a265f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-f9ee7e20-7480-465f-a536-6b9f78a265f9.02f0401d-9c76-4c3c-9031-c92f5f3a0e64 1G {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:39:21 devstack sudo[111978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-f9ee7e20-7480-465f-a536-6b9f78a265f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-f9ee7e20-7480-465f-a536-6b9f78a265f9.02f0401d-9c76-4c3c-9031-c92f5f3a0e64 1G Jun 29 03:39:21 devstack sudo[111978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:39:22 devstack sudo[111978]: pam_unix(sudo:session): session closed for user root Jun 29 03:39:22 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-feff8923-96e0-4ae0-b03a-ee31b543f18c tempest-VolumesSnapshotTestJSON-1995063474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-f9ee7e20-7480-465f-a536-6b9f78a265f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-f9ee7e20-7480-465f-a536-6b9f78a265f9.02f0401d-9c76-4c3c-9031-c92f5f3a0e64 1G" returned: 0 in 0.794s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:39:22 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-feff8923-96e0-4ae0-b03a-ee31b543f18c tempest-VolumesSnapshotTestJSON-1995063474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f9ee7e20-7480-465f-a536-6b9f78a265f9 -F qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-f9ee7e20-7480-465f-a536-6b9f78a265f9.02f0401d-9c76-4c3c-9031-c92f5f3a0e64 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:39:22 devstack sudo[111984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f9ee7e20-7480-465f-a536-6b9f78a265f9 -F qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-f9ee7e20-7480-465f-a536-6b9f78a265f9.02f0401d-9c76-4c3c-9031-c92f5f3a0e64 Jun 29 03:39:22 devstack sudo[111984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:39:23 devstack sudo[111984]: pam_unix(sudo:session): session closed for user root Jun 29 03:39:23 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-feff8923-96e0-4ae0-b03a-ee31b543f18c tempest-VolumesSnapshotTestJSON-1995063474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f9ee7e20-7480-465f-a536-6b9f78a265f9 -F qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-f9ee7e20-7480-465f-a536-6b9f78a265f9.02f0401d-9c76-4c3c-9031-c92f5f3a0e64" returned: 0 in 0.689s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:39:23 devstack cinder-volume[93468]: WARNING cinder.volume.drivers.remotefs [None req-feff8923-96e0-4ae0-b03a-ee31b543f18c tempest-VolumesSnapshotTestJSON-1995063474 None] /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-f9ee7e20-7480-465f-a536-6b9f78a265f9.02f0401d-9c76-4c3c-9031-c92f5f3a0e64 is being set with open permissions: ugo+rw Jun 29 03:39:23 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-feff8923-96e0-4ae0-b03a-ee31b543f18c tempest-VolumesSnapshotTestJSON-1995063474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-f9ee7e20-7480-465f-a536-6b9f78a265f9.02f0401d-9c76-4c3c-9031-c92f5f3a0e64 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:39:23 devstack sudo[111989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-f9ee7e20-7480-465f-a536-6b9f78a265f9.02f0401d-9c76-4c3c-9031-c92f5f3a0e64 Jun 29 03:39:23 devstack sudo[111989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:39:23 devstack sudo[111989]: pam_unix(sudo:session): session closed for user root Jun 29 03:39:23 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-feff8923-96e0-4ae0-b03a-ee31b543f18c tempest-VolumesSnapshotTestJSON-1995063474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-f9ee7e20-7480-465f-a536-6b9f78a265f9.02f0401d-9c76-4c3c-9031-c92f5f3a0e64" returned: 0 in 0.664s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:39:23 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-feff8923-96e0-4ae0-b03a-ee31b543f18c tempest-VolumesSnapshotTestJSON-1995063474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-f9ee7e20-7480-465f-a536-6b9f78a265f9.info {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:39:23 devstack sudo[111994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-f9ee7e20-7480-465f-a536-6b9f78a265f9.info Jun 29 03:39:23 devstack sudo[111994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:39:24 devstack sudo[111994]: pam_unix(sudo:session): session closed for user root Jun 29 03:39:24 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-feff8923-96e0-4ae0-b03a-ee31b543f18c tempest-VolumesSnapshotTestJSON-1995063474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-f9ee7e20-7480-465f-a536-6b9f78a265f9.info" returned: 0 in 0.657s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:39:24 devstack cinder-volume[93468]: WARNING cinder.volume.drivers.remotefs [None req-feff8923-96e0-4ae0-b03a-ee31b543f18c tempest-VolumesSnapshotTestJSON-1995063474 None] /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-f9ee7e20-7480-465f-a536-6b9f78a265f9.info is being set with open permissions: ugo+rw Jun 29 03:39:24 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-feff8923-96e0-4ae0-b03a-ee31b543f18c tempest-VolumesSnapshotTestJSON-1995063474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-f9ee7e20-7480-465f-a536-6b9f78a265f9.info {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:39:24 devstack sudo[112011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-f9ee7e20-7480-465f-a536-6b9f78a265f9.info Jun 29 03:39:24 devstack sudo[112011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:39:25 devstack sudo[112011]: pam_unix(sudo:session): session closed for user root Jun 29 03:39:25 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-feff8923-96e0-4ae0-b03a-ee31b543f18c tempest-VolumesSnapshotTestJSON-1995063474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-f9ee7e20-7480-465f-a536-6b9f78a265f9.info" returned: 0 in 0.646s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:39:25 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-feff8923-96e0-4ae0-b03a-ee31b543f18c tempest-VolumesSnapshotTestJSON-1995063474 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.290s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:39:25 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-feff8923-96e0-4ae0-b03a-ee31b543f18c tempest-VolumesSnapshotTestJSON-1995063474 None] Create snapshot completed successfully Jun 29 03:39:26 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-1560fff3-0a9a-43ad-abdd-9dd608bb1beb tempest-VolumesSnapshotTestJSON-1995063474 None] Acquiring lock "cinder-02f0401d-9c76-4c3c-9031-c92f5f3a0e64-delete_snapshot" by "delete_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:39:26 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-1560fff3-0a9a-43ad-abdd-9dd608bb1beb tempest-VolumesSnapshotTestJSON-1995063474 None] Lock "cinder-02f0401d-9c76-4c3c-9031-c92f5f3a0e64-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:39:26 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-1560fff3-0a9a-43ad-abdd-9dd608bb1beb tempest-VolumesSnapshotTestJSON-1995063474 None] Acquiring lock "cinder-quobyte-f9ee7e20-7480-465f-a536-6b9f78a265f9" by "delete_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:39:26 devstack cinder-volume[93468]: INFO cinder.volume.manager [req-cf0ab513-f2c9-4bd3-938e-7a3b4987c8bf req-aea6a3fb-7bdd-4aca-8aa4-3fffbfd9c3ba tempest-TestStampPattern-670457191 None] Terminate volume connection completed successfully. Jun 29 03:39:26 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [req-cf0ab513-f2c9-4bd3-938e-7a3b4987c8bf req-aea6a3fb-7bdd-4aca-8aa4-3fffbfd9c3ba tempest-TestStampPattern-670457191 None] Deleting attachment 8dd433a5-7d93-4d27-b0ef-d47a1090d617. {{(pid=93468) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 29 03:39:26 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-1560fff3-0a9a-43ad-abdd-9dd608bb1beb tempest-VolumesSnapshotTestJSON-1995063474 None] Lock "cinder-quobyte-f9ee7e20-7480-465f-a536-6b9f78a265f9" acquired by "delete_snapshot" :: waited 0.022s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:39:26 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-1560fff3-0a9a-43ad-abdd-9dd608bb1beb tempest-VolumesSnapshotTestJSON-1995063474 None] Acquiring lock "cinder-quobyte-02f0401d-9c76-4c3c-9031-c92f5f3a0e64" by "_delete_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:39:26 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-1560fff3-0a9a-43ad-abdd-9dd608bb1beb tempest-VolumesSnapshotTestJSON-1995063474 None] Lock "cinder-quobyte-02f0401d-9c76-4c3c-9031-c92f5f3a0e64" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:39:26 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-1560fff3-0a9a-43ad-abdd-9dd608bb1beb tempest-VolumesSnapshotTestJSON-1995063474 None] Deleting offline snapshot 02f0401d-9c76-4c3c-9031-c92f5f3a0e64 of volume f9ee7e20-7480-465f-a536-6b9f78a265f9 {{(pid=93468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 29 03:39:26 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-1560fff3-0a9a-43ad-abdd-9dd608bb1beb tempest-VolumesSnapshotTestJSON-1995063474 None] snapshot_file for this snap is: volume-f9ee7e20-7480-465f-a536-6b9f78a265f9.02f0401d-9c76-4c3c-9031-c92f5f3a0e64 {{(pid=93468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 29 03:39:26 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[d71bd046-ffeb-44be-ac32-34d7a42095f2]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:39:26 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-1560fff3-0a9a-43ad-abdd-9dd608bb1beb tempest-VolumesSnapshotTestJSON-1995063474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-f9ee7e20-7480-465f-a536-6b9f78a265f9.02f0401d-9c76-4c3c-9031-c92f5f3a0e64 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:39:26 devstack sudo[112050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-f9ee7e20-7480-465f-a536-6b9f78a265f9.02f0401d-9c76-4c3c-9031-c92f5f3a0e64 Jun 29 03:39:26 devstack sudo[112050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:39:27 devstack sudo[112050]: pam_unix(sudo:session): session closed for user root Jun 29 03:39:27 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-1560fff3-0a9a-43ad-abdd-9dd608bb1beb tempest-VolumesSnapshotTestJSON-1995063474 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-f9ee7e20-7480-465f-a536-6b9f78a265f9.02f0401d-9c76-4c3c-9031-c92f5f3a0e64" returned: 0 in 0.774s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:39:27 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-1560fff3-0a9a-43ad-abdd-9dd608bb1beb tempest-VolumesSnapshotTestJSON-1995063474 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f9ee7e20-7480-465f-a536-6b9f78a265f9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93468) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 29 03:39:27 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[035accb0-a4b1-4a5b-ba2c-b2a72ba81eea]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:39:27 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-1560fff3-0a9a-43ad-abdd-9dd608bb1beb tempest-VolumesSnapshotTestJSON-1995063474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-f9ee7e20-7480-465f-a536-6b9f78a265f9 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:39:27 devstack sudo[112055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-f9ee7e20-7480-465f-a536-6b9f78a265f9 Jun 29 03:39:27 devstack sudo[112055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:39:28 devstack sudo[112055]: pam_unix(sudo:session): session closed for user root Jun 29 03:39:28 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-1560fff3-0a9a-43ad-abdd-9dd608bb1beb tempest-VolumesSnapshotTestJSON-1995063474 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-f9ee7e20-7480-465f-a536-6b9f78a265f9" returned: 0 in 0.772s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:39:28 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-1560fff3-0a9a-43ad-abdd-9dd608bb1beb tempest-VolumesSnapshotTestJSON-1995063474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-f9ee7e20-7480-465f-a536-6b9f78a265f9.02f0401d-9c76-4c3c-9031-c92f5f3a0e64 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:39:28 devstack sudo[112060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-f9ee7e20-7480-465f-a536-6b9f78a265f9.02f0401d-9c76-4c3c-9031-c92f5f3a0e64 Jun 29 03:39:28 devstack sudo[112060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:39:28 devstack sudo[112060]: pam_unix(sudo:session): session closed for user root Jun 29 03:39:28 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-1560fff3-0a9a-43ad-abdd-9dd608bb1beb tempest-VolumesSnapshotTestJSON-1995063474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-f9ee7e20-7480-465f-a536-6b9f78a265f9.02f0401d-9c76-4c3c-9031-c92f5f3a0e64" returned: 0 in 0.865s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:39:28 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-1560fff3-0a9a-43ad-abdd-9dd608bb1beb tempest-VolumesSnapshotTestJSON-1995063474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-f9ee7e20-7480-465f-a536-6b9f78a265f9.02f0401d-9c76-4c3c-9031-c92f5f3a0e64 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:39:28 devstack sudo[112068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-f9ee7e20-7480-465f-a536-6b9f78a265f9.02f0401d-9c76-4c3c-9031-c92f5f3a0e64 Jun 29 03:39:28 devstack sudo[112068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:39:29 devstack sudo[112068]: pam_unix(sudo:session): session closed for user root Jun 29 03:39:29 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-1560fff3-0a9a-43ad-abdd-9dd608bb1beb tempest-VolumesSnapshotTestJSON-1995063474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-f9ee7e20-7480-465f-a536-6b9f78a265f9.02f0401d-9c76-4c3c-9031-c92f5f3a0e64" returned: 0 in 0.708s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:39:29 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-1560fff3-0a9a-43ad-abdd-9dd608bb1beb tempest-VolumesSnapshotTestJSON-1995063474 None] Lock "cinder-quobyte-02f0401d-9c76-4c3c-9031-c92f5f3a0e64" released by "_delete_snapshot" :: held 3.223s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:39:29 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-1560fff3-0a9a-43ad-abdd-9dd608bb1beb tempest-VolumesSnapshotTestJSON-1995063474 None] Lock "cinder-quobyte-f9ee7e20-7480-465f-a536-6b9f78a265f9" released by "delete_snapshot" :: held 3.250s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:39:29 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-1560fff3-0a9a-43ad-abdd-9dd608bb1beb tempest-VolumesSnapshotTestJSON-1995063474 None] Created reservations ['5529f0f0-8616-4fb7-95c0-8e711552a236', 'f4ee5d35-f910-4f64-873e-e2a64aac91f8', '36f19f37-acab-494d-9190-053d25e4e837', '86280c66-7884-4d38-a60d-f34a983e53b6'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:39:29 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-1560fff3-0a9a-43ad-abdd-9dd608bb1beb tempest-VolumesSnapshotTestJSON-1995063474 None] Delete snapshot completed successfully. Jun 29 03:39:29 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-1560fff3-0a9a-43ad-abdd-9dd608bb1beb tempest-VolumesSnapshotTestJSON-1995063474 None] Lock "cinder-02f0401d-9c76-4c3c-9031-c92f5f3a0e64-delete_snapshot" released by "delete_snapshot" :: held 3.467s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:39:31 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-d934ff79-0f89-49b6-84e3-5be200c08ddc tempest-VolumesSnapshotTestJSON-1995063474 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:39:31 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-d934ff79-0f89-49b6-84e3-5be200c08ddc tempest-VolumesSnapshotTestJSON-1995063474 None] Flow 'volume_create_manager' (7d56173c-d536-45fa-8864-ea0b2b01d395) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:39:31 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-d934ff79-0f89-49b6-84e3-5be200c08ddc tempest-VolumesSnapshotTestJSON-1995063474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (125908d3-72da-41fb-8758-af4da793dbe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:39:31 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-d934ff79-0f89-49b6-84e3-5be200c08ddc tempest-VolumesSnapshotTestJSON-1995063474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (125908d3-72da-41fb-8758-af4da793dbe5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:39:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1544588668',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc97c015-a89b-4052-9843-9ae334917fbb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57e1750da8ab427786e9129ab400acb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:39:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:39:31Z,use_quota=True,user_id='87d6a117819e42218c0e3a501737fab7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:39:31 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-d934ff79-0f89-49b6-84e3-5be200c08ddc tempest-VolumesSnapshotTestJSON-1995063474 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4362cc6-1ce2-4e15-aeee-35f90418bec4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:39:31 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-d934ff79-0f89-49b6-84e3-5be200c08ddc tempest-VolumesSnapshotTestJSON-1995063474 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4362cc6-1ce2-4e15-aeee-35f90418bec4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:39:31 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-d934ff79-0f89-49b6-84e3-5be200c08ddc tempest-VolumesSnapshotTestJSON-1995063474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a01bb540-8882-4ec4-bde0-c9ba990146fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:39:31 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-d934ff79-0f89-49b6-84e3-5be200c08ddc tempest-VolumesSnapshotTestJSON-1995063474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a01bb540-8882-4ec4-bde0-c9ba990146fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc97c015-a89b-4052-9843-9ae334917fbb', 'volume_name': 'volume-bc97c015-a89b-4052-9843-9ae334917fbb', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:39:31 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-d934ff79-0f89-49b6-84e3-5be200c08ddc tempest-VolumesSnapshotTestJSON-1995063474 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00fc0c0c-55b3-45f1-a2b9-41cd6b394e76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:39:31 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-d934ff79-0f89-49b6-84e3-5be200c08ddc tempest-VolumesSnapshotTestJSON-1995063474 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00fc0c0c-55b3-45f1-a2b9-41cd6b394e76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:39:31 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-d934ff79-0f89-49b6-84e3-5be200c08ddc tempest-VolumesSnapshotTestJSON-1995063474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (286017d8-533a-4d85-baa1-2a0ca463f31f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:39:31 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-d934ff79-0f89-49b6-84e3-5be200c08ddc tempest-VolumesSnapshotTestJSON-1995063474 None] Volume bc97c015-a89b-4052-9843-9ae334917fbb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc97c015-a89b-4052-9843-9ae334917fbb', 'volume_size': 1} Jun 29 03:39:31 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-d934ff79-0f89-49b6-84e3-5be200c08ddc tempest-VolumesSnapshotTestJSON-1995063474 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:39:31 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-d934ff79-0f89-49b6-84e3-5be200c08ddc tempest-VolumesSnapshotTestJSON-1995063474 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:39:31 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-d934ff79-0f89-49b6-84e3-5be200c08ddc tempest-VolumesSnapshotTestJSON-1995063474 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:39:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1544588668',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc97c015-a89b-4052-9843-9ae334917fbb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57e1750da8ab427786e9129ab400acb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:39:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:39:31Z,use_quota=True,user_id='87d6a117819e42218c0e3a501737fab7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:39:31 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-d934ff79-0f89-49b6-84e3-5be200c08ddc tempest-VolumesSnapshotTestJSON-1995063474 None] Creating volume bc97c015-a89b-4052-9843-9ae334917fbb {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:39:31 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-d934ff79-0f89-49b6-84e3-5be200c08ddc tempest-VolumesSnapshotTestJSON-1995063474 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:39:31 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-d934ff79-0f89-49b6-84e3-5be200c08ddc tempest-VolumesSnapshotTestJSON-1995063474 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:39:31 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-d934ff79-0f89-49b6-84e3-5be200c08ddc tempest-VolumesSnapshotTestJSON-1995063474 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:39:31 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-d934ff79-0f89-49b6-84e3-5be200c08ddc tempest-VolumesSnapshotTestJSON-1995063474 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:39:31 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-d934ff79-0f89-49b6-84e3-5be200c08ddc tempest-VolumesSnapshotTestJSON-1995063474 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:39:31 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-d934ff79-0f89-49b6-84e3-5be200c08ddc tempest-VolumesSnapshotTestJSON-1995063474 None] Selected osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:39:31 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-d934ff79-0f89-49b6-84e3-5be200c08ddc tempest-VolumesSnapshotTestJSON-1995063474 None] casted to osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f Jun 29 03:39:31 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d934ff79-0f89-49b6-84e3-5be200c08ddc tempest-VolumesSnapshotTestJSON-1995063474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-bc97c015-a89b-4052-9843-9ae334917fbb 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:39:31 devstack sudo[112112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-bc97c015-a89b-4052-9843-9ae334917fbb 1073741824 Jun 29 03:39:31 devstack sudo[112112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:39:32 devstack sudo[112112]: pam_unix(sudo:session): session closed for user root Jun 29 03:39:32 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d934ff79-0f89-49b6-84e3-5be200c08ddc tempest-VolumesSnapshotTestJSON-1995063474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-bc97c015-a89b-4052-9843-9ae334917fbb 1073741824" returned: 0 in 0.947s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:39:32 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d934ff79-0f89-49b6-84e3-5be200c08ddc tempest-VolumesSnapshotTestJSON-1995063474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-bc97c015-a89b-4052-9843-9ae334917fbb {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:39:32 devstack sudo[112121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-bc97c015-a89b-4052-9843-9ae334917fbb Jun 29 03:39:32 devstack sudo[112121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:39:32 devstack sudo[112121]: pam_unix(sudo:session): session closed for user root Jun 29 03:39:32 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d934ff79-0f89-49b6-84e3-5be200c08ddc tempest-VolumesSnapshotTestJSON-1995063474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-bc97c015-a89b-4052-9843-9ae334917fbb" returned: 0 in 0.650s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:39:32 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-d934ff79-0f89-49b6-84e3-5be200c08ddc tempest-VolumesSnapshotTestJSON-1995063474 None] <== create_volume: return (1640ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:39:32 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-d934ff79-0f89-49b6-84e3-5be200c08ddc tempest-VolumesSnapshotTestJSON-1995063474 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.643s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:39:32 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-d934ff79-0f89-49b6-84e3-5be200c08ddc tempest-VolumesSnapshotTestJSON-1995063474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (286017d8-533a-4d85-baa1-2a0ca463f31f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc97c015-a89b-4052-9843-9ae334917fbb', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:39:32 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-d934ff79-0f89-49b6-84e3-5be200c08ddc tempest-VolumesSnapshotTestJSON-1995063474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33aa4757-3ae1-4cd4-86e5-be3206d3aec4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:39:32 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-d934ff79-0f89-49b6-84e3-5be200c08ddc tempest-VolumesSnapshotTestJSON-1995063474 None] Volume volume-bc97c015-a89b-4052-9843-9ae334917fbb (bc97c015-a89b-4052-9843-9ae334917fbb): created successfully Jun 29 03:39:32 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-d934ff79-0f89-49b6-84e3-5be200c08ddc tempest-VolumesSnapshotTestJSON-1995063474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33aa4757-3ae1-4cd4-86e5-be3206d3aec4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:39:32 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-d934ff79-0f89-49b6-84e3-5be200c08ddc tempest-VolumesSnapshotTestJSON-1995063474 None] Flow 'volume_create_manager' (7d56173c-d536-45fa-8864-ea0b2b01d395) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:39:32 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-d934ff79-0f89-49b6-84e3-5be200c08ddc tempest-VolumesSnapshotTestJSON-1995063474 None] Created volume successfully. Jun 29 03:39:33 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-b695cab2-49c8-48c1-8e03-8615748ec269 tempest-VolumesSnapshotTestJSON-1995063474 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:39:33 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-b695cab2-49c8-48c1-8e03-8615748ec269 tempest-VolumesSnapshotTestJSON-1995063474 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:39:33 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-b695cab2-49c8-48c1-8e03-8615748ec269 tempest-VolumesSnapshotTestJSON-1995063474 None] Creating offline snapshot d9dce48e-72e5-434a-b357-80210c33e0fe of volume bc97c015-a89b-4052-9843-9ae334917fbb {{(pid=93468) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 29 03:39:33 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[3001a91f-c3f8-4f83-b34a-da2827d67e12]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:39:33 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b695cab2-49c8-48c1-8e03-8615748ec269 tempest-VolumesSnapshotTestJSON-1995063474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-bc97c015-a89b-4052-9843-9ae334917fbb {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:39:33 devstack sudo[112124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-bc97c015-a89b-4052-9843-9ae334917fbb Jun 29 03:39:33 devstack sudo[112124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:39:34 devstack sudo[112124]: pam_unix(sudo:session): session closed for user root Jun 29 03:39:34 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b695cab2-49c8-48c1-8e03-8615748ec269 tempest-VolumesSnapshotTestJSON-1995063474 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-bc97c015-a89b-4052-9843-9ae334917fbb" returned: 0 in 0.783s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:39:34 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b695cab2-49c8-48c1-8e03-8615748ec269 tempest-VolumesSnapshotTestJSON-1995063474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-bc97c015-a89b-4052-9843-9ae334917fbb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-bc97c015-a89b-4052-9843-9ae334917fbb.d9dce48e-72e5-434a-b357-80210c33e0fe 1G {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:39:34 devstack sudo[112129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-bc97c015-a89b-4052-9843-9ae334917fbb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-bc97c015-a89b-4052-9843-9ae334917fbb.d9dce48e-72e5-434a-b357-80210c33e0fe 1G Jun 29 03:39:34 devstack sudo[112129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:39:35 devstack sudo[112129]: pam_unix(sudo:session): session closed for user root Jun 29 03:39:35 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b695cab2-49c8-48c1-8e03-8615748ec269 tempest-VolumesSnapshotTestJSON-1995063474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-bc97c015-a89b-4052-9843-9ae334917fbb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-bc97c015-a89b-4052-9843-9ae334917fbb.d9dce48e-72e5-434a-b357-80210c33e0fe 1G" returned: 0 in 0.833s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:39:35 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b695cab2-49c8-48c1-8e03-8615748ec269 tempest-VolumesSnapshotTestJSON-1995063474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bc97c015-a89b-4052-9843-9ae334917fbb -F qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-bc97c015-a89b-4052-9843-9ae334917fbb.d9dce48e-72e5-434a-b357-80210c33e0fe {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:39:35 devstack sudo[112137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bc97c015-a89b-4052-9843-9ae334917fbb -F qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-bc97c015-a89b-4052-9843-9ae334917fbb.d9dce48e-72e5-434a-b357-80210c33e0fe Jun 29 03:39:35 devstack sudo[112137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:39:35 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-3742f787-d4dd-4dc4-a884-4a49fc1f4528 tempest-TestStampPattern-670457191 None] Acquiring lock "cinder-761d49fb-954c-4601-bcb1-74dfb0935794-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:39:35 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-3742f787-d4dd-4dc4-a884-4a49fc1f4528 tempest-TestStampPattern-670457191 None] Lock "cinder-761d49fb-954c-4601-bcb1-74dfb0935794-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:39:35 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-3742f787-d4dd-4dc4-a884-4a49fc1f4528 tempest-TestStampPattern-670457191 None] Acquiring lock "cinder-quobyte-761d49fb-954c-4601-bcb1-74dfb0935794" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:39:35 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-3742f787-d4dd-4dc4-a884-4a49fc1f4528 tempest-TestStampPattern-670457191 None] Lock "cinder-quobyte-761d49fb-954c-4601-bcb1-74dfb0935794" acquired by "delete_volume" :: waited 0.017s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:39:35 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1b8c789-0b3b-4b9c-a6fb-561a3414f8c8]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:39:35 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-3742f787-d4dd-4dc4-a884-4a49fc1f4528 tempest-TestStampPattern-670457191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-761d49fb-954c-4601-bcb1-74dfb0935794 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:39:35 devstack sudo[112141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-761d49fb-954c-4601-bcb1-74dfb0935794 Jun 29 03:39:35 devstack sudo[112141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:39:35 devstack sudo[112137]: pam_unix(sudo:session): session closed for user root Jun 29 03:39:35 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b695cab2-49c8-48c1-8e03-8615748ec269 tempest-VolumesSnapshotTestJSON-1995063474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bc97c015-a89b-4052-9843-9ae334917fbb -F qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-bc97c015-a89b-4052-9843-9ae334917fbb.d9dce48e-72e5-434a-b357-80210c33e0fe" returned: 0 in 0.723s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:39:35 devstack cinder-volume[93468]: WARNING cinder.volume.drivers.remotefs [None req-b695cab2-49c8-48c1-8e03-8615748ec269 tempest-VolumesSnapshotTestJSON-1995063474 None] /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-bc97c015-a89b-4052-9843-9ae334917fbb.d9dce48e-72e5-434a-b357-80210c33e0fe is being set with open permissions: ugo+rw Jun 29 03:39:35 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b695cab2-49c8-48c1-8e03-8615748ec269 tempest-VolumesSnapshotTestJSON-1995063474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-bc97c015-a89b-4052-9843-9ae334917fbb.d9dce48e-72e5-434a-b357-80210c33e0fe {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:39:35 devstack sudo[112145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-bc97c015-a89b-4052-9843-9ae334917fbb.d9dce48e-72e5-434a-b357-80210c33e0fe Jun 29 03:39:35 devstack sudo[112145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:39:36 devstack sudo[112141]: pam_unix(sudo:session): session closed for user root Jun 29 03:39:36 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-3742f787-d4dd-4dc4-a884-4a49fc1f4528 tempest-TestStampPattern-670457191 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-761d49fb-954c-4601-bcb1-74dfb0935794" returned: 0 in 0.800s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:39:36 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-3742f787-d4dd-4dc4-a884-4a49fc1f4528 tempest-TestStampPattern-670457191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-761d49fb-954c-4601-bcb1-74dfb0935794 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:39:36 devstack sudo[112145]: pam_unix(sudo:session): session closed for user root Jun 29 03:39:36 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b695cab2-49c8-48c1-8e03-8615748ec269 tempest-VolumesSnapshotTestJSON-1995063474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-bc97c015-a89b-4052-9843-9ae334917fbb.d9dce48e-72e5-434a-b357-80210c33e0fe" returned: 0 in 0.666s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:39:36 devstack sudo[112151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-761d49fb-954c-4601-bcb1-74dfb0935794 Jun 29 03:39:36 devstack sudo[112151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:39:36 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b695cab2-49c8-48c1-8e03-8615748ec269 tempest-VolumesSnapshotTestJSON-1995063474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-bc97c015-a89b-4052-9843-9ae334917fbb.info {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:39:36 devstack sudo[112153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-bc97c015-a89b-4052-9843-9ae334917fbb.info Jun 29 03:39:36 devstack sudo[112153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:39:37 devstack sudo[112151]: pam_unix(sudo:session): session closed for user root Jun 29 03:39:37 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-3742f787-d4dd-4dc4-a884-4a49fc1f4528 tempest-TestStampPattern-670457191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-761d49fb-954c-4601-bcb1-74dfb0935794" returned: 0 in 0.666s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:39:37 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-3742f787-d4dd-4dc4-a884-4a49fc1f4528 tempest-TestStampPattern-670457191 None] Lock "cinder-quobyte-761d49fb-954c-4601-bcb1-74dfb0935794" released by "delete_volume" :: held 1.517s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:39:37 devstack sudo[112153]: pam_unix(sudo:session): session closed for user root Jun 29 03:39:37 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b695cab2-49c8-48c1-8e03-8615748ec269 tempest-VolumesSnapshotTestJSON-1995063474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-bc97c015-a89b-4052-9843-9ae334917fbb.info" returned: 0 in 0.665s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:39:37 devstack cinder-volume[93468]: WARNING cinder.volume.drivers.remotefs [None req-b695cab2-49c8-48c1-8e03-8615748ec269 tempest-VolumesSnapshotTestJSON-1995063474 None] /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-bc97c015-a89b-4052-9843-9ae334917fbb.info is being set with open permissions: ugo+rw Jun 29 03:39:37 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b695cab2-49c8-48c1-8e03-8615748ec269 tempest-VolumesSnapshotTestJSON-1995063474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-bc97c015-a89b-4052-9843-9ae334917fbb.info {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:39:37 devstack sudo[112157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-bc97c015-a89b-4052-9843-9ae334917fbb.info Jun 29 03:39:37 devstack sudo[112157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:39:37 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-3742f787-d4dd-4dc4-a884-4a49fc1f4528 tempest-TestStampPattern-670457191 None] Created reservations ['fad4ebbe-c9f4-4be3-9ea1-4cac8e3e6846', '62d71bc0-ccbe-43af-8ae4-2faec3ac775c', 'fe60580e-aced-41e4-9b48-8d17a3ec45d8', '6ad51d7f-39a3-428d-a571-9a9ccedab1fb'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:39:37 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-3742f787-d4dd-4dc4-a884-4a49fc1f4528 tempest-TestStampPattern-670457191 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:39:37 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-3742f787-d4dd-4dc4-a884-4a49fc1f4528 tempest-TestStampPattern-670457191 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:39:37 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-3742f787-d4dd-4dc4-a884-4a49fc1f4528 tempest-TestStampPattern-670457191 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:39:37 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-3742f787-d4dd-4dc4-a884-4a49fc1f4528 tempest-TestStampPattern-670457191 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:39:37 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-3742f787-d4dd-4dc4-a884-4a49fc1f4528 tempest-TestStampPattern-670457191 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:39:37 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-3742f787-d4dd-4dc4-a884-4a49fc1f4528 tempest-TestStampPattern-670457191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:39:37 devstack sudo[112159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf Jun 29 03:39:37 devstack sudo[112159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:39:37 devstack sudo[112157]: pam_unix(sudo:session): session closed for user root Jun 29 03:39:37 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b695cab2-49c8-48c1-8e03-8615748ec269 tempest-VolumesSnapshotTestJSON-1995063474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-bc97c015-a89b-4052-9843-9ae334917fbb.info" returned: 0 in 0.644s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:39:37 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-b695cab2-49c8-48c1-8e03-8615748ec269 tempest-VolumesSnapshotTestJSON-1995063474 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.427s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:39:37 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-b695cab2-49c8-48c1-8e03-8615748ec269 tempest-VolumesSnapshotTestJSON-1995063474 None] Create snapshot completed successfully Jun 29 03:39:37 devstack sudo[112159]: pam_unix(sudo:session): session closed for user root Jun 29 03:39:37 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-3742f787-d4dd-4dc4-a884-4a49fc1f4528 tempest-TestStampPattern-670457191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf" returned: 0 in 0.702s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:39:37 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-3742f787-d4dd-4dc4-a884-4a49fc1f4528 tempest-TestStampPattern-670457191 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:39:37 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-3742f787-d4dd-4dc4-a884-4a49fc1f4528 tempest-TestStampPattern-670457191 None] Deleted volume successfully. Jun 29 03:39:37 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-3742f787-d4dd-4dc4-a884-4a49fc1f4528 tempest-TestStampPattern-670457191 None] Lock "cinder-761d49fb-954c-4601-bcb1-74dfb0935794-delete_volume" released by "delete_volume" :: held 2.442s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:39:38 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-721e9271-14d0-4b3d-818c-2c626d35aca5 tempest-TestStampPattern-670457191 None] Acquiring lock "cinder-065975ec-b392-48bc-88f2-5ec9a9d0e5bd-delete_snapshot" by "delete_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:39:38 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-721e9271-14d0-4b3d-818c-2c626d35aca5 tempest-TestStampPattern-670457191 None] Lock "cinder-065975ec-b392-48bc-88f2-5ec9a9d0e5bd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:39:38 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-721e9271-14d0-4b3d-818c-2c626d35aca5 tempest-TestStampPattern-670457191 None] Acquiring lock "cinder-quobyte-27bc308b-b543-4d10-a580-b570f71d8866" by "delete_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:39:38 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-721e9271-14d0-4b3d-818c-2c626d35aca5 tempest-TestStampPattern-670457191 None] Lock "cinder-quobyte-27bc308b-b543-4d10-a580-b570f71d8866" acquired by "delete_snapshot" :: waited 0.014s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:39:38 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-721e9271-14d0-4b3d-818c-2c626d35aca5 tempest-TestStampPattern-670457191 None] Acquiring lock "cinder-quobyte-065975ec-b392-48bc-88f2-5ec9a9d0e5bd" by "_delete_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:39:38 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-721e9271-14d0-4b3d-818c-2c626d35aca5 tempest-TestStampPattern-670457191 None] Lock "cinder-quobyte-065975ec-b392-48bc-88f2-5ec9a9d0e5bd" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:39:38 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-721e9271-14d0-4b3d-818c-2c626d35aca5 tempest-TestStampPattern-670457191 None] Deleting offline snapshot 065975ec-b392-48bc-88f2-5ec9a9d0e5bd of volume 27bc308b-b543-4d10-a580-b570f71d8866 {{(pid=93468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 29 03:39:38 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-721e9271-14d0-4b3d-818c-2c626d35aca5 tempest-TestStampPattern-670457191 None] snapshot_file for this snap is: volume-27bc308b-b543-4d10-a580-b570f71d8866.065975ec-b392-48bc-88f2-5ec9a9d0e5bd {{(pid=93468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 29 03:39:38 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[482755b8-aa83-425e-b123-f9bcacb5421c]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:39:38 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-721e9271-14d0-4b3d-818c-2c626d35aca5 tempest-TestStampPattern-670457191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-27bc308b-b543-4d10-a580-b570f71d8866.065975ec-b392-48bc-88f2-5ec9a9d0e5bd {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:39:38 devstack sudo[112163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-27bc308b-b543-4d10-a580-b570f71d8866.065975ec-b392-48bc-88f2-5ec9a9d0e5bd Jun 29 03:39:38 devstack sudo[112163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:39:38 devstack sudo[112163]: pam_unix(sudo:session): session closed for user root Jun 29 03:39:38 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-721e9271-14d0-4b3d-818c-2c626d35aca5 tempest-TestStampPattern-670457191 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-27bc308b-b543-4d10-a580-b570f71d8866.065975ec-b392-48bc-88f2-5ec9a9d0e5bd" returned: 0 in 0.780s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:39:38 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-721e9271-14d0-4b3d-818c-2c626d35aca5 tempest-TestStampPattern-670457191 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-27bc308b-b543-4d10-a580-b570f71d8866(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93468) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 29 03:39:38 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbe9d928-113a-4e09-bf4f-3dfcdf9606c5]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:39:38 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-721e9271-14d0-4b3d-818c-2c626d35aca5 tempest-TestStampPattern-670457191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-27bc308b-b543-4d10-a580-b570f71d8866 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:39:39 devstack sudo[112169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-27bc308b-b543-4d10-a580-b570f71d8866 Jun 29 03:39:39 devstack sudo[112169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:39:39 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ac43f73-63e5-44f9-874c-f126d8138031 tempest-VolumesSnapshotTestJSON-1995063474 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:39:39 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-6ac43f73-63e5-44f9-874c-f126d8138031 tempest-VolumesSnapshotTestJSON-1995063474 None] Flow 'volume_create_manager' (e5c68c22-a76a-437f-825a-3b70f90f46e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:39:39 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-6ac43f73-63e5-44f9-874c-f126d8138031 tempest-VolumesSnapshotTestJSON-1995063474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82998d98-441c-4d35-8ddf-c28d0e549be8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:39:39 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-6ac43f73-63e5-44f9-874c-f126d8138031 tempest-VolumesSnapshotTestJSON-1995063474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82998d98-441c-4d35-8ddf-c28d0e549be8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:39:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2040899872',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d409aaee-9b63-47bb-9d51-a449ab35f79f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57e1750da8ab427786e9129ab400acb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:39:39Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=d9dce48e-72e5-434a-b357-80210c33e0fe,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:39:39Z,use_quota=True,user_id='87d6a117819e42218c0e3a501737fab7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:39:39 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-6ac43f73-63e5-44f9-874c-f126d8138031 tempest-VolumesSnapshotTestJSON-1995063474 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bed36ba3-7f62-446c-9c6e-27a6136360d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:39:39 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-6ac43f73-63e5-44f9-874c-f126d8138031 tempest-VolumesSnapshotTestJSON-1995063474 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bed36ba3-7f62-446c-9c6e-27a6136360d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:39:39 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-6ac43f73-63e5-44f9-874c-f126d8138031 tempest-VolumesSnapshotTestJSON-1995063474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83e4dc07-4e32-44d8-a837-f6da7af68014) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:39:39 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-6ac43f73-63e5-44f9-874c-f126d8138031 tempest-VolumesSnapshotTestJSON-1995063474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83e4dc07-4e32-44d8-a837-f6da7af68014) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'd409aaee-9b63-47bb-9d51-a449ab35f79f', 'volume_name': 'volume-d409aaee-9b63-47bb-9d51-a449ab35f79f', 'volume_size': 2, 'snapshot_id': 'd9dce48e-72e5-434a-b357-80210c33e0fe'}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:39:39 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-6ac43f73-63e5-44f9-874c-f126d8138031 tempest-VolumesSnapshotTestJSON-1995063474 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2c85a79-a8c1-47ee-8d47-aa2890ab7044) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:39:39 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-6ac43f73-63e5-44f9-874c-f126d8138031 tempest-VolumesSnapshotTestJSON-1995063474 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2c85a79-a8c1-47ee-8d47-aa2890ab7044) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:39:39 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-6ac43f73-63e5-44f9-874c-f126d8138031 tempest-VolumesSnapshotTestJSON-1995063474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7dfa006d-10af-4ce9-b8a8-a55ccf96d398) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:39:39 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-6ac43f73-63e5-44f9-874c-f126d8138031 tempest-VolumesSnapshotTestJSON-1995063474 None] Volume d409aaee-9b63-47bb-9d51-a449ab35f79f: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-d409aaee-9b63-47bb-9d51-a449ab35f79f', 'volume_size': 2, 'snapshot_id': 'd9dce48e-72e5-434a-b357-80210c33e0fe'} Jun 29 03:39:39 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-6ac43f73-63e5-44f9-874c-f126d8138031 tempest-VolumesSnapshotTestJSON-1995063474 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:39:39 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-6ac43f73-63e5-44f9-874c-f126d8138031 tempest-VolumesSnapshotTestJSON-1995063474 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:39:39 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-6ac43f73-63e5-44f9-874c-f126d8138031 tempest-VolumesSnapshotTestJSON-1995063474 None] Acquiring lock "cinder-quobyte-d9dce48e-72e5-434a-b357-80210c33e0fe-d409aaee-9b63-47bb-9d51-a449ab35f79f" by "_create_volume_from_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:39:39 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-6ac43f73-63e5-44f9-874c-f126d8138031 tempest-VolumesSnapshotTestJSON-1995063474 None] Lock "cinder-quobyte-d9dce48e-72e5-434a-b357-80210c33e0fe-d409aaee-9b63-47bb-9d51-a449ab35f79f" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:39:39 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-6ac43f73-63e5-44f9-874c-f126d8138031 tempest-VolumesSnapshotTestJSON-1995063474 None] Creating volume d409aaee-9b63-47bb-9d51-a449ab35f79f from snapshot d9dce48e-72e5-434a-b357-80210c33e0fe {{(pid=93468) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 29 03:39:39 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-6ac43f73-63e5-44f9-874c-f126d8138031 tempest-VolumesSnapshotTestJSON-1995063474 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:39:39 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-6ac43f73-63e5-44f9-874c-f126d8138031 tempest-VolumesSnapshotTestJSON-1995063474 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:39:39 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-6ac43f73-63e5-44f9-874c-f126d8138031 tempest-VolumesSnapshotTestJSON-1995063474 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:39:39 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-6ac43f73-63e5-44f9-874c-f126d8138031 tempest-VolumesSnapshotTestJSON-1995063474 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:39:39 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-6ac43f73-63e5-44f9-874c-f126d8138031 tempest-VolumesSnapshotTestJSON-1995063474 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:39:39 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-6ac43f73-63e5-44f9-874c-f126d8138031 tempest-VolumesSnapshotTestJSON-1995063474 None] Selected osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:39:39 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-6ac43f73-63e5-44f9-874c-f126d8138031 tempest-VolumesSnapshotTestJSON-1995063474 None] Acquiring lock "cinder-quobyte-d409aaee-9b63-47bb-9d51-a449ab35f79f" by "_copy_volume_from_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:39:39 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-6ac43f73-63e5-44f9-874c-f126d8138031 tempest-VolumesSnapshotTestJSON-1995063474 None] Lock "cinder-quobyte-d409aaee-9b63-47bb-9d51-a449ab35f79f" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:39:39 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-6ac43f73-63e5-44f9-874c-f126d8138031 tempest-VolumesSnapshotTestJSON-1995063474 None] snapshot: d9dce48e-72e5-434a-b357-80210c33e0fe, volume: d409aaee-9b63-47bb-9d51-a449ab35f79f, {{(pid=93468) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 29 03:39:39 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-6ac43f73-63e5-44f9-874c-f126d8138031 tempest-VolumesSnapshotTestJSON-1995063474 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:39:39 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-6ac43f73-63e5-44f9-874c-f126d8138031 tempest-VolumesSnapshotTestJSON-1995063474 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:39:39 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-6ac43f73-63e5-44f9-874c-f126d8138031 tempest-VolumesSnapshotTestJSON-1995063474 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:39:39 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-6ac43f73-63e5-44f9-874c-f126d8138031 tempest-VolumesSnapshotTestJSON-1995063474 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:39:39 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-6ac43f73-63e5-44f9-874c-f126d8138031 tempest-VolumesSnapshotTestJSON-1995063474 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:39:39 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdbf1301-382a-4ebb-8ece-b6f4650cf9e4]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:39:39 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-6ac43f73-63e5-44f9-874c-f126d8138031 tempest-VolumesSnapshotTestJSON-1995063474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-bc97c015-a89b-4052-9843-9ae334917fbb.d9dce48e-72e5-434a-b357-80210c33e0fe {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:39:39 devstack sudo[112171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-bc97c015-a89b-4052-9843-9ae334917fbb.d9dce48e-72e5-434a-b357-80210c33e0fe Jun 29 03:39:39 devstack sudo[112171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:39:39 devstack sudo[112169]: pam_unix(sudo:session): session closed for user root Jun 29 03:39:39 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-721e9271-14d0-4b3d-818c-2c626d35aca5 tempest-TestStampPattern-670457191 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-27bc308b-b543-4d10-a580-b570f71d8866" returned: 0 in 0.776s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:39:39 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-721e9271-14d0-4b3d-818c-2c626d35aca5 tempest-TestStampPattern-670457191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-27bc308b-b543-4d10-a580-b570f71d8866.065975ec-b392-48bc-88f2-5ec9a9d0e5bd {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:39:39 devstack sudo[112176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-27bc308b-b543-4d10-a580-b570f71d8866.065975ec-b392-48bc-88f2-5ec9a9d0e5bd Jun 29 03:39:39 devstack sudo[112176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:39:40 devstack sudo[112171]: pam_unix(sudo:session): session closed for user root Jun 29 03:39:40 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-6ac43f73-63e5-44f9-874c-f126d8138031 tempest-VolumesSnapshotTestJSON-1995063474 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-bc97c015-a89b-4052-9843-9ae334917fbb.d9dce48e-72e5-434a-b357-80210c33e0fe" returned: 0 in 0.766s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:39:40 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-6ac43f73-63e5-44f9-874c-f126d8138031 tempest-VolumesSnapshotTestJSON-1995063474 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bc97c015-a89b-4052-9843-9ae334917fbb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93468) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 29 03:39:40 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-6ac43f73-63e5-44f9-874c-f126d8138031 tempest-VolumesSnapshotTestJSON-1995063474 None] will copy from snapshot at /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-bc97c015-a89b-4052-9843-9ae334917fbb {{(pid=93468) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 29 03:39:40 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-6ac43f73-63e5-44f9-874c-f126d8138031 tempest-VolumesSnapshotTestJSON-1995063474 None] Creating direct copy from snapshot {{(pid=93468) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 29 03:39:40 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc4fbd47-01c3-402d-a15b-97fff1bffcd5]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:39:40 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-6ac43f73-63e5-44f9-874c-f126d8138031 tempest-VolumesSnapshotTestJSON-1995063474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-bc97c015-a89b-4052-9843-9ae334917fbb {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:39:40 devstack sudo[112181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-bc97c015-a89b-4052-9843-9ae334917fbb Jun 29 03:39:40 devstack sudo[112181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:39:40 devstack sudo[112176]: pam_unix(sudo:session): session closed for user root Jun 29 03:39:40 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-721e9271-14d0-4b3d-818c-2c626d35aca5 tempest-TestStampPattern-670457191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-27bc308b-b543-4d10-a580-b570f71d8866.065975ec-b392-48bc-88f2-5ec9a9d0e5bd" returned: 0 in 0.755s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:39:40 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-721e9271-14d0-4b3d-818c-2c626d35aca5 tempest-TestStampPattern-670457191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-27bc308b-b543-4d10-a580-b570f71d8866.065975ec-b392-48bc-88f2-5ec9a9d0e5bd {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:39:40 devstack sudo[112186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-27bc308b-b543-4d10-a580-b570f71d8866.065975ec-b392-48bc-88f2-5ec9a9d0e5bd Jun 29 03:39:40 devstack sudo[112186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:39:40 devstack sudo[112181]: pam_unix(sudo:session): session closed for user root Jun 29 03:39:40 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-6ac43f73-63e5-44f9-874c-f126d8138031 tempest-VolumesSnapshotTestJSON-1995063474 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-bc97c015-a89b-4052-9843-9ae334917fbb" returned: 0 in 0.786s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:39:40 devstack cinder-volume[93468]: DEBUG cinder.utils [None req-6ac43f73-63e5-44f9-874c-f126d8138031 tempest-VolumesSnapshotTestJSON-1995063474 None] Path /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-d409aaee-9b63-47bb-9d51-a449ab35f79f not found in is_blk_device check {{(pid=93468) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 29 03:39:40 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-6ac43f73-63e5-44f9-874c-f126d8138031 tempest-VolumesSnapshotTestJSON-1995063474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-bc97c015-a89b-4052-9843-9ae334917fbb /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-d409aaee-9b63-47bb-9d51-a449ab35f79f {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:39:40 devstack sudo[112191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-bc97c015-a89b-4052-9843-9ae334917fbb /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-d409aaee-9b63-47bb-9d51-a449ab35f79f Jun 29 03:39:40 devstack sudo[112191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:39:41 devstack sudo[112186]: pam_unix(sudo:session): session closed for user root Jun 29 03:39:41 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-721e9271-14d0-4b3d-818c-2c626d35aca5 tempest-TestStampPattern-670457191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-27bc308b-b543-4d10-a580-b570f71d8866.065975ec-b392-48bc-88f2-5ec9a9d0e5bd" returned: 0 in 0.647s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:39:41 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-721e9271-14d0-4b3d-818c-2c626d35aca5 tempest-TestStampPattern-670457191 None] Lock "cinder-quobyte-065975ec-b392-48bc-88f2-5ec9a9d0e5bd" released by "_delete_snapshot" :: held 3.069s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:39:41 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-721e9271-14d0-4b3d-818c-2c626d35aca5 tempest-TestStampPattern-670457191 None] Lock "cinder-quobyte-27bc308b-b543-4d10-a580-b570f71d8866" released by "delete_snapshot" :: held 3.092s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:39:41 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-721e9271-14d0-4b3d-818c-2c626d35aca5 tempest-TestStampPattern-670457191 None] Created reservations ['a745e773-ea37-449b-9153-20dfdb4e2e8e', 'a9b229d6-6e44-48b3-88a7-229fc1cdee39', 'ff00d015-cafe-4915-b7c3-b67570805d75', 'bf72ce53-1917-414a-a776-42cf784804eb'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:39:41 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-721e9271-14d0-4b3d-818c-2c626d35aca5 tempest-TestStampPattern-670457191 None] Delete snapshot completed successfully. Jun 29 03:39:41 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-721e9271-14d0-4b3d-818c-2c626d35aca5 tempest-TestStampPattern-670457191 None] Lock "cinder-065975ec-b392-48bc-88f2-5ec9a9d0e5bd-delete_snapshot" released by "delete_snapshot" :: held 3.218s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:39:46 devstack sudo[112191]: pam_unix(sudo:session): session closed for user root Jun 29 03:39:46 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-6ac43f73-63e5-44f9-874c-f126d8138031 tempest-VolumesSnapshotTestJSON-1995063474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-bc97c015-a89b-4052-9843-9ae334917fbb /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-d409aaee-9b63-47bb-9d51-a449ab35f79f" returned: 0 in 5.715s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:39:46 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[510ad2f6-f912-433e-8b22-b1067f6ae269]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:39:46 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-6ac43f73-63e5-44f9-874c-f126d8138031 tempest-VolumesSnapshotTestJSON-1995063474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-bc97c015-a89b-4052-9843-9ae334917fbb {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:39:46 devstack sudo[112288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-bc97c015-a89b-4052-9843-9ae334917fbb Jun 29 03:39:46 devstack sudo[112288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:39:47 devstack sudo[112288]: pam_unix(sudo:session): session closed for user root Jun 29 03:39:47 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-6ac43f73-63e5-44f9-874c-f126d8138031 tempest-VolumesSnapshotTestJSON-1995063474 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-bc97c015-a89b-4052-9843-9ae334917fbb" returned: 0 in 1.010s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:39:47 devstack cinder-volume[93468]: DEBUG cinder.image.image_utils [None req-6ac43f73-63e5-44f9-874c-f126d8138031 tempest-VolumesSnapshotTestJSON-1995063474 None] Image conversion details: src /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-bc97c015-a89b-4052-9843-9ae334917fbb, size 1024.00 MB, duration 5.72 sec, destination /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-d409aaee-9b63-47bb-9d51-a449ab35f79f {{(pid=93468) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 29 03:39:47 devstack cinder-volume[93468]: INFO cinder.image.image_utils [None req-6ac43f73-63e5-44f9-874c-f126d8138031 tempest-VolumesSnapshotTestJSON-1995063474 None] Converted 1024.00 MB image at 179.16 MB/s Jun 29 03:39:47 devstack cinder-volume[93468]: WARNING cinder.volume.drivers.remotefs [None req-6ac43f73-63e5-44f9-874c-f126d8138031 tempest-VolumesSnapshotTestJSON-1995063474 None] /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-d409aaee-9b63-47bb-9d51-a449ab35f79f is being set with open permissions: ugo+rw Jun 29 03:39:47 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-6ac43f73-63e5-44f9-874c-f126d8138031 tempest-VolumesSnapshotTestJSON-1995063474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-d409aaee-9b63-47bb-9d51-a449ab35f79f {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:39:47 devstack sudo[112295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-d409aaee-9b63-47bb-9d51-a449ab35f79f Jun 29 03:39:47 devstack sudo[112295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:39:48 devstack sudo[112295]: pam_unix(sudo:session): session closed for user root Jun 29 03:39:48 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-6ac43f73-63e5-44f9-874c-f126d8138031 tempest-VolumesSnapshotTestJSON-1995063474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-d409aaee-9b63-47bb-9d51-a449ab35f79f" returned: 0 in 0.709s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:39:48 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-6ac43f73-63e5-44f9-874c-f126d8138031 tempest-VolumesSnapshotTestJSON-1995063474 None] Lock "cinder-quobyte-d409aaee-9b63-47bb-9d51-a449ab35f79f" released by "_copy_volume_from_snapshot" :: held 9.096s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:39:48 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-6ac43f73-63e5-44f9-874c-f126d8138031 tempest-VolumesSnapshotTestJSON-1995063474 None] Lock "cinder-quobyte-d9dce48e-72e5-434a-b357-80210c33e0fe-d409aaee-9b63-47bb-9d51-a449ab35f79f" released by "_create_volume_from_snapshot" :: held 9.123s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:39:48 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-6ac43f73-63e5-44f9-874c-f126d8138031 tempest-VolumesSnapshotTestJSON-1995063474 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.138s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:39:48 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-6ac43f73-63e5-44f9-874c-f126d8138031 tempest-VolumesSnapshotTestJSON-1995063474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7dfa006d-10af-4ce9-b8a8-a55ccf96d398) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d409aaee-9b63-47bb-9d51-a449ab35f79f', 'volume_size': 2, 'snapshot_id': 'd9dce48e-72e5-434a-b357-80210c33e0fe'}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:39:48 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-6ac43f73-63e5-44f9-874c-f126d8138031 tempest-VolumesSnapshotTestJSON-1995063474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e70ed78-e605-4bbe-9d6a-b0cfd4320a27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:39:48 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-6ac43f73-63e5-44f9-874c-f126d8138031 tempest-VolumesSnapshotTestJSON-1995063474 None] Volume volume-d409aaee-9b63-47bb-9d51-a449ab35f79f (d409aaee-9b63-47bb-9d51-a449ab35f79f): created successfully Jun 29 03:39:48 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-6ac43f73-63e5-44f9-874c-f126d8138031 tempest-VolumesSnapshotTestJSON-1995063474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e70ed78-e605-4bbe-9d6a-b0cfd4320a27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:39:48 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-6ac43f73-63e5-44f9-874c-f126d8138031 tempest-VolumesSnapshotTestJSON-1995063474 None] Flow 'volume_create_manager' (e5c68c22-a76a-437f-825a-3b70f90f46e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:39:48 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-6ac43f73-63e5-44f9-874c-f126d8138031 tempest-VolumesSnapshotTestJSON-1995063474 None] Created volume successfully. Jun 29 03:39:49 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-2ddcca92-f262-4c2f-b4d2-65cd4b1e9c5a tempest-VolumesSnapshotTestJSON-1995063474 None] Acquiring lock "cinder-d409aaee-9b63-47bb-9d51-a449ab35f79f-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:39:49 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-2ddcca92-f262-4c2f-b4d2-65cd4b1e9c5a tempest-VolumesSnapshotTestJSON-1995063474 None] Lock "cinder-d409aaee-9b63-47bb-9d51-a449ab35f79f-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:39:49 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-2ddcca92-f262-4c2f-b4d2-65cd4b1e9c5a tempest-VolumesSnapshotTestJSON-1995063474 None] Acquiring lock "cinder-quobyte-d409aaee-9b63-47bb-9d51-a449ab35f79f" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:39:49 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-2ddcca92-f262-4c2f-b4d2-65cd4b1e9c5a tempest-VolumesSnapshotTestJSON-1995063474 None] Lock "cinder-quobyte-d409aaee-9b63-47bb-9d51-a449ab35f79f" acquired by "delete_volume" :: waited 0.016s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:39:49 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6879ba8-7306-4daf-a880-6ff049872206]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:39:49 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2ddcca92-f262-4c2f-b4d2-65cd4b1e9c5a tempest-VolumesSnapshotTestJSON-1995063474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-d409aaee-9b63-47bb-9d51-a449ab35f79f {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:39:49 devstack sudo[112299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-d409aaee-9b63-47bb-9d51-a449ab35f79f Jun 29 03:39:49 devstack sudo[112299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:39:50 devstack sudo[112299]: pam_unix(sudo:session): session closed for user root Jun 29 03:39:50 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2ddcca92-f262-4c2f-b4d2-65cd4b1e9c5a tempest-VolumesSnapshotTestJSON-1995063474 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-d409aaee-9b63-47bb-9d51-a449ab35f79f" returned: 0 in 0.757s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:39:50 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2ddcca92-f262-4c2f-b4d2-65cd4b1e9c5a tempest-VolumesSnapshotTestJSON-1995063474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-d409aaee-9b63-47bb-9d51-a449ab35f79f {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:39:50 devstack sudo[112304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-d409aaee-9b63-47bb-9d51-a449ab35f79f Jun 29 03:39:50 devstack sudo[112304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:39:50 devstack sudo[112304]: pam_unix(sudo:session): session closed for user root Jun 29 03:39:50 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2ddcca92-f262-4c2f-b4d2-65cd4b1e9c5a tempest-VolumesSnapshotTestJSON-1995063474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-d409aaee-9b63-47bb-9d51-a449ab35f79f" returned: 0 in 0.661s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:39:50 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-2ddcca92-f262-4c2f-b4d2-65cd4b1e9c5a tempest-VolumesSnapshotTestJSON-1995063474 None] Lock "cinder-quobyte-d409aaee-9b63-47bb-9d51-a449ab35f79f" released by "delete_volume" :: held 1.466s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:39:50 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-2ddcca92-f262-4c2f-b4d2-65cd4b1e9c5a tempest-VolumesSnapshotTestJSON-1995063474 None] Created reservations ['ea596226-e472-4ed5-9040-13a6710469d3', '3942cb98-c9dd-430c-bf2c-721a82bbf65a', '999aa55a-4f28-481b-891c-bac28a2d1c34', '4638ce70-35d3-4cad-af0d-298fe78f895f'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:39:50 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-2ddcca92-f262-4c2f-b4d2-65cd4b1e9c5a tempest-VolumesSnapshotTestJSON-1995063474 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:39:50 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-2ddcca92-f262-4c2f-b4d2-65cd4b1e9c5a tempest-VolumesSnapshotTestJSON-1995063474 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:39:50 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-2ddcca92-f262-4c2f-b4d2-65cd4b1e9c5a tempest-VolumesSnapshotTestJSON-1995063474 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:39:50 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-2ddcca92-f262-4c2f-b4d2-65cd4b1e9c5a tempest-VolumesSnapshotTestJSON-1995063474 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:39:50 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-2ddcca92-f262-4c2f-b4d2-65cd4b1e9c5a tempest-VolumesSnapshotTestJSON-1995063474 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:39:50 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2ddcca92-f262-4c2f-b4d2-65cd4b1e9c5a tempest-VolumesSnapshotTestJSON-1995063474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:39:50 devstack sudo[112307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf Jun 29 03:39:50 devstack sudo[112307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:39:51 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-fce95aab-e594-49c9-acf5-5ad0d26e38ef tempest-TestStampPattern-670457191 None] Acquiring lock "cinder-27bc308b-b543-4d10-a580-b570f71d8866-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:39:51 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-fce95aab-e594-49c9-acf5-5ad0d26e38ef tempest-TestStampPattern-670457191 None] Lock "cinder-27bc308b-b543-4d10-a580-b570f71d8866-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:39:51 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-41839203-672d-42c3-8fa5-071dbe69fd5e tempest-VolumesSnapshotTestJSON-1995063474 None] Acquiring lock "cinder-d9dce48e-72e5-434a-b357-80210c33e0fe-delete_snapshot" by "delete_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:39:51 devstack sudo[112307]: pam_unix(sudo:session): session closed for user root Jun 29 03:39:51 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2ddcca92-f262-4c2f-b4d2-65cd4b1e9c5a tempest-VolumesSnapshotTestJSON-1995063474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf" returned: 0 in 0.706s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:39:51 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-2ddcca92-f262-4c2f-b4d2-65cd4b1e9c5a tempest-VolumesSnapshotTestJSON-1995063474 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:39:51 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-41839203-672d-42c3-8fa5-071dbe69fd5e tempest-VolumesSnapshotTestJSON-1995063474 None] Lock "cinder-d9dce48e-72e5-434a-b357-80210c33e0fe-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:39:51 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-41839203-672d-42c3-8fa5-071dbe69fd5e tempest-VolumesSnapshotTestJSON-1995063474 None] Acquiring lock "cinder-quobyte-bc97c015-a89b-4052-9843-9ae334917fbb" by "delete_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:39:51 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-2ddcca92-f262-4c2f-b4d2-65cd4b1e9c5a tempest-VolumesSnapshotTestJSON-1995063474 None] Deleted volume successfully. Jun 29 03:39:51 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-fce95aab-e594-49c9-acf5-5ad0d26e38ef tempest-TestStampPattern-670457191 None] Acquiring lock "cinder-quobyte-27bc308b-b543-4d10-a580-b570f71d8866" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:39:51 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-41839203-672d-42c3-8fa5-071dbe69fd5e tempest-VolumesSnapshotTestJSON-1995063474 None] Lock "cinder-quobyte-bc97c015-a89b-4052-9843-9ae334917fbb" acquired by "delete_snapshot" :: waited 0.034s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:39:51 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-41839203-672d-42c3-8fa5-071dbe69fd5e tempest-VolumesSnapshotTestJSON-1995063474 None] Acquiring lock "cinder-quobyte-d9dce48e-72e5-434a-b357-80210c33e0fe" by "_delete_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:39:51 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-2ddcca92-f262-4c2f-b4d2-65cd4b1e9c5a tempest-VolumesSnapshotTestJSON-1995063474 None] Lock "cinder-d409aaee-9b63-47bb-9d51-a449ab35f79f-delete_volume" released by "delete_volume" :: held 2.393s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:39:51 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-41839203-672d-42c3-8fa5-071dbe69fd5e tempest-VolumesSnapshotTestJSON-1995063474 None] Lock "cinder-quobyte-d9dce48e-72e5-434a-b357-80210c33e0fe" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:39:51 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-41839203-672d-42c3-8fa5-071dbe69fd5e tempest-VolumesSnapshotTestJSON-1995063474 None] Deleting offline snapshot d9dce48e-72e5-434a-b357-80210c33e0fe of volume bc97c015-a89b-4052-9843-9ae334917fbb {{(pid=93468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 29 03:39:51 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-41839203-672d-42c3-8fa5-071dbe69fd5e tempest-VolumesSnapshotTestJSON-1995063474 None] snapshot_file for this snap is: volume-bc97c015-a89b-4052-9843-9ae334917fbb.d9dce48e-72e5-434a-b357-80210c33e0fe {{(pid=93468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 29 03:39:51 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-fce95aab-e594-49c9-acf5-5ad0d26e38ef tempest-TestStampPattern-670457191 None] Lock "cinder-quobyte-27bc308b-b543-4d10-a580-b570f71d8866" acquired by "delete_volume" :: waited 0.041s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:39:51 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[03d36d84-f807-41b5-8702-016a479dba16]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:39:51 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-41839203-672d-42c3-8fa5-071dbe69fd5e tempest-VolumesSnapshotTestJSON-1995063474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-bc97c015-a89b-4052-9843-9ae334917fbb.d9dce48e-72e5-434a-b357-80210c33e0fe {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:39:51 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[95c5e702-0da3-4933-9700-88be95697216]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:39:51 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-fce95aab-e594-49c9-acf5-5ad0d26e38ef tempest-TestStampPattern-670457191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-27bc308b-b543-4d10-a580-b570f71d8866 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:39:51 devstack sudo[112310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-bc97c015-a89b-4052-9843-9ae334917fbb.d9dce48e-72e5-434a-b357-80210c33e0fe Jun 29 03:39:51 devstack sudo[112310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:39:51 devstack sudo[112311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-27bc308b-b543-4d10-a580-b570f71d8866 Jun 29 03:39:51 devstack sudo[112311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:39:52 devstack sudo[112310]: pam_unix(sudo:session): session closed for user root Jun 29 03:39:52 devstack sudo[112311]: pam_unix(sudo:session): session closed for user root Jun 29 03:39:52 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-41839203-672d-42c3-8fa5-071dbe69fd5e tempest-VolumesSnapshotTestJSON-1995063474 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-bc97c015-a89b-4052-9843-9ae334917fbb.d9dce48e-72e5-434a-b357-80210c33e0fe" returned: 0 in 0.777s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:39:52 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-41839203-672d-42c3-8fa5-071dbe69fd5e tempest-VolumesSnapshotTestJSON-1995063474 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bc97c015-a89b-4052-9843-9ae334917fbb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93468) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 29 03:39:52 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-fce95aab-e594-49c9-acf5-5ad0d26e38ef tempest-TestStampPattern-670457191 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-27bc308b-b543-4d10-a580-b570f71d8866" returned: 0 in 0.782s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:39:52 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-fce95aab-e594-49c9-acf5-5ad0d26e38ef tempest-TestStampPattern-670457191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-27bc308b-b543-4d10-a580-b570f71d8866 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:39:52 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[67174366-fd21-429a-af24-50f1801626a0]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:39:52 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-41839203-672d-42c3-8fa5-071dbe69fd5e tempest-VolumesSnapshotTestJSON-1995063474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-bc97c015-a89b-4052-9843-9ae334917fbb {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:39:52 devstack sudo[112321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-27bc308b-b543-4d10-a580-b570f71d8866 Jun 29 03:39:52 devstack sudo[112321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:39:52 devstack sudo[112322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-bc97c015-a89b-4052-9843-9ae334917fbb Jun 29 03:39:52 devstack sudo[112322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:39:53 devstack sudo[112321]: pam_unix(sudo:session): session closed for user root Jun 29 03:39:53 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-fce95aab-e594-49c9-acf5-5ad0d26e38ef tempest-TestStampPattern-670457191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-27bc308b-b543-4d10-a580-b570f71d8866" returned: 0 in 0.676s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:39:53 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-fce95aab-e594-49c9-acf5-5ad0d26e38ef tempest-TestStampPattern-670457191 None] Lock "cinder-quobyte-27bc308b-b543-4d10-a580-b570f71d8866" released by "delete_volume" :: held 1.518s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:39:53 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-fce95aab-e594-49c9-acf5-5ad0d26e38ef tempest-TestStampPattern-670457191 None] Created reservations ['38858e8b-72b9-40fe-8077-569770ca538a', '0f50c0b7-e3ad-40e9-8d6b-0a77ddd83dfd', '740add01-673e-4640-9767-f2c35f95e48b', 'eb7a6dd5-9318-4517-bc79-349ca9e91e0b'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:39:53 devstack sudo[112322]: pam_unix(sudo:session): session closed for user root Jun 29 03:39:53 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-41839203-672d-42c3-8fa5-071dbe69fd5e tempest-VolumesSnapshotTestJSON-1995063474 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-bc97c015-a89b-4052-9843-9ae334917fbb" returned: 0 in 0.759s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:39:53 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-41839203-672d-42c3-8fa5-071dbe69fd5e tempest-VolumesSnapshotTestJSON-1995063474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-bc97c015-a89b-4052-9843-9ae334917fbb.d9dce48e-72e5-434a-b357-80210c33e0fe {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:39:53 devstack sudo[112329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-bc97c015-a89b-4052-9843-9ae334917fbb.d9dce48e-72e5-434a-b357-80210c33e0fe Jun 29 03:39:53 devstack sudo[112329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:39:53 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-fce95aab-e594-49c9-acf5-5ad0d26e38ef tempest-TestStampPattern-670457191 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:39:53 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-fce95aab-e594-49c9-acf5-5ad0d26e38ef tempest-TestStampPattern-670457191 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:39:53 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-fce95aab-e594-49c9-acf5-5ad0d26e38ef tempest-TestStampPattern-670457191 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:39:53 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-fce95aab-e594-49c9-acf5-5ad0d26e38ef tempest-TestStampPattern-670457191 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:39:53 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-fce95aab-e594-49c9-acf5-5ad0d26e38ef tempest-TestStampPattern-670457191 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:39:53 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-fce95aab-e594-49c9-acf5-5ad0d26e38ef tempest-TestStampPattern-670457191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:39:53 devstack sudo[112331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf Jun 29 03:39:53 devstack sudo[112331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:39:53 devstack sudo[112331]: pam_unix(sudo:session): session closed for user root Jun 29 03:39:53 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-fce95aab-e594-49c9-acf5-5ad0d26e38ef tempest-TestStampPattern-670457191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf" returned: 0 in 0.689s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:39:53 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-fce95aab-e594-49c9-acf5-5ad0d26e38ef tempest-TestStampPattern-670457191 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:39:54 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-fce95aab-e594-49c9-acf5-5ad0d26e38ef tempest-TestStampPattern-670457191 None] Deleted volume successfully. Jun 29 03:39:54 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-fce95aab-e594-49c9-acf5-5ad0d26e38ef tempest-TestStampPattern-670457191 None] Lock "cinder-27bc308b-b543-4d10-a580-b570f71d8866-delete_volume" released by "delete_volume" :: held 2.504s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:39:54 devstack sudo[112329]: pam_unix(sudo:session): session closed for user root Jun 29 03:39:54 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-41839203-672d-42c3-8fa5-071dbe69fd5e tempest-VolumesSnapshotTestJSON-1995063474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-bc97c015-a89b-4052-9843-9ae334917fbb.d9dce48e-72e5-434a-b357-80210c33e0fe" returned: 0 in 0.834s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:39:54 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-41839203-672d-42c3-8fa5-071dbe69fd5e tempest-VolumesSnapshotTestJSON-1995063474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-bc97c015-a89b-4052-9843-9ae334917fbb.d9dce48e-72e5-434a-b357-80210c33e0fe {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:39:54 devstack sudo[112338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-bc97c015-a89b-4052-9843-9ae334917fbb.d9dce48e-72e5-434a-b357-80210c33e0fe Jun 29 03:39:54 devstack sudo[112338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:39:54 devstack sudo[112338]: pam_unix(sudo:session): session closed for user root Jun 29 03:39:54 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-41839203-672d-42c3-8fa5-071dbe69fd5e tempest-VolumesSnapshotTestJSON-1995063474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-bc97c015-a89b-4052-9843-9ae334917fbb.d9dce48e-72e5-434a-b357-80210c33e0fe" returned: 0 in 0.690s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:39:54 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-41839203-672d-42c3-8fa5-071dbe69fd5e tempest-VolumesSnapshotTestJSON-1995063474 None] Lock "cinder-quobyte-d9dce48e-72e5-434a-b357-80210c33e0fe" released by "_delete_snapshot" :: held 3.195s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:39:54 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-41839203-672d-42c3-8fa5-071dbe69fd5e tempest-VolumesSnapshotTestJSON-1995063474 None] Lock "cinder-quobyte-bc97c015-a89b-4052-9843-9ae334917fbb" released by "delete_snapshot" :: held 3.227s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:39:54 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-41839203-672d-42c3-8fa5-071dbe69fd5e tempest-VolumesSnapshotTestJSON-1995063474 None] Created reservations ['c9be6371-4c2a-401c-91c1-a650e1655504', '5c592b81-162a-451e-b90f-5c08ead4d0b4', 'd16add2f-f564-4f12-be69-af6d7e06fa65', '1569e72f-1779-433d-8ee9-0ff291bc53e1'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:39:54 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-41839203-672d-42c3-8fa5-071dbe69fd5e tempest-VolumesSnapshotTestJSON-1995063474 None] Delete snapshot completed successfully. Jun 29 03:39:55 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-41839203-672d-42c3-8fa5-071dbe69fd5e tempest-VolumesSnapshotTestJSON-1995063474 None] Lock "cinder-d9dce48e-72e5-434a-b357-80210c33e0fe-delete_snapshot" released by "delete_snapshot" :: held 3.422s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:39:55 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-9f7fad02-635d-4a77-ab14-dabd4d96afbd tempest-VolumesSnapshotTestJSON-1995063474 None] Acquiring lock "cinder-bc97c015-a89b-4052-9843-9ae334917fbb-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:39:55 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-9f7fad02-635d-4a77-ab14-dabd4d96afbd tempest-VolumesSnapshotTestJSON-1995063474 None] Lock "cinder-bc97c015-a89b-4052-9843-9ae334917fbb-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:39:55 devstack cinder-volume[93468]: DEBUG dbcounter [-] [93468] Writing DB stats cinder:UPDATE=62,cinder:SELECT=67,cinder:INSERT=15,cinder:DELETE=4 {{(pid=93468) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 29 03:39:55 devstack cinder-volume[93468]: DEBUG dbcounter [-] [93468] Writing DB stats cinder:SELECT=60,cinder:UPDATE=63,cinder:INSERT=17,cinder:DELETE=5 {{(pid=93468) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 29 03:39:55 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-9f7fad02-635d-4a77-ab14-dabd4d96afbd tempest-VolumesSnapshotTestJSON-1995063474 None] Acquiring lock "cinder-quobyte-bc97c015-a89b-4052-9843-9ae334917fbb" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:39:55 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-9f7fad02-635d-4a77-ab14-dabd4d96afbd tempest-VolumesSnapshotTestJSON-1995063474 None] Lock "cinder-quobyte-bc97c015-a89b-4052-9843-9ae334917fbb" acquired by "delete_volume" :: waited 0.020s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:39:56 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[503c1abd-dfe8-404a-9da0-093ea340dfce]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:39:56 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-9f7fad02-635d-4a77-ab14-dabd4d96afbd tempest-VolumesSnapshotTestJSON-1995063474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-bc97c015-a89b-4052-9843-9ae334917fbb {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:39:56 devstack sudo[112342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-bc97c015-a89b-4052-9843-9ae334917fbb Jun 29 03:39:56 devstack sudo[112342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:39:56 devstack sudo[112342]: pam_unix(sudo:session): session closed for user root Jun 29 03:39:56 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-9f7fad02-635d-4a77-ab14-dabd4d96afbd tempest-VolumesSnapshotTestJSON-1995063474 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-bc97c015-a89b-4052-9843-9ae334917fbb" returned: 0 in 0.797s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:39:56 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-9f7fad02-635d-4a77-ab14-dabd4d96afbd tempest-VolumesSnapshotTestJSON-1995063474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-bc97c015-a89b-4052-9843-9ae334917fbb {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:39:56 devstack sudo[112347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-bc97c015-a89b-4052-9843-9ae334917fbb Jun 29 03:39:56 devstack sudo[112347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:39:57 devstack sudo[112347]: pam_unix(sudo:session): session closed for user root Jun 29 03:39:57 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-9f7fad02-635d-4a77-ab14-dabd4d96afbd tempest-VolumesSnapshotTestJSON-1995063474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-bc97c015-a89b-4052-9843-9ae334917fbb" returned: 0 in 0.652s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:39:57 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-9f7fad02-635d-4a77-ab14-dabd4d96afbd tempest-VolumesSnapshotTestJSON-1995063474 None] Lock "cinder-quobyte-bc97c015-a89b-4052-9843-9ae334917fbb" released by "delete_volume" :: held 1.518s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:39:57 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-9f7fad02-635d-4a77-ab14-dabd4d96afbd tempest-VolumesSnapshotTestJSON-1995063474 None] Created reservations ['a9243121-f06d-4164-be80-2ea48478f34c', '6482d307-f844-4d89-b36e-d634ba615219', 'd002b259-18a0-4bb5-aba1-4f56a42cbbb0', '6c37ab19-a31b-4376-ba8d-53650641bdd8'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:39:57 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-9f7fad02-635d-4a77-ab14-dabd4d96afbd tempest-VolumesSnapshotTestJSON-1995063474 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:39:57 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-9f7fad02-635d-4a77-ab14-dabd4d96afbd tempest-VolumesSnapshotTestJSON-1995063474 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:39:57 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-9f7fad02-635d-4a77-ab14-dabd4d96afbd tempest-VolumesSnapshotTestJSON-1995063474 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:39:57 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-9f7fad02-635d-4a77-ab14-dabd4d96afbd tempest-VolumesSnapshotTestJSON-1995063474 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:39:57 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-9f7fad02-635d-4a77-ab14-dabd4d96afbd tempest-VolumesSnapshotTestJSON-1995063474 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:39:57 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-9f7fad02-635d-4a77-ab14-dabd4d96afbd tempest-VolumesSnapshotTestJSON-1995063474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:39:57 devstack sudo[112350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf Jun 29 03:39:57 devstack sudo[112350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:39:58 devstack sudo[112350]: pam_unix(sudo:session): session closed for user root Jun 29 03:39:58 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-9f7fad02-635d-4a77-ab14-dabd4d96afbd tempest-VolumesSnapshotTestJSON-1995063474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf" returned: 0 in 0.705s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:39:58 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-9f7fad02-635d-4a77-ab14-dabd4d96afbd tempest-VolumesSnapshotTestJSON-1995063474 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:39:58 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-9f7fad02-635d-4a77-ab14-dabd4d96afbd tempest-VolumesSnapshotTestJSON-1995063474 None] Deleted volume successfully. Jun 29 03:39:58 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-9f7fad02-635d-4a77-ab14-dabd4d96afbd tempest-VolumesSnapshotTestJSON-1995063474 None] Lock "cinder-bc97c015-a89b-4052-9843-9ae334917fbb-delete_volume" released by "delete_volume" :: held 2.625s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:39:58 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-22e1c162-024a-4d2f-bad5-63fe67875e78 tempest-VolumesSnapshotTestJSON-1995063474 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:39:58 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-22e1c162-024a-4d2f-bad5-63fe67875e78 tempest-VolumesSnapshotTestJSON-1995063474 None] Flow 'volume_create_manager' (db2a9864-13c3-42c5-8068-6283992f177c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:39:58 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-22e1c162-024a-4d2f-bad5-63fe67875e78 tempest-VolumesSnapshotTestJSON-1995063474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da2b6263-e0e6-48c9-b3ae-0bc00e52987e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:39:58 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-22e1c162-024a-4d2f-bad5-63fe67875e78 tempest-VolumesSnapshotTestJSON-1995063474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da2b6263-e0e6-48c9-b3ae-0bc00e52987e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:39:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1082247125',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbe2032c-173d-4363-8e8a-f85854c64198,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57e1750da8ab427786e9129ab400acb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:39:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:39:59Z,use_quota=True,user_id='87d6a117819e42218c0e3a501737fab7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:39:58 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-22e1c162-024a-4d2f-bad5-63fe67875e78 tempest-VolumesSnapshotTestJSON-1995063474 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd49933b-cfbf-4abb-b1f5-141b23129230) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:39:58 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-22e1c162-024a-4d2f-bad5-63fe67875e78 tempest-VolumesSnapshotTestJSON-1995063474 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd49933b-cfbf-4abb-b1f5-141b23129230) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:39:58 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-22e1c162-024a-4d2f-bad5-63fe67875e78 tempest-VolumesSnapshotTestJSON-1995063474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c66187c-f034-4be5-8575-4ecad35157ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:39:58 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-22e1c162-024a-4d2f-bad5-63fe67875e78 tempest-VolumesSnapshotTestJSON-1995063474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c66187c-f034-4be5-8575-4ecad35157ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dbe2032c-173d-4363-8e8a-f85854c64198', 'volume_name': 'volume-dbe2032c-173d-4363-8e8a-f85854c64198', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:39:58 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-22e1c162-024a-4d2f-bad5-63fe67875e78 tempest-VolumesSnapshotTestJSON-1995063474 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d34aecd2-8393-48fb-a6a0-6601782f2465) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:39:58 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-22e1c162-024a-4d2f-bad5-63fe67875e78 tempest-VolumesSnapshotTestJSON-1995063474 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d34aecd2-8393-48fb-a6a0-6601782f2465) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:39:58 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-22e1c162-024a-4d2f-bad5-63fe67875e78 tempest-VolumesSnapshotTestJSON-1995063474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (327cf6ef-313d-417c-a9e5-9d55c73766e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:39:58 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-22e1c162-024a-4d2f-bad5-63fe67875e78 tempest-VolumesSnapshotTestJSON-1995063474 None] Volume dbe2032c-173d-4363-8e8a-f85854c64198: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dbe2032c-173d-4363-8e8a-f85854c64198', 'volume_size': 1} Jun 29 03:39:58 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-22e1c162-024a-4d2f-bad5-63fe67875e78 tempest-VolumesSnapshotTestJSON-1995063474 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:39:58 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-22e1c162-024a-4d2f-bad5-63fe67875e78 tempest-VolumesSnapshotTestJSON-1995063474 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:39:58 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-22e1c162-024a-4d2f-bad5-63fe67875e78 tempest-VolumesSnapshotTestJSON-1995063474 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:39:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1082247125',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbe2032c-173d-4363-8e8a-f85854c64198,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57e1750da8ab427786e9129ab400acb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:39:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:39:59Z,use_quota=True,user_id='87d6a117819e42218c0e3a501737fab7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:39:58 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-22e1c162-024a-4d2f-bad5-63fe67875e78 tempest-VolumesSnapshotTestJSON-1995063474 None] Creating volume dbe2032c-173d-4363-8e8a-f85854c64198 {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:39:58 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-22e1c162-024a-4d2f-bad5-63fe67875e78 tempest-VolumesSnapshotTestJSON-1995063474 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:39:58 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-22e1c162-024a-4d2f-bad5-63fe67875e78 tempest-VolumesSnapshotTestJSON-1995063474 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:39:58 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-22e1c162-024a-4d2f-bad5-63fe67875e78 tempest-VolumesSnapshotTestJSON-1995063474 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:39:58 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-22e1c162-024a-4d2f-bad5-63fe67875e78 tempest-VolumesSnapshotTestJSON-1995063474 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:39:58 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-22e1c162-024a-4d2f-bad5-63fe67875e78 tempest-VolumesSnapshotTestJSON-1995063474 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:39:58 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-22e1c162-024a-4d2f-bad5-63fe67875e78 tempest-VolumesSnapshotTestJSON-1995063474 None] Selected osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:39:58 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-22e1c162-024a-4d2f-bad5-63fe67875e78 tempest-VolumesSnapshotTestJSON-1995063474 None] casted to osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f Jun 29 03:39:58 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-22e1c162-024a-4d2f-bad5-63fe67875e78 tempest-VolumesSnapshotTestJSON-1995063474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-dbe2032c-173d-4363-8e8a-f85854c64198 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:39:58 devstack sudo[112354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-dbe2032c-173d-4363-8e8a-f85854c64198 1073741824 Jun 29 03:39:58 devstack sudo[112354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:39:59 devstack sudo[112354]: pam_unix(sudo:session): session closed for user root Jun 29 03:39:59 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-22e1c162-024a-4d2f-bad5-63fe67875e78 tempest-VolumesSnapshotTestJSON-1995063474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-dbe2032c-173d-4363-8e8a-f85854c64198 1073741824" returned: 0 in 0.865s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:39:59 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-22e1c162-024a-4d2f-bad5-63fe67875e78 tempest-VolumesSnapshotTestJSON-1995063474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-dbe2032c-173d-4363-8e8a-f85854c64198 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:39:59 devstack sudo[112359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-dbe2032c-173d-4363-8e8a-f85854c64198 Jun 29 03:39:59 devstack sudo[112359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:40:00 devstack sudo[112359]: pam_unix(sudo:session): session closed for user root Jun 29 03:40:00 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-22e1c162-024a-4d2f-bad5-63fe67875e78 tempest-VolumesSnapshotTestJSON-1995063474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-dbe2032c-173d-4363-8e8a-f85854c64198" returned: 0 in 0.676s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:40:00 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-22e1c162-024a-4d2f-bad5-63fe67875e78 tempest-VolumesSnapshotTestJSON-1995063474 None] <== create_volume: return (1586ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:40:00 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-22e1c162-024a-4d2f-bad5-63fe67875e78 tempest-VolumesSnapshotTestJSON-1995063474 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.588s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:40:00 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-22e1c162-024a-4d2f-bad5-63fe67875e78 tempest-VolumesSnapshotTestJSON-1995063474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (327cf6ef-313d-417c-a9e5-9d55c73766e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dbe2032c-173d-4363-8e8a-f85854c64198', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:40:00 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-22e1c162-024a-4d2f-bad5-63fe67875e78 tempest-VolumesSnapshotTestJSON-1995063474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc267f9c-ffd1-4a06-b3e4-83d602eb89fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:40:00 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-22e1c162-024a-4d2f-bad5-63fe67875e78 tempest-VolumesSnapshotTestJSON-1995063474 None] Volume volume-dbe2032c-173d-4363-8e8a-f85854c64198 (dbe2032c-173d-4363-8e8a-f85854c64198): created successfully Jun 29 03:40:00 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-22e1c162-024a-4d2f-bad5-63fe67875e78 tempest-VolumesSnapshotTestJSON-1995063474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc267f9c-ffd1-4a06-b3e4-83d602eb89fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:40:00 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-22e1c162-024a-4d2f-bad5-63fe67875e78 tempest-VolumesSnapshotTestJSON-1995063474 None] Flow 'volume_create_manager' (db2a9864-13c3-42c5-8068-6283992f177c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:40:00 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-22e1c162-024a-4d2f-bad5-63fe67875e78 tempest-VolumesSnapshotTestJSON-1995063474 None] Created volume successfully. Jun 29 03:40:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-ab8565b1-c12b-46d9-8c75-cb8c6e544726 tempest-VolumesSnapshotTestJSON-1995063474 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:40:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-ab8565b1-c12b-46d9-8c75-cb8c6e544726 tempest-VolumesSnapshotTestJSON-1995063474 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:40:01 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-ab8565b1-c12b-46d9-8c75-cb8c6e544726 tempest-VolumesSnapshotTestJSON-1995063474 None] Creating offline snapshot d1a6e3fe-443f-4175-b55e-a3c2d6374e9c of volume dbe2032c-173d-4363-8e8a-f85854c64198 {{(pid=93468) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 29 03:40:01 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[95d6f513-b93a-4c7e-8e1c-a6055e8ae872]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:40:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ab8565b1-c12b-46d9-8c75-cb8c6e544726 tempest-VolumesSnapshotTestJSON-1995063474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-dbe2032c-173d-4363-8e8a-f85854c64198 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:40:01 devstack sudo[112363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-dbe2032c-173d-4363-8e8a-f85854c64198 Jun 29 03:40:01 devstack sudo[112363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:40:01 devstack sudo[112363]: pam_unix(sudo:session): session closed for user root Jun 29 03:40:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ab8565b1-c12b-46d9-8c75-cb8c6e544726 tempest-VolumesSnapshotTestJSON-1995063474 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-dbe2032c-173d-4363-8e8a-f85854c64198" returned: 0 in 0.871s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:40:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ab8565b1-c12b-46d9-8c75-cb8c6e544726 tempest-VolumesSnapshotTestJSON-1995063474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-dbe2032c-173d-4363-8e8a-f85854c64198,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-dbe2032c-173d-4363-8e8a-f85854c64198.d1a6e3fe-443f-4175-b55e-a3c2d6374e9c 1G {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:40:01 devstack sudo[112369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-dbe2032c-173d-4363-8e8a-f85854c64198,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-dbe2032c-173d-4363-8e8a-f85854c64198.d1a6e3fe-443f-4175-b55e-a3c2d6374e9c 1G Jun 29 03:40:01 devstack sudo[112369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:40:02 devstack sudo[112369]: pam_unix(sudo:session): session closed for user root Jun 29 03:40:02 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ab8565b1-c12b-46d9-8c75-cb8c6e544726 tempest-VolumesSnapshotTestJSON-1995063474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-dbe2032c-173d-4363-8e8a-f85854c64198,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-dbe2032c-173d-4363-8e8a-f85854c64198.d1a6e3fe-443f-4175-b55e-a3c2d6374e9c 1G" returned: 0 in 0.919s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:40:02 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ab8565b1-c12b-46d9-8c75-cb8c6e544726 tempest-VolumesSnapshotTestJSON-1995063474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dbe2032c-173d-4363-8e8a-f85854c64198 -F qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-dbe2032c-173d-4363-8e8a-f85854c64198.d1a6e3fe-443f-4175-b55e-a3c2d6374e9c {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:40:02 devstack sudo[112375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dbe2032c-173d-4363-8e8a-f85854c64198 -F qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-dbe2032c-173d-4363-8e8a-f85854c64198.d1a6e3fe-443f-4175-b55e-a3c2d6374e9c Jun 29 03:40:02 devstack sudo[112375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:40:03 devstack sudo[112375]: pam_unix(sudo:session): session closed for user root Jun 29 03:40:03 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ab8565b1-c12b-46d9-8c75-cb8c6e544726 tempest-VolumesSnapshotTestJSON-1995063474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dbe2032c-173d-4363-8e8a-f85854c64198 -F qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-dbe2032c-173d-4363-8e8a-f85854c64198.d1a6e3fe-443f-4175-b55e-a3c2d6374e9c" returned: 0 in 0.751s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:40:03 devstack cinder-volume[93468]: WARNING cinder.volume.drivers.remotefs [None req-ab8565b1-c12b-46d9-8c75-cb8c6e544726 tempest-VolumesSnapshotTestJSON-1995063474 None] /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-dbe2032c-173d-4363-8e8a-f85854c64198.d1a6e3fe-443f-4175-b55e-a3c2d6374e9c is being set with open permissions: ugo+rw Jun 29 03:40:03 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ab8565b1-c12b-46d9-8c75-cb8c6e544726 tempest-VolumesSnapshotTestJSON-1995063474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-dbe2032c-173d-4363-8e8a-f85854c64198.d1a6e3fe-443f-4175-b55e-a3c2d6374e9c {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:40:03 devstack sudo[112380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-dbe2032c-173d-4363-8e8a-f85854c64198.d1a6e3fe-443f-4175-b55e-a3c2d6374e9c Jun 29 03:40:03 devstack sudo[112380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:40:04 devstack sudo[112380]: pam_unix(sudo:session): session closed for user root Jun 29 03:40:04 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ab8565b1-c12b-46d9-8c75-cb8c6e544726 tempest-VolumesSnapshotTestJSON-1995063474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-dbe2032c-173d-4363-8e8a-f85854c64198.d1a6e3fe-443f-4175-b55e-a3c2d6374e9c" returned: 0 in 0.678s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:40:04 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ab8565b1-c12b-46d9-8c75-cb8c6e544726 tempest-VolumesSnapshotTestJSON-1995063474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-dbe2032c-173d-4363-8e8a-f85854c64198.info {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:40:04 devstack sudo[112383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-dbe2032c-173d-4363-8e8a-f85854c64198.info Jun 29 03:40:04 devstack sudo[112383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:40:04 devstack sudo[112383]: pam_unix(sudo:session): session closed for user root Jun 29 03:40:04 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ab8565b1-c12b-46d9-8c75-cb8c6e544726 tempest-VolumesSnapshotTestJSON-1995063474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-dbe2032c-173d-4363-8e8a-f85854c64198.info" returned: 0 in 0.654s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:40:04 devstack cinder-volume[93468]: WARNING cinder.volume.drivers.remotefs [None req-ab8565b1-c12b-46d9-8c75-cb8c6e544726 tempest-VolumesSnapshotTestJSON-1995063474 None] /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-dbe2032c-173d-4363-8e8a-f85854c64198.info is being set with open permissions: ugo+rw Jun 29 03:40:04 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ab8565b1-c12b-46d9-8c75-cb8c6e544726 tempest-VolumesSnapshotTestJSON-1995063474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-dbe2032c-173d-4363-8e8a-f85854c64198.info {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:40:04 devstack sudo[112386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-dbe2032c-173d-4363-8e8a-f85854c64198.info Jun 29 03:40:04 devstack sudo[112386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:40:05 devstack sudo[112386]: pam_unix(sudo:session): session closed for user root Jun 29 03:40:05 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ab8565b1-c12b-46d9-8c75-cb8c6e544726 tempest-VolumesSnapshotTestJSON-1995063474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-dbe2032c-173d-4363-8e8a-f85854c64198.info" returned: 0 in 0.665s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:40:05 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-ab8565b1-c12b-46d9-8c75-cb8c6e544726 tempest-VolumesSnapshotTestJSON-1995063474 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.634s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:40:05 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-ab8565b1-c12b-46d9-8c75-cb8c6e544726 tempest-VolumesSnapshotTestJSON-1995063474 None] Create snapshot completed successfully Jun 29 03:40:06 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba83285d-5029-4930-a612-7903ca9ee550 tempest-VolumesSnapshotTestJSON-1995063474 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:40:06 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-ba83285d-5029-4930-a612-7903ca9ee550 tempest-VolumesSnapshotTestJSON-1995063474 None] Flow 'volume_create_manager' (6f3bb02a-b620-4d9e-82c6-7ec20bb4dbb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:40:06 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-ba83285d-5029-4930-a612-7903ca9ee550 tempest-VolumesSnapshotTestJSON-1995063474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad72e51e-3c48-4d99-90b3-3969f059d7ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:40:06 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-ba83285d-5029-4930-a612-7903ca9ee550 tempest-VolumesSnapshotTestJSON-1995063474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad72e51e-3c48-4d99-90b3-3969f059d7ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:40:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1988133436',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e12e6690-75c7-4eb9-bff3-9a34ad99b7f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57e1750da8ab427786e9129ab400acb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:40:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=d1a6e3fe-443f-4175-b55e-a3c2d6374e9c,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:40:07Z,use_quota=True,user_id='87d6a117819e42218c0e3a501737fab7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:40:06 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-ba83285d-5029-4930-a612-7903ca9ee550 tempest-VolumesSnapshotTestJSON-1995063474 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b14781a6-1e31-4b8d-985e-c073736782aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:40:06 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-ba83285d-5029-4930-a612-7903ca9ee550 tempest-VolumesSnapshotTestJSON-1995063474 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b14781a6-1e31-4b8d-985e-c073736782aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:40:06 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-ba83285d-5029-4930-a612-7903ca9ee550 tempest-VolumesSnapshotTestJSON-1995063474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (845ed23b-4c03-448c-a873-21ff3db42496) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:40:06 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-ba83285d-5029-4930-a612-7903ca9ee550 tempest-VolumesSnapshotTestJSON-1995063474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (845ed23b-4c03-448c-a873-21ff3db42496) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'e12e6690-75c7-4eb9-bff3-9a34ad99b7f7', 'volume_name': 'volume-e12e6690-75c7-4eb9-bff3-9a34ad99b7f7', 'volume_size': 1, 'snapshot_id': 'd1a6e3fe-443f-4175-b55e-a3c2d6374e9c'}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:40:06 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-ba83285d-5029-4930-a612-7903ca9ee550 tempest-VolumesSnapshotTestJSON-1995063474 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (717f9ecb-8e11-4b66-8cb0-0774166d4681) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:40:06 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-ba83285d-5029-4930-a612-7903ca9ee550 tempest-VolumesSnapshotTestJSON-1995063474 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (717f9ecb-8e11-4b66-8cb0-0774166d4681) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:40:06 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-ba83285d-5029-4930-a612-7903ca9ee550 tempest-VolumesSnapshotTestJSON-1995063474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8277e16-a811-4485-af6c-072ca2c75237) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:40:06 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-ba83285d-5029-4930-a612-7903ca9ee550 tempest-VolumesSnapshotTestJSON-1995063474 None] Volume e12e6690-75c7-4eb9-bff3-9a34ad99b7f7: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-e12e6690-75c7-4eb9-bff3-9a34ad99b7f7', 'volume_size': 1, 'snapshot_id': 'd1a6e3fe-443f-4175-b55e-a3c2d6374e9c'} Jun 29 03:40:06 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-ba83285d-5029-4930-a612-7903ca9ee550 tempest-VolumesSnapshotTestJSON-1995063474 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:40:06 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-ba83285d-5029-4930-a612-7903ca9ee550 tempest-VolumesSnapshotTestJSON-1995063474 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:40:06 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-ba83285d-5029-4930-a612-7903ca9ee550 tempest-VolumesSnapshotTestJSON-1995063474 None] Acquiring lock "cinder-quobyte-d1a6e3fe-443f-4175-b55e-a3c2d6374e9c-e12e6690-75c7-4eb9-bff3-9a34ad99b7f7" by "_create_volume_from_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:40:06 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-ba83285d-5029-4930-a612-7903ca9ee550 tempest-VolumesSnapshotTestJSON-1995063474 None] Lock "cinder-quobyte-d1a6e3fe-443f-4175-b55e-a3c2d6374e9c-e12e6690-75c7-4eb9-bff3-9a34ad99b7f7" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:40:06 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-ba83285d-5029-4930-a612-7903ca9ee550 tempest-VolumesSnapshotTestJSON-1995063474 None] Creating volume e12e6690-75c7-4eb9-bff3-9a34ad99b7f7 from snapshot d1a6e3fe-443f-4175-b55e-a3c2d6374e9c {{(pid=93468) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 29 03:40:06 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-ba83285d-5029-4930-a612-7903ca9ee550 tempest-VolumesSnapshotTestJSON-1995063474 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:40:06 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-ba83285d-5029-4930-a612-7903ca9ee550 tempest-VolumesSnapshotTestJSON-1995063474 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:40:06 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-ba83285d-5029-4930-a612-7903ca9ee550 tempest-VolumesSnapshotTestJSON-1995063474 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:40:06 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-ba83285d-5029-4930-a612-7903ca9ee550 tempest-VolumesSnapshotTestJSON-1995063474 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:40:06 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-ba83285d-5029-4930-a612-7903ca9ee550 tempest-VolumesSnapshotTestJSON-1995063474 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:40:06 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-ba83285d-5029-4930-a612-7903ca9ee550 tempest-VolumesSnapshotTestJSON-1995063474 None] Selected osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:40:06 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-ba83285d-5029-4930-a612-7903ca9ee550 tempest-VolumesSnapshotTestJSON-1995063474 None] Acquiring lock "cinder-quobyte-e12e6690-75c7-4eb9-bff3-9a34ad99b7f7" by "_copy_volume_from_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:40:06 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-ba83285d-5029-4930-a612-7903ca9ee550 tempest-VolumesSnapshotTestJSON-1995063474 None] Lock "cinder-quobyte-e12e6690-75c7-4eb9-bff3-9a34ad99b7f7" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:40:06 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-ba83285d-5029-4930-a612-7903ca9ee550 tempest-VolumesSnapshotTestJSON-1995063474 None] snapshot: d1a6e3fe-443f-4175-b55e-a3c2d6374e9c, volume: e12e6690-75c7-4eb9-bff3-9a34ad99b7f7, {{(pid=93468) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 29 03:40:06 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-ba83285d-5029-4930-a612-7903ca9ee550 tempest-VolumesSnapshotTestJSON-1995063474 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:40:06 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-ba83285d-5029-4930-a612-7903ca9ee550 tempest-VolumesSnapshotTestJSON-1995063474 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:40:06 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-ba83285d-5029-4930-a612-7903ca9ee550 tempest-VolumesSnapshotTestJSON-1995063474 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:40:06 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-ba83285d-5029-4930-a612-7903ca9ee550 tempest-VolumesSnapshotTestJSON-1995063474 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:40:06 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-ba83285d-5029-4930-a612-7903ca9ee550 tempest-VolumesSnapshotTestJSON-1995063474 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:40:06 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[9adb8211-8afa-4b4b-a45c-ad971e05f1fc]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:40:06 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ba83285d-5029-4930-a612-7903ca9ee550 tempest-VolumesSnapshotTestJSON-1995063474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-dbe2032c-173d-4363-8e8a-f85854c64198.d1a6e3fe-443f-4175-b55e-a3c2d6374e9c {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:40:07 devstack sudo[112389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-dbe2032c-173d-4363-8e8a-f85854c64198.d1a6e3fe-443f-4175-b55e-a3c2d6374e9c Jun 29 03:40:07 devstack sudo[112389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:40:07 devstack sudo[112389]: pam_unix(sudo:session): session closed for user root Jun 29 03:40:07 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ba83285d-5029-4930-a612-7903ca9ee550 tempest-VolumesSnapshotTestJSON-1995063474 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-dbe2032c-173d-4363-8e8a-f85854c64198.d1a6e3fe-443f-4175-b55e-a3c2d6374e9c" returned: 0 in 0.791s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:40:07 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-ba83285d-5029-4930-a612-7903ca9ee550 tempest-VolumesSnapshotTestJSON-1995063474 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dbe2032c-173d-4363-8e8a-f85854c64198(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93468) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 29 03:40:07 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-ba83285d-5029-4930-a612-7903ca9ee550 tempest-VolumesSnapshotTestJSON-1995063474 None] will copy from snapshot at /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-dbe2032c-173d-4363-8e8a-f85854c64198 {{(pid=93468) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 29 03:40:07 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-ba83285d-5029-4930-a612-7903ca9ee550 tempest-VolumesSnapshotTestJSON-1995063474 None] Creating direct copy from snapshot {{(pid=93468) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 29 03:40:07 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[031f169a-0b0d-498d-9a42-421e51f7e9c0]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:40:07 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ba83285d-5029-4930-a612-7903ca9ee550 tempest-VolumesSnapshotTestJSON-1995063474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-dbe2032c-173d-4363-8e8a-f85854c64198 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:40:07 devstack sudo[112394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-dbe2032c-173d-4363-8e8a-f85854c64198 Jun 29 03:40:07 devstack sudo[112394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:40:08 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-d994b5ba-581f-4ca3-84a2-3937a8938d61 tempest-VolumeAndVolumeTypeFromImageTest-1619514416 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:40:08 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-d994b5ba-581f-4ca3-84a2-3937a8938d61 tempest-VolumeAndVolumeTypeFromImageTest-1619514416 None] Flow 'volume_create_manager' (2ccc2feb-829a-43d7-bd4a-70d55fe2502e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:40:08 devstack sudo[112394]: pam_unix(sudo:session): session closed for user root Jun 29 03:40:08 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-d994b5ba-581f-4ca3-84a2-3937a8938d61 tempest-VolumeAndVolumeTypeFromImageTest-1619514416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8df0325c-fcdc-43e6-8e7e-ad9753222f50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:40:08 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ba83285d-5029-4930-a612-7903ca9ee550 tempest-VolumesSnapshotTestJSON-1995063474 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-dbe2032c-173d-4363-8e8a-f85854c64198" returned: 0 in 0.777s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:40:08 devstack cinder-volume[93468]: DEBUG cinder.utils [None req-ba83285d-5029-4930-a612-7903ca9ee550 tempest-VolumesSnapshotTestJSON-1995063474 None] Path /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-e12e6690-75c7-4eb9-bff3-9a34ad99b7f7 not found in is_blk_device check {{(pid=93468) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 29 03:40:08 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ba83285d-5029-4930-a612-7903ca9ee550 tempest-VolumesSnapshotTestJSON-1995063474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-dbe2032c-173d-4363-8e8a-f85854c64198 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-e12e6690-75c7-4eb9-bff3-9a34ad99b7f7 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:40:08 devstack sudo[112399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-dbe2032c-173d-4363-8e8a-f85854c64198 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-e12e6690-75c7-4eb9-bff3-9a34ad99b7f7 Jun 29 03:40:08 devstack sudo[112399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:40:08 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-d994b5ba-581f-4ca3-84a2-3937a8938d61 tempest-VolumeAndVolumeTypeFromImageTest-1619514416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8df0325c-fcdc-43e6-8e7e-ad9753222f50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:40:08Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2079bf51-be37-43ab-bf25-851be80bf8d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16bc4aa200e4457ba23d99d6272c9bde',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:40:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:40:08Z,use_quota=True,user_id='23428b5dda314be098a2f4791e15d5b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85c019ab-79e4-43e3-8e3e-9e6310e50117),volume_type_id=85c019ab-79e4-43e3-8e3e-9e6310e50117)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:40:08 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-d994b5ba-581f-4ca3-84a2-3937a8938d61 tempest-VolumeAndVolumeTypeFromImageTest-1619514416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c81ca6ba-5074-47f2-85d8-08bc90b3e64d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:40:08 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-d994b5ba-581f-4ca3-84a2-3937a8938d61 tempest-VolumeAndVolumeTypeFromImageTest-1619514416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c81ca6ba-5074-47f2-85d8-08bc90b3e64d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:40:08 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-d994b5ba-581f-4ca3-84a2-3937a8938d61 tempest-VolumeAndVolumeTypeFromImageTest-1619514416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ac418a5-ccca-463e-9d1b-fdb27d7d5c23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:40:08 devstack cinder-volume[93468]: DEBUG cinder.image.glance [None req-d994b5ba-581f-4ca3-84a2-3937a8938d61 tempest-VolumeAndVolumeTypeFromImageTest-1619514416 None] Creating Keystone auth plugin from conf {{(pid=93468) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 29 03:40:08 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-d994b5ba-581f-4ca3-84a2-3937a8938d61 tempest-VolumeAndVolumeTypeFromImageTest-1619514416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ac418a5-ccca-463e-9d1b-fdb27d7d5c23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '2079bf51-be37-43ab-bf25-851be80bf8d3', 'volume_name': 'volume-2079bf51-be37-43ab-bf25-851be80bf8d3', 'volume_size': 1, 'image_id': '003fe47f-7c94-4a75-95e7-7eb642873121', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/003fe47f-7c94-4a75-95e7-7eb642873121', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'fe6305cb15d273175add6f7cdcc719cd', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '16bc4aa200e4457ba23d99d6272c9bde', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '21d17bffed646bd9b7046045d0421e2b5a7904cf185f4cfac8027d772f5b8735f16a5e871912be05185fa6e43684513fd6c3285be6d70d0f1d982b6d4b5c4857', 'id': '003fe47f-7c94-4a75-95e7-7eb642873121', 'created_at': datetime.datetime(2026, 6, 29, 1, 40, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 29, 1, 40, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/003fe47f-7c94-4a75-95e7-7eb642873121/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:40:08 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-d994b5ba-581f-4ca3-84a2-3937a8938d61 tempest-VolumeAndVolumeTypeFromImageTest-1619514416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17082936-8bb7-41a6-b6d5-fed568e676d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:40:08 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-d994b5ba-581f-4ca3-84a2-3937a8938d61 tempest-VolumeAndVolumeTypeFromImageTest-1619514416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17082936-8bb7-41a6-b6d5-fed568e676d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:40:08 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-d994b5ba-581f-4ca3-84a2-3937a8938d61 tempest-VolumeAndVolumeTypeFromImageTest-1619514416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ed5b7dd-5803-44b1-a8fa-5b0e1a9ed4f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:40:08 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-d994b5ba-581f-4ca3-84a2-3937a8938d61 tempest-VolumeAndVolumeTypeFromImageTest-1619514416 None] Volume 2079bf51-be37-43ab-bf25-851be80bf8d3: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-2079bf51-be37-43ab-bf25-851be80bf8d3', 'volume_size': 1, 'image_id': '003fe47f-7c94-4a75-95e7-7eb642873121', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/003fe47f-7c94-4a75-95e7-7eb642873121', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'fe6305cb15d273175add6f7cdcc719cd', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '16bc4aa200e4457ba23d99d6272c9bde', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '21d17bffed646bd9b7046045d0421e2b5a7904cf185f4cfac8027d772f5b8735f16a5e871912be05185fa6e43684513fd6c3285be6d70d0f1d982b6d4b5c4857', 'id': '003fe47f-7c94-4a75-95e7-7eb642873121', 'created_at': datetime.datetime(2026, 6, 29, 1, 40, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 29, 1, 40, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/003fe47f-7c94-4a75-95e7-7eb642873121/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jun 29 03:40:08 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-d994b5ba-581f-4ca3-84a2-3937a8938d61 tempest-VolumeAndVolumeTypeFromImageTest-1619514416 None] Trying to clone 2079bf51-be37-43ab-bf25-851be80bf8d3 from image 003fe47f-7c94-4a75-95e7-7eb642873121 at location (None, [{'url': 'file:///opt/stack/data/glance/images/003fe47f-7c94-4a75-95e7-7eb642873121', 'metadata': {}}]). {{(pid=93468) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 29 03:40:08 devstack cinder-volume[93468]: DEBUG cinder.image.image_utils [None req-d994b5ba-581f-4ca3-84a2-3937a8938d61 tempest-VolumeAndVolumeTypeFromImageTest-1619514416 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_003fe47f-7c94-4a75-95e7-7eb642873121_zs5skvqbdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=93468) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 29 03:40:08 devstack cinder-volume[93468]: INFO cinder.image.image_utils [None req-d994b5ba-581f-4ca3-84a2-3937a8938d61 tempest-VolumeAndVolumeTypeFromImageTest-1619514416 None] Image download 0.00 MB at 0.00 MB/s Jun 29 03:40:09 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[70c16b0d-ac21-4ce9-8af5-9ecd91eb5431]: (4, 'raw') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:40:09 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d994b5ba-581f-4ca3-84a2-3937a8938d61 tempest-VolumeAndVolumeTypeFromImageTest-1619514416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_003fe47f-7c94-4a75-95e7-7eb642873121_zs5skvqbdevstack@QuobyteHD {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:40:09 devstack sudo[112401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_003fe47f-7c94-4a75-95e7-7eb642873121_zs5skvqbdevstack@QuobyteHD Jun 29 03:40:09 devstack sudo[112401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:40:10 devstack sudo[112401]: pam_unix(sudo:session): session closed for user root Jun 29 03:40:10 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d994b5ba-581f-4ca3-84a2-3937a8938d61 tempest-VolumeAndVolumeTypeFromImageTest-1619514416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_003fe47f-7c94-4a75-95e7-7eb642873121_zs5skvqbdevstack@QuobyteHD" returned: 0 in 1.109s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:40:10 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d994b5ba-581f-4ca3-84a2-3937a8938d61 tempest-VolumeAndVolumeTypeFromImageTest-1619514416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_003fe47f-7c94-4a75-95e7-7eb642873121_zs5skvqbdevstack@QuobyteHD {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:40:10 devstack sudo[112415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_003fe47f-7c94-4a75-95e7-7eb642873121_zs5skvqbdevstack@QuobyteHD Jun 29 03:40:10 devstack sudo[112415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:40:11 devstack sudo[112415]: pam_unix(sudo:session): session closed for user root Jun 29 03:40:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d994b5ba-581f-4ca3-84a2-3937a8938d61 tempest-VolumeAndVolumeTypeFromImageTest-1619514416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_003fe47f-7c94-4a75-95e7-7eb642873121_zs5skvqbdevstack@QuobyteHD" returned: 1 in 1.270s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:40:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d994b5ba-581f-4ca3-84a2-3937a8938d61 tempest-VolumeAndVolumeTypeFromImageTest-1619514416 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_003fe47f-7c94-4a75-95e7-7eb642873121_zs5skvqbdevstack@QuobyteHD' failed. Not Retrying. {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 29 03:40:11 devstack cinder-volume[93468]: DEBUG cinder.image.image_utils [None req-d994b5ba-581f-4ca3-84a2-3937a8938d61 tempest-VolumeAndVolumeTypeFromImageTest-1619514416 None] Temporary image 003fe47f-7c94-4a75-95e7-7eb642873121 is fetched for user 23428b5dda314be098a2f4791e15d5b0. {{(pid=93468) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 29 03:40:11 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[19ece4b0-e29c-4f75-ace4-18087e49d660]: (4, 'raw') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:40:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d994b5ba-581f-4ca3-84a2-3937a8938d61 tempest-VolumeAndVolumeTypeFromImageTest-1619514416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_003fe47f-7c94-4a75-95e7-7eb642873121_zs5skvqbdevstack@QuobyteHD {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:40:11 devstack sudo[112421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_003fe47f-7c94-4a75-95e7-7eb642873121_zs5skvqbdevstack@QuobyteHD Jun 29 03:40:11 devstack sudo[112421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:40:11 devstack cinder-volume[93468]: DEBUG oslo_service.periodic_task [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93468) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 29 03:40:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:40:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:40:11 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:40:11 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:40:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:40:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:40:12 devstack sudo[112424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf Jun 29 03:40:12 devstack sudo[112424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:40:13 devstack sudo[112421]: pam_unix(sudo:session): session closed for user root Jun 29 03:40:13 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d994b5ba-581f-4ca3-84a2-3937a8938d61 tempest-VolumeAndVolumeTypeFromImageTest-1619514416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_003fe47f-7c94-4a75-95e7-7eb642873121_zs5skvqbdevstack@QuobyteHD" returned: 0 in 1.429s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:40:13 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d994b5ba-581f-4ca3-84a2-3937a8938d61 tempest-VolumeAndVolumeTypeFromImageTest-1619514416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_003fe47f-7c94-4a75-95e7-7eb642873121_zs5skvqbdevstack@QuobyteHD {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:40:13 devstack sudo[112424]: pam_unix(sudo:session): session closed for user root Jun 29 03:40:13 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf" returned: 0 in 1.173s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:40:13 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:40:13 devstack cinder-volume[93468]: DEBUG oslo_service.periodic_task [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Running periodic task VolumeManager._thread_info {{(pid=93468) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 29 03:40:13 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] thread count: 28 {{(pid=93468) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 29 03:40:13 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] thread info: [<_MainThread(MainThread, started 132331377287296)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93468) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 29 03:40:13 devstack sudo[112429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_003fe47f-7c94-4a75-95e7-7eb642873121_zs5skvqbdevstack@QuobyteHD Jun 29 03:40:13 devstack sudo[112429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:40:13 devstack sudo[112399]: pam_unix(sudo:session): session closed for user root Jun 29 03:40:13 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ba83285d-5029-4930-a612-7903ca9ee550 tempest-VolumesSnapshotTestJSON-1995063474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-dbe2032c-173d-4363-8e8a-f85854c64198 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-e12e6690-75c7-4eb9-bff3-9a34ad99b7f7" returned: 0 in 5.349s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:40:13 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6971655-0625-48fd-ac9a-3b8477d91f86]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:40:13 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ba83285d-5029-4930-a612-7903ca9ee550 tempest-VolumesSnapshotTestJSON-1995063474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-dbe2032c-173d-4363-8e8a-f85854c64198 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:40:14 devstack sudo[112431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-dbe2032c-173d-4363-8e8a-f85854c64198 Jun 29 03:40:14 devstack sudo[112431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:40:14 devstack sudo[112429]: pam_unix(sudo:session): session closed for user root Jun 29 03:40:14 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d994b5ba-581f-4ca3-84a2-3937a8938d61 tempest-VolumeAndVolumeTypeFromImageTest-1619514416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_003fe47f-7c94-4a75-95e7-7eb642873121_zs5skvqbdevstack@QuobyteHD" returned: 1 in 1.024s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:40:14 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d994b5ba-581f-4ca3-84a2-3937a8938d61 tempest-VolumeAndVolumeTypeFromImageTest-1619514416 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_003fe47f-7c94-4a75-95e7-7eb642873121_zs5skvqbdevstack@QuobyteHD' failed. Not Retrying. {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 29 03:40:14 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-d994b5ba-581f-4ca3-84a2-3937a8938d61 tempest-VolumeAndVolumeTypeFromImageTest-1619514416 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:40:14 devstack sudo[112431]: pam_unix(sudo:session): session closed for user root Jun 29 03:40:14 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ba83285d-5029-4930-a612-7903ca9ee550 tempest-VolumesSnapshotTestJSON-1995063474 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-dbe2032c-173d-4363-8e8a-f85854c64198" returned: 0 in 0.965s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:40:14 devstack cinder-volume[93468]: DEBUG cinder.image.image_utils [None req-ba83285d-5029-4930-a612-7903ca9ee550 tempest-VolumesSnapshotTestJSON-1995063474 None] Image conversion details: src /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-dbe2032c-173d-4363-8e8a-f85854c64198, size 1024.00 MB, duration 5.35 sec, destination /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-e12e6690-75c7-4eb9-bff3-9a34ad99b7f7 {{(pid=93468) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 29 03:40:14 devstack cinder-volume[93468]: INFO cinder.image.image_utils [None req-ba83285d-5029-4930-a612-7903ca9ee550 tempest-VolumesSnapshotTestJSON-1995063474 None] Converted 1024.00 MB image at 191.40 MB/s Jun 29 03:40:14 devstack cinder-volume[93468]: WARNING cinder.volume.drivers.remotefs [None req-ba83285d-5029-4930-a612-7903ca9ee550 tempest-VolumesSnapshotTestJSON-1995063474 None] /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-e12e6690-75c7-4eb9-bff3-9a34ad99b7f7 is being set with open permissions: ugo+rw Jun 29 03:40:14 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ba83285d-5029-4930-a612-7903ca9ee550 tempest-VolumesSnapshotTestJSON-1995063474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-e12e6690-75c7-4eb9-bff3-9a34ad99b7f7 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:40:14 devstack sudo[112444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-e12e6690-75c7-4eb9-bff3-9a34ad99b7f7 Jun 29 03:40:14 devstack sudo[112444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:40:15 devstack sudo[112444]: pam_unix(sudo:session): session closed for user root Jun 29 03:40:15 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ba83285d-5029-4930-a612-7903ca9ee550 tempest-VolumesSnapshotTestJSON-1995063474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-e12e6690-75c7-4eb9-bff3-9a34ad99b7f7" returned: 0 in 0.658s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:40:15 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-ba83285d-5029-4930-a612-7903ca9ee550 tempest-VolumesSnapshotTestJSON-1995063474 None] Lock "cinder-quobyte-e12e6690-75c7-4eb9-bff3-9a34ad99b7f7" released by "_copy_volume_from_snapshot" :: held 8.639s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:40:15 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-ba83285d-5029-4930-a612-7903ca9ee550 tempest-VolumesSnapshotTestJSON-1995063474 None] Lock "cinder-quobyte-d1a6e3fe-443f-4175-b55e-a3c2d6374e9c-e12e6690-75c7-4eb9-bff3-9a34ad99b7f7" released by "_create_volume_from_snapshot" :: held 8.668s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:40:15 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-ba83285d-5029-4930-a612-7903ca9ee550 tempest-VolumesSnapshotTestJSON-1995063474 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.683s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:40:15 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-d994b5ba-581f-4ca3-84a2-3937a8938d61 tempest-VolumeAndVolumeTypeFromImageTest-1619514416 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.514s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:40:15 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-d994b5ba-581f-4ca3-84a2-3937a8938d61 tempest-VolumeAndVolumeTypeFromImageTest-1619514416 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:40:08Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2079bf51-be37-43ab-bf25-851be80bf8d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16bc4aa200e4457ba23d99d6272c9bde',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:40:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:40:08Z,use_quota=True,user_id='23428b5dda314be098a2f4791e15d5b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85c019ab-79e4-43e3-8e3e-9e6310e50117),volume_type_id=85c019ab-79e4-43e3-8e3e-9e6310e50117)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:40:15 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-d994b5ba-581f-4ca3-84a2-3937a8938d61 tempest-VolumeAndVolumeTypeFromImageTest-1619514416 None] Creating volume 2079bf51-be37-43ab-bf25-851be80bf8d3 {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:40:15 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-d994b5ba-581f-4ca3-84a2-3937a8938d61 tempest-VolumeAndVolumeTypeFromImageTest-1619514416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:40:15 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-d994b5ba-581f-4ca3-84a2-3937a8938d61 tempest-VolumeAndVolumeTypeFromImageTest-1619514416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:40:15 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-d994b5ba-581f-4ca3-84a2-3937a8938d61 tempest-VolumeAndVolumeTypeFromImageTest-1619514416 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:40:15 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-d994b5ba-581f-4ca3-84a2-3937a8938d61 tempest-VolumeAndVolumeTypeFromImageTest-1619514416 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:40:15 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-d994b5ba-581f-4ca3-84a2-3937a8938d61 tempest-VolumeAndVolumeTypeFromImageTest-1619514416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:40:15 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-d994b5ba-581f-4ca3-84a2-3937a8938d61 tempest-VolumeAndVolumeTypeFromImageTest-1619514416 None] Selected osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:40:15 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-d994b5ba-581f-4ca3-84a2-3937a8938d61 tempest-VolumeAndVolumeTypeFromImageTest-1619514416 None] casted to osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f Jun 29 03:40:15 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d994b5ba-581f-4ca3-84a2-3937a8938d61 tempest-VolumeAndVolumeTypeFromImageTest-1619514416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-2079bf51-be37-43ab-bf25-851be80bf8d3 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:40:15 devstack sudo[112447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-2079bf51-be37-43ab-bf25-851be80bf8d3 1073741824 Jun 29 03:40:15 devstack sudo[112447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:40:15 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-ba83285d-5029-4930-a612-7903ca9ee550 tempest-VolumesSnapshotTestJSON-1995063474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8277e16-a811-4485-af6c-072ca2c75237) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e12e6690-75c7-4eb9-bff3-9a34ad99b7f7', 'volume_size': 1, 'snapshot_id': 'd1a6e3fe-443f-4175-b55e-a3c2d6374e9c'}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:40:15 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-ba83285d-5029-4930-a612-7903ca9ee550 tempest-VolumesSnapshotTestJSON-1995063474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49377b07-aba6-4901-99d7-f7cec814a0b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:40:15 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-ba83285d-5029-4930-a612-7903ca9ee550 tempest-VolumesSnapshotTestJSON-1995063474 None] Volume volume-e12e6690-75c7-4eb9-bff3-9a34ad99b7f7 (e12e6690-75c7-4eb9-bff3-9a34ad99b7f7): created successfully Jun 29 03:40:15 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-ba83285d-5029-4930-a612-7903ca9ee550 tempest-VolumesSnapshotTestJSON-1995063474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49377b07-aba6-4901-99d7-f7cec814a0b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:40:15 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-ba83285d-5029-4930-a612-7903ca9ee550 tempest-VolumesSnapshotTestJSON-1995063474 None] Flow 'volume_create_manager' (6f3bb02a-b620-4d9e-82c6-7ec20bb4dbb7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:40:15 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-ba83285d-5029-4930-a612-7903ca9ee550 tempest-VolumesSnapshotTestJSON-1995063474 None] Created volume successfully. Jun 29 03:40:16 devstack sudo[112447]: pam_unix(sudo:session): session closed for user root Jun 29 03:40:16 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d994b5ba-581f-4ca3-84a2-3937a8938d61 tempest-VolumeAndVolumeTypeFromImageTest-1619514416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-2079bf51-be37-43ab-bf25-851be80bf8d3 1073741824" returned: 0 in 0.806s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:40:16 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d994b5ba-581f-4ca3-84a2-3937a8938d61 tempest-VolumeAndVolumeTypeFromImageTest-1619514416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-2079bf51-be37-43ab-bf25-851be80bf8d3 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:40:16 devstack sudo[112452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-2079bf51-be37-43ab-bf25-851be80bf8d3 Jun 29 03:40:16 devstack sudo[112452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:40:16 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-8e6829b9-f93e-4590-a8cc-bbce72ddbc7f tempest-VolumesSnapshotTestJSON-1995063474 None] Acquiring lock "cinder-e12e6690-75c7-4eb9-bff3-9a34ad99b7f7-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:40:16 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-8e6829b9-f93e-4590-a8cc-bbce72ddbc7f tempest-VolumesSnapshotTestJSON-1995063474 None] Lock "cinder-e12e6690-75c7-4eb9-bff3-9a34ad99b7f7-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:40:16 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-8e6829b9-f93e-4590-a8cc-bbce72ddbc7f tempest-VolumesSnapshotTestJSON-1995063474 None] Acquiring lock "cinder-quobyte-e12e6690-75c7-4eb9-bff3-9a34ad99b7f7" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:40:16 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-8e6829b9-f93e-4590-a8cc-bbce72ddbc7f tempest-VolumesSnapshotTestJSON-1995063474 None] Lock "cinder-quobyte-e12e6690-75c7-4eb9-bff3-9a34ad99b7f7" acquired by "delete_volume" :: waited 0.014s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:40:16 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[23301327-e1f6-4805-bcf8-7c128de1e086]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:40:16 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-8e6829b9-f93e-4590-a8cc-bbce72ddbc7f tempest-VolumesSnapshotTestJSON-1995063474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-e12e6690-75c7-4eb9-bff3-9a34ad99b7f7 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:40:17 devstack sudo[112456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-e12e6690-75c7-4eb9-bff3-9a34ad99b7f7 Jun 29 03:40:17 devstack sudo[112456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:40:17 devstack sudo[112452]: pam_unix(sudo:session): session closed for user root Jun 29 03:40:17 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d994b5ba-581f-4ca3-84a2-3937a8938d61 tempest-VolumeAndVolumeTypeFromImageTest-1619514416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-2079bf51-be37-43ab-bf25-851be80bf8d3" returned: 0 in 0.648s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:40:17 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-d994b5ba-581f-4ca3-84a2-3937a8938d61 tempest-VolumeAndVolumeTypeFromImageTest-1619514416 None] <== create_volume: return (1493ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:40:17 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-d994b5ba-581f-4ca3-84a2-3937a8938d61 tempest-VolumeAndVolumeTypeFromImageTest-1619514416 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.496s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:40:17 devstack cinder-volume[93468]: DEBUG cinder.volume.volume_utils [None req-d994b5ba-581f-4ca3-84a2-3937a8938d61 tempest-VolumeAndVolumeTypeFromImageTest-1619514416 None] Attempting download of 003fe47f-7c94-4a75-95e7-7eb642873121 ((None, [{'url': 'file:///opt/stack/data/glance/images/003fe47f-7c94-4a75-95e7-7eb642873121', 'metadata': {}}])) to volume 2079bf51-be37-43ab-bf25-851be80bf8d3. {{(pid=93468) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 29 03:40:17 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[173eb1c0-f640-4060-aeca-568a4f0b4e1d]: (4, 'raw') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:40:17 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d994b5ba-581f-4ca3-84a2-3937a8938d61 tempest-VolumeAndVolumeTypeFromImageTest-1619514416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_003fe47f-7c94-4a75-95e7-7eb642873121_sifcivpw {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:40:17 devstack sudo[112459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_003fe47f-7c94-4a75-95e7-7eb642873121_sifcivpw Jun 29 03:40:17 devstack sudo[112459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:40:17 devstack sudo[112456]: pam_unix(sudo:session): session closed for user root Jun 29 03:40:17 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-8e6829b9-f93e-4590-a8cc-bbce72ddbc7f tempest-VolumesSnapshotTestJSON-1995063474 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-e12e6690-75c7-4eb9-bff3-9a34ad99b7f7" returned: 0 in 0.759s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:40:17 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-8e6829b9-f93e-4590-a8cc-bbce72ddbc7f tempest-VolumesSnapshotTestJSON-1995063474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-e12e6690-75c7-4eb9-bff3-9a34ad99b7f7 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:40:17 devstack sudo[112464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-e12e6690-75c7-4eb9-bff3-9a34ad99b7f7 Jun 29 03:40:17 devstack sudo[112464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:40:17 devstack sudo[112459]: pam_unix(sudo:session): session closed for user root Jun 29 03:40:17 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d994b5ba-581f-4ca3-84a2-3937a8938d61 tempest-VolumeAndVolumeTypeFromImageTest-1619514416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_003fe47f-7c94-4a75-95e7-7eb642873121_sifcivpw" returned: 0 in 0.739s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:40:17 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d994b5ba-581f-4ca3-84a2-3937a8938d61 tempest-VolumeAndVolumeTypeFromImageTest-1619514416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_003fe47f-7c94-4a75-95e7-7eb642873121_sifcivpw {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:40:18 devstack sudo[112468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_003fe47f-7c94-4a75-95e7-7eb642873121_sifcivpw Jun 29 03:40:18 devstack sudo[112468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:40:18 devstack sudo[112464]: pam_unix(sudo:session): session closed for user root Jun 29 03:40:18 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-8e6829b9-f93e-4590-a8cc-bbce72ddbc7f tempest-VolumesSnapshotTestJSON-1995063474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-e12e6690-75c7-4eb9-bff3-9a34ad99b7f7" returned: 0 in 0.657s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:40:18 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-8e6829b9-f93e-4590-a8cc-bbce72ddbc7f tempest-VolumesSnapshotTestJSON-1995063474 None] Lock "cinder-quobyte-e12e6690-75c7-4eb9-bff3-9a34ad99b7f7" released by "delete_volume" :: held 1.460s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:40:18 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-8e6829b9-f93e-4590-a8cc-bbce72ddbc7f tempest-VolumesSnapshotTestJSON-1995063474 None] Created reservations ['20d91fd3-7e0f-480c-b588-c84de262a53c', '0e945b84-59f3-44a9-a63c-4f01e8632630', '49c5be3e-0e74-4478-a71a-bc4366d1a9a6', 'b6e0a3a0-003c-408a-a1e6-795cb3c9c990'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:40:18 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-8e6829b9-f93e-4590-a8cc-bbce72ddbc7f tempest-VolumesSnapshotTestJSON-1995063474 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:40:18 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-8e6829b9-f93e-4590-a8cc-bbce72ddbc7f tempest-VolumesSnapshotTestJSON-1995063474 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:40:18 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-8e6829b9-f93e-4590-a8cc-bbce72ddbc7f tempest-VolumesSnapshotTestJSON-1995063474 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:40:18 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-8e6829b9-f93e-4590-a8cc-bbce72ddbc7f tempest-VolumesSnapshotTestJSON-1995063474 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:40:18 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-8e6829b9-f93e-4590-a8cc-bbce72ddbc7f tempest-VolumesSnapshotTestJSON-1995063474 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:40:18 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-8e6829b9-f93e-4590-a8cc-bbce72ddbc7f tempest-VolumesSnapshotTestJSON-1995063474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:40:18 devstack sudo[112471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf Jun 29 03:40:18 devstack sudo[112471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:40:18 devstack sudo[112468]: pam_unix(sudo:session): session closed for user root Jun 29 03:40:18 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d994b5ba-581f-4ca3-84a2-3937a8938d61 tempest-VolumeAndVolumeTypeFromImageTest-1619514416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_003fe47f-7c94-4a75-95e7-7eb642873121_sifcivpw" returned: 1 in 0.762s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:40:18 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d994b5ba-581f-4ca3-84a2-3937a8938d61 tempest-VolumeAndVolumeTypeFromImageTest-1619514416 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_003fe47f-7c94-4a75-95e7-7eb642873121_sifcivpw' failed. Not Retrying. {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 29 03:40:18 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e572c76-bdf4-439e-bdce-0fa0a80a99ba]: (4, 'raw') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:40:18 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d994b5ba-581f-4ca3-84a2-3937a8938d61 tempest-VolumeAndVolumeTypeFromImageTest-1619514416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_003fe47f-7c94-4a75-95e7-7eb642873121_zs5skvqbdevstack@QuobyteHD {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:40:18 devstack sudo[112475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_003fe47f-7c94-4a75-95e7-7eb642873121_zs5skvqbdevstack@QuobyteHD Jun 29 03:40:18 devstack sudo[112475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:40:19 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-73e85728-cdbe-492f-9d49-47a5abf3a24c tempest-VolumesSnapshotTestJSON-1995063474 None] Acquiring lock "cinder-d1a6e3fe-443f-4175-b55e-a3c2d6374e9c-delete_snapshot" by "delete_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:40:19 devstack sudo[112471]: pam_unix(sudo:session): session closed for user root Jun 29 03:40:19 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-8e6829b9-f93e-4590-a8cc-bbce72ddbc7f tempest-VolumesSnapshotTestJSON-1995063474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf" returned: 0 in 0.660s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:40:19 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-8e6829b9-f93e-4590-a8cc-bbce72ddbc7f tempest-VolumesSnapshotTestJSON-1995063474 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:40:19 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-73e85728-cdbe-492f-9d49-47a5abf3a24c tempest-VolumesSnapshotTestJSON-1995063474 None] Lock "cinder-d1a6e3fe-443f-4175-b55e-a3c2d6374e9c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:40:19 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-73e85728-cdbe-492f-9d49-47a5abf3a24c tempest-VolumesSnapshotTestJSON-1995063474 None] Acquiring lock "cinder-quobyte-dbe2032c-173d-4363-8e8a-f85854c64198" by "delete_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:40:19 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-8e6829b9-f93e-4590-a8cc-bbce72ddbc7f tempest-VolumesSnapshotTestJSON-1995063474 None] Deleted volume successfully. Jun 29 03:40:19 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-73e85728-cdbe-492f-9d49-47a5abf3a24c tempest-VolumesSnapshotTestJSON-1995063474 None] Lock "cinder-quobyte-dbe2032c-173d-4363-8e8a-f85854c64198" acquired by "delete_snapshot" :: waited 0.026s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:40:19 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-73e85728-cdbe-492f-9d49-47a5abf3a24c tempest-VolumesSnapshotTestJSON-1995063474 None] Acquiring lock "cinder-quobyte-d1a6e3fe-443f-4175-b55e-a3c2d6374e9c" by "_delete_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:40:19 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-8e6829b9-f93e-4590-a8cc-bbce72ddbc7f tempest-VolumesSnapshotTestJSON-1995063474 None] Lock "cinder-e12e6690-75c7-4eb9-bff3-9a34ad99b7f7-delete_volume" released by "delete_volume" :: held 2.338s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:40:19 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-73e85728-cdbe-492f-9d49-47a5abf3a24c tempest-VolumesSnapshotTestJSON-1995063474 None] Lock "cinder-quobyte-d1a6e3fe-443f-4175-b55e-a3c2d6374e9c" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:40:19 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-73e85728-cdbe-492f-9d49-47a5abf3a24c tempest-VolumesSnapshotTestJSON-1995063474 None] Deleting offline snapshot d1a6e3fe-443f-4175-b55e-a3c2d6374e9c of volume dbe2032c-173d-4363-8e8a-f85854c64198 {{(pid=93468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 29 03:40:19 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-73e85728-cdbe-492f-9d49-47a5abf3a24c tempest-VolumesSnapshotTestJSON-1995063474 None] snapshot_file for this snap is: volume-dbe2032c-173d-4363-8e8a-f85854c64198.d1a6e3fe-443f-4175-b55e-a3c2d6374e9c {{(pid=93468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 29 03:40:19 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb1897d7-6698-429a-bae1-55c79b5b7798]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:40:19 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-73e85728-cdbe-492f-9d49-47a5abf3a24c tempest-VolumesSnapshotTestJSON-1995063474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-dbe2032c-173d-4363-8e8a-f85854c64198.d1a6e3fe-443f-4175-b55e-a3c2d6374e9c {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:40:19 devstack sudo[112478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-dbe2032c-173d-4363-8e8a-f85854c64198.d1a6e3fe-443f-4175-b55e-a3c2d6374e9c Jun 29 03:40:19 devstack sudo[112478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:40:19 devstack sudo[112475]: pam_unix(sudo:session): session closed for user root Jun 29 03:40:19 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d994b5ba-581f-4ca3-84a2-3937a8938d61 tempest-VolumeAndVolumeTypeFromImageTest-1619514416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_003fe47f-7c94-4a75-95e7-7eb642873121_zs5skvqbdevstack@QuobyteHD" returned: 0 in 0.781s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:40:19 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d994b5ba-581f-4ca3-84a2-3937a8938d61 tempest-VolumeAndVolumeTypeFromImageTest-1619514416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_003fe47f-7c94-4a75-95e7-7eb642873121_zs5skvqbdevstack@QuobyteHD {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:40:19 devstack sudo[112482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_003fe47f-7c94-4a75-95e7-7eb642873121_zs5skvqbdevstack@QuobyteHD Jun 29 03:40:19 devstack sudo[112482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:40:19 devstack sudo[112478]: pam_unix(sudo:session): session closed for user root Jun 29 03:40:19 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-73e85728-cdbe-492f-9d49-47a5abf3a24c tempest-VolumesSnapshotTestJSON-1995063474 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-dbe2032c-173d-4363-8e8a-f85854c64198.d1a6e3fe-443f-4175-b55e-a3c2d6374e9c" returned: 0 in 0.766s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:40:19 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-73e85728-cdbe-492f-9d49-47a5abf3a24c tempest-VolumesSnapshotTestJSON-1995063474 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dbe2032c-173d-4363-8e8a-f85854c64198(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93468) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 29 03:40:20 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[da822bc0-326b-4d33-b10d-959379db4b28]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:40:20 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-73e85728-cdbe-492f-9d49-47a5abf3a24c tempest-VolumesSnapshotTestJSON-1995063474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-dbe2032c-173d-4363-8e8a-f85854c64198 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:40:20 devstack sudo[112487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-dbe2032c-173d-4363-8e8a-f85854c64198 Jun 29 03:40:20 devstack sudo[112487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:40:20 devstack sudo[112482]: pam_unix(sudo:session): session closed for user root Jun 29 03:40:20 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d994b5ba-581f-4ca3-84a2-3937a8938d61 tempest-VolumeAndVolumeTypeFromImageTest-1619514416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_003fe47f-7c94-4a75-95e7-7eb642873121_zs5skvqbdevstack@QuobyteHD" returned: 1 in 0.707s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:40:20 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d994b5ba-581f-4ca3-84a2-3937a8938d61 tempest-VolumeAndVolumeTypeFromImageTest-1619514416 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_003fe47f-7c94-4a75-95e7-7eb642873121_zs5skvqbdevstack@QuobyteHD' failed. Not Retrying. {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 29 03:40:20 devstack cinder-volume[93468]: DEBUG cinder.image.image_utils [None req-d994b5ba-581f-4ca3-84a2-3937a8938d61 tempest-VolumeAndVolumeTypeFromImageTest-1619514416 None] 003fe47f-7c94-4a75-95e7-7eb642873121 was raw, converting to raw {{(pid=93468) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 29 03:40:20 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d994b5ba-581f-4ca3-84a2-3937a8938d61 tempest-VolumeAndVolumeTypeFromImageTest-1619514416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_003fe47f-7c94-4a75-95e7-7eb642873121_zs5skvqbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-2079bf51-be37-43ab-bf25-851be80bf8d3 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:40:20 devstack sudo[112492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_003fe47f-7c94-4a75-95e7-7eb642873121_zs5skvqbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-2079bf51-be37-43ab-bf25-851be80bf8d3 Jun 29 03:40:20 devstack sudo[112492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:40:20 devstack sudo[112487]: pam_unix(sudo:session): session closed for user root Jun 29 03:40:20 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-73e85728-cdbe-492f-9d49-47a5abf3a24c tempest-VolumesSnapshotTestJSON-1995063474 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-dbe2032c-173d-4363-8e8a-f85854c64198" returned: 0 in 0.777s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:40:20 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-73e85728-cdbe-492f-9d49-47a5abf3a24c tempest-VolumesSnapshotTestJSON-1995063474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-dbe2032c-173d-4363-8e8a-f85854c64198.d1a6e3fe-443f-4175-b55e-a3c2d6374e9c {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:40:20 devstack sudo[112500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-dbe2032c-173d-4363-8e8a-f85854c64198.d1a6e3fe-443f-4175-b55e-a3c2d6374e9c Jun 29 03:40:20 devstack sudo[112500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:40:20 devstack sudo[112492]: pam_unix(sudo:session): session closed for user root Jun 29 03:40:20 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d994b5ba-581f-4ca3-84a2-3937a8938d61 tempest-VolumeAndVolumeTypeFromImageTest-1619514416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_003fe47f-7c94-4a75-95e7-7eb642873121_zs5skvqbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-2079bf51-be37-43ab-bf25-851be80bf8d3" returned: 0 in 0.784s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:40:20 devstack cinder-volume[93468]: DEBUG cinder.image.image_utils [None req-d994b5ba-581f-4ca3-84a2-3937a8938d61 tempest-VolumeAndVolumeTypeFromImageTest-1619514416 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_003fe47f-7c94-4a75-95e7-7eb642873121_zs5skvqbdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-2079bf51-be37-43ab-bf25-851be80bf8d3 {{(pid=93468) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 29 03:40:20 devstack cinder-volume[93468]: INFO cinder.image.image_utils [None req-d994b5ba-581f-4ca3-84a2-3937a8938d61 tempest-VolumeAndVolumeTypeFromImageTest-1619514416 None] Converted 0.00 MB image at 0.00 MB/s Jun 29 03:40:20 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d994b5ba-581f-4ca3-84a2-3937a8938d61 tempest-VolumeAndVolumeTypeFromImageTest-1619514416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-2079bf51-be37-43ab-bf25-851be80bf8d3 1G {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:40:20 devstack sudo[112502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-2079bf51-be37-43ab-bf25-851be80bf8d3 1G Jun 29 03:40:20 devstack sudo[112502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:40:21 devstack sudo[112500]: pam_unix(sudo:session): session closed for user root Jun 29 03:40:21 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-73e85728-cdbe-492f-9d49-47a5abf3a24c tempest-VolumesSnapshotTestJSON-1995063474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-dbe2032c-173d-4363-8e8a-f85854c64198.d1a6e3fe-443f-4175-b55e-a3c2d6374e9c" returned: 0 in 0.752s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:40:21 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-73e85728-cdbe-492f-9d49-47a5abf3a24c tempest-VolumesSnapshotTestJSON-1995063474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-dbe2032c-173d-4363-8e8a-f85854c64198.d1a6e3fe-443f-4175-b55e-a3c2d6374e9c {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:40:21 devstack sudo[112510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-dbe2032c-173d-4363-8e8a-f85854c64198.d1a6e3fe-443f-4175-b55e-a3c2d6374e9c Jun 29 03:40:21 devstack sudo[112510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:40:21 devstack sudo[112502]: pam_unix(sudo:session): session closed for user root Jun 29 03:40:21 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d994b5ba-581f-4ca3-84a2-3937a8938d61 tempest-VolumeAndVolumeTypeFromImageTest-1619514416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-2079bf51-be37-43ab-bf25-851be80bf8d3 1G" returned: 0 in 0.678s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:40:21 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[f65b281a-36f0-43b4-ac5c-1b097ddd35a3]: (4, 'raw') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:40:21 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d994b5ba-581f-4ca3-84a2-3937a8938d61 tempest-VolumeAndVolumeTypeFromImageTest-1619514416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-2079bf51-be37-43ab-bf25-851be80bf8d3 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:40:21 devstack sudo[112512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-2079bf51-be37-43ab-bf25-851be80bf8d3 Jun 29 03:40:21 devstack sudo[112512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:40:22 devstack sudo[112510]: pam_unix(sudo:session): session closed for user root Jun 29 03:40:22 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-73e85728-cdbe-492f-9d49-47a5abf3a24c tempest-VolumesSnapshotTestJSON-1995063474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-dbe2032c-173d-4363-8e8a-f85854c64198.d1a6e3fe-443f-4175-b55e-a3c2d6374e9c" returned: 0 in 0.654s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:40:22 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-73e85728-cdbe-492f-9d49-47a5abf3a24c tempest-VolumesSnapshotTestJSON-1995063474 None] Lock "cinder-quobyte-d1a6e3fe-443f-4175-b55e-a3c2d6374e9c" released by "_delete_snapshot" :: held 3.077s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:40:22 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-73e85728-cdbe-492f-9d49-47a5abf3a24c tempest-VolumesSnapshotTestJSON-1995063474 None] Lock "cinder-quobyte-dbe2032c-173d-4363-8e8a-f85854c64198" released by "delete_snapshot" :: held 3.119s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:40:22 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-73e85728-cdbe-492f-9d49-47a5abf3a24c tempest-VolumesSnapshotTestJSON-1995063474 None] Created reservations ['76a5a8bb-e3fe-4b6a-867b-63c8c759c242', '694273f9-9af3-4467-89ec-23875bb621c6', 'd25ada8a-13cb-4305-8ae2-f269a5506328', '9c97d474-3e82-466b-96f8-fa50b7f8d670'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:40:22 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-73e85728-cdbe-492f-9d49-47a5abf3a24c tempest-VolumesSnapshotTestJSON-1995063474 None] Delete snapshot completed successfully. Jun 29 03:40:22 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-73e85728-cdbe-492f-9d49-47a5abf3a24c tempest-VolumesSnapshotTestJSON-1995063474 None] Lock "cinder-d1a6e3fe-443f-4175-b55e-a3c2d6374e9c-delete_snapshot" released by "delete_snapshot" :: held 3.259s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:40:22 devstack sudo[112512]: pam_unix(sudo:session): session closed for user root Jun 29 03:40:22 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d994b5ba-581f-4ca3-84a2-3937a8938d61 tempest-VolumeAndVolumeTypeFromImageTest-1619514416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-2079bf51-be37-43ab-bf25-851be80bf8d3" returned: 0 in 0.753s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:40:22 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d994b5ba-581f-4ca3-84a2-3937a8938d61 tempest-VolumeAndVolumeTypeFromImageTest-1619514416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-2079bf51-be37-43ab-bf25-851be80bf8d3 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:40:22 devstack sudo[112518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-2079bf51-be37-43ab-bf25-851be80bf8d3 Jun 29 03:40:22 devstack sudo[112518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:40:23 devstack sudo[112518]: pam_unix(sudo:session): session closed for user root Jun 29 03:40:23 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d994b5ba-581f-4ca3-84a2-3937a8938d61 tempest-VolumeAndVolumeTypeFromImageTest-1619514416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-2079bf51-be37-43ab-bf25-851be80bf8d3" returned: 1 in 0.734s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:40:23 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d994b5ba-581f-4ca3-84a2-3937a8938d61 tempest-VolumeAndVolumeTypeFromImageTest-1619514416 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-2079bf51-be37-43ab-bf25-851be80bf8d3' failed. Not Retrying. {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 29 03:40:23 devstack cinder-volume[93468]: DEBUG cinder.volume.volume_utils [None req-d994b5ba-581f-4ca3-84a2-3937a8938d61 tempest-VolumeAndVolumeTypeFromImageTest-1619514416 None] Downloaded image 003fe47f-7c94-4a75-95e7-7eb642873121 ((None, [{'url': 'file:///opt/stack/data/glance/images/003fe47f-7c94-4a75-95e7-7eb642873121', 'metadata': {}}])) to volume 2079bf51-be37-43ab-bf25-851be80bf8d3 successfully. {{(pid=93468) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 29 03:40:23 devstack cinder-volume[93468]: DEBUG cinder.image.image_utils [None req-d994b5ba-581f-4ca3-84a2-3937a8938d61 tempest-VolumeAndVolumeTypeFromImageTest-1619514416 None] Temporary image 003fe47f-7c94-4a75-95e7-7eb642873121 for user 23428b5dda314be098a2f4791e15d5b0 is deleted. {{(pid=93468) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 29 03:40:23 devstack cinder-volume[93468]: DEBUG cinder.volume.volume_utils [None req-d994b5ba-581f-4ca3-84a2-3937a8938d61 tempest-VolumeAndVolumeTypeFromImageTest-1619514416 None] Marking volume 2079bf51-be37-43ab-bf25-851be80bf8d3 as bootable. {{(pid=93468) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 29 03:40:23 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-d994b5ba-581f-4ca3-84a2-3937a8938d61 tempest-VolumeAndVolumeTypeFromImageTest-1619514416 None] Copying metadata from image 003fe47f-7c94-4a75-95e7-7eb642873121 to 2079bf51-be37-43ab-bf25-851be80bf8d3. {{(pid=93468) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 29 03:40:23 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-d994b5ba-581f-4ca3-84a2-3937a8938d61 tempest-VolumeAndVolumeTypeFromImageTest-1619514416 None] Creating volume glance metadata for volume 2079bf51-be37-43ab-bf25-851be80bf8d3 backed by image 003fe47f-7c94-4a75-95e7-7eb642873121 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '003fe47f-7c94-4a75-95e7-7eb642873121', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'fe6305cb15d273175add6f7cdcc719cd', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=93468) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 29 03:40:23 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-d994b5ba-581f-4ca3-84a2-3937a8938d61 tempest-VolumeAndVolumeTypeFromImageTest-1619514416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ed5b7dd-5803-44b1-a8fa-5b0e1a9ed4f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2079bf51-be37-43ab-bf25-851be80bf8d3', 'volume_size': 1, 'image_id': '003fe47f-7c94-4a75-95e7-7eb642873121', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/003fe47f-7c94-4a75-95e7-7eb642873121', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'fe6305cb15d273175add6f7cdcc719cd', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '16bc4aa200e4457ba23d99d6272c9bde', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '21d17bffed646bd9b7046045d0421e2b5a7904cf185f4cfac8027d772f5b8735f16a5e871912be05185fa6e43684513fd6c3285be6d70d0f1d982b6d4b5c4857', 'id': '003fe47f-7c94-4a75-95e7-7eb642873121', 'created_at': datetime.datetime(2026, 6, 29, 1, 40, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 29, 1, 40, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/003fe47f-7c94-4a75-95e7-7eb642873121/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:40:23 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-d994b5ba-581f-4ca3-84a2-3937a8938d61 tempest-VolumeAndVolumeTypeFromImageTest-1619514416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9974556-c7ba-434d-986a-c46d486d10d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:40:23 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-d994b5ba-581f-4ca3-84a2-3937a8938d61 tempest-VolumeAndVolumeTypeFromImageTest-1619514416 None] Volume volume-2079bf51-be37-43ab-bf25-851be80bf8d3 (2079bf51-be37-43ab-bf25-851be80bf8d3): created successfully Jun 29 03:40:23 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-d994b5ba-581f-4ca3-84a2-3937a8938d61 tempest-VolumeAndVolumeTypeFromImageTest-1619514416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9974556-c7ba-434d-986a-c46d486d10d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:40:23 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-d994b5ba-581f-4ca3-84a2-3937a8938d61 tempest-VolumeAndVolumeTypeFromImageTest-1619514416 None] Flow 'volume_create_manager' (2ccc2feb-829a-43d7-bd4a-70d55fe2502e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:40:23 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-d994b5ba-581f-4ca3-84a2-3937a8938d61 tempest-VolumeAndVolumeTypeFromImageTest-1619514416 None] Created volume successfully. Jun 29 03:40:23 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-694c031c-7261-4f72-bada-5a3386bf8fb3 tempest-VolumesSnapshotTestJSON-1995063474 None] Acquiring lock "cinder-dbe2032c-173d-4363-8e8a-f85854c64198-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:40:23 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-694c031c-7261-4f72-bada-5a3386bf8fb3 tempest-VolumesSnapshotTestJSON-1995063474 None] Lock "cinder-dbe2032c-173d-4363-8e8a-f85854c64198-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:40:23 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-694c031c-7261-4f72-bada-5a3386bf8fb3 tempest-VolumesSnapshotTestJSON-1995063474 None] Acquiring lock "cinder-quobyte-dbe2032c-173d-4363-8e8a-f85854c64198" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:40:23 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-694c031c-7261-4f72-bada-5a3386bf8fb3 tempest-VolumesSnapshotTestJSON-1995063474 None] Lock "cinder-quobyte-dbe2032c-173d-4363-8e8a-f85854c64198" acquired by "delete_volume" :: waited 0.016s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:40:23 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b6fec01-d6fb-49c4-a75e-b4dc1bda6f61]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:40:23 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-694c031c-7261-4f72-bada-5a3386bf8fb3 tempest-VolumesSnapshotTestJSON-1995063474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-dbe2032c-173d-4363-8e8a-f85854c64198 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:40:23 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-d1307b9d-58c9-4ea1-8703-1922da23307d tempest-VolumeAndVolumeTypeFromImageTest-1619514416 None] Acquiring lock "cinder-2079bf51-be37-43ab-bf25-851be80bf8d3-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:40:23 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-d1307b9d-58c9-4ea1-8703-1922da23307d tempest-VolumeAndVolumeTypeFromImageTest-1619514416 None] Lock "cinder-2079bf51-be37-43ab-bf25-851be80bf8d3-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:40:23 devstack sudo[112523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-dbe2032c-173d-4363-8e8a-f85854c64198 Jun 29 03:40:23 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-d1307b9d-58c9-4ea1-8703-1922da23307d tempest-VolumeAndVolumeTypeFromImageTest-1619514416 None] Acquiring lock "cinder-quobyte-2079bf51-be37-43ab-bf25-851be80bf8d3" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:40:23 devstack sudo[112523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:40:23 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-d1307b9d-58c9-4ea1-8703-1922da23307d tempest-VolumeAndVolumeTypeFromImageTest-1619514416 None] Lock "cinder-quobyte-2079bf51-be37-43ab-bf25-851be80bf8d3" acquired by "delete_volume" :: waited 0.020s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:40:23 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[e70ff416-eea2-423e-957c-1472fdfce6ce]: (4, 'raw') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:40:23 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d1307b9d-58c9-4ea1-8703-1922da23307d tempest-VolumeAndVolumeTypeFromImageTest-1619514416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-2079bf51-be37-43ab-bf25-851be80bf8d3 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:40:23 devstack sudo[112525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-2079bf51-be37-43ab-bf25-851be80bf8d3 Jun 29 03:40:23 devstack sudo[112525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:40:24 devstack sudo[112523]: pam_unix(sudo:session): session closed for user root Jun 29 03:40:24 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-694c031c-7261-4f72-bada-5a3386bf8fb3 tempest-VolumesSnapshotTestJSON-1995063474 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-dbe2032c-173d-4363-8e8a-f85854c64198" returned: 0 in 0.769s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:40:24 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-694c031c-7261-4f72-bada-5a3386bf8fb3 tempest-VolumesSnapshotTestJSON-1995063474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-dbe2032c-173d-4363-8e8a-f85854c64198 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:40:24 devstack sudo[112530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-dbe2032c-173d-4363-8e8a-f85854c64198 Jun 29 03:40:24 devstack sudo[112530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:40:24 devstack sudo[112525]: pam_unix(sudo:session): session closed for user root Jun 29 03:40:24 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d1307b9d-58c9-4ea1-8703-1922da23307d tempest-VolumeAndVolumeTypeFromImageTest-1619514416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-2079bf51-be37-43ab-bf25-851be80bf8d3" returned: 0 in 0.765s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:40:24 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d1307b9d-58c9-4ea1-8703-1922da23307d tempest-VolumeAndVolumeTypeFromImageTest-1619514416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-2079bf51-be37-43ab-bf25-851be80bf8d3 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:40:24 devstack sudo[112534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-2079bf51-be37-43ab-bf25-851be80bf8d3 Jun 29 03:40:24 devstack sudo[112534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:40:24 devstack sudo[112530]: pam_unix(sudo:session): session closed for user root Jun 29 03:40:24 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-694c031c-7261-4f72-bada-5a3386bf8fb3 tempest-VolumesSnapshotTestJSON-1995063474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-dbe2032c-173d-4363-8e8a-f85854c64198" returned: 0 in 0.687s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:40:24 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-694c031c-7261-4f72-bada-5a3386bf8fb3 tempest-VolumesSnapshotTestJSON-1995063474 None] Lock "cinder-quobyte-dbe2032c-173d-4363-8e8a-f85854c64198" released by "delete_volume" :: held 1.527s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:40:25 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-694c031c-7261-4f72-bada-5a3386bf8fb3 tempest-VolumesSnapshotTestJSON-1995063474 None] Created reservations ['7fc33f59-545e-435c-b81b-460b83391cc1', '37c2477d-9f19-48bb-90b7-fc7c3af8227f', '612b7a71-2660-4ea3-8b3f-45ac3e582f8d', 'e9bd13f8-bc30-41fa-bf66-d0bb26eb1140'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:40:25 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-694c031c-7261-4f72-bada-5a3386bf8fb3 tempest-VolumesSnapshotTestJSON-1995063474 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:40:25 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-694c031c-7261-4f72-bada-5a3386bf8fb3 tempest-VolumesSnapshotTestJSON-1995063474 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:40:25 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-694c031c-7261-4f72-bada-5a3386bf8fb3 tempest-VolumesSnapshotTestJSON-1995063474 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:40:25 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-694c031c-7261-4f72-bada-5a3386bf8fb3 tempest-VolumesSnapshotTestJSON-1995063474 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:40:25 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-694c031c-7261-4f72-bada-5a3386bf8fb3 tempest-VolumesSnapshotTestJSON-1995063474 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:40:25 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-694c031c-7261-4f72-bada-5a3386bf8fb3 tempest-VolumesSnapshotTestJSON-1995063474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:40:25 devstack sudo[112539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf Jun 29 03:40:25 devstack sudo[112539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:40:25 devstack sudo[112534]: pam_unix(sudo:session): session closed for user root Jun 29 03:40:25 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d1307b9d-58c9-4ea1-8703-1922da23307d tempest-VolumeAndVolumeTypeFromImageTest-1619514416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-2079bf51-be37-43ab-bf25-851be80bf8d3" returned: 1 in 0.773s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:40:25 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d1307b9d-58c9-4ea1-8703-1922da23307d tempest-VolumeAndVolumeTypeFromImageTest-1619514416 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-2079bf51-be37-43ab-bf25-851be80bf8d3' failed. Not Retrying. {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 29 03:40:25 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d1307b9d-58c9-4ea1-8703-1922da23307d tempest-VolumeAndVolumeTypeFromImageTest-1619514416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-2079bf51-be37-43ab-bf25-851be80bf8d3 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:40:25 devstack sudo[112542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-2079bf51-be37-43ab-bf25-851be80bf8d3 Jun 29 03:40:25 devstack sudo[112542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:40:25 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-4a3686bb-eff2-4d9d-bc11-9b99181b8cb7 tempest-VolumesSnapshotTestJSON-1995063474 None] Acquiring lock "cinder-f9ee7e20-7480-465f-a536-6b9f78a265f9-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:40:25 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-4a3686bb-eff2-4d9d-bc11-9b99181b8cb7 tempest-VolumesSnapshotTestJSON-1995063474 None] Lock "cinder-f9ee7e20-7480-465f-a536-6b9f78a265f9-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:40:25 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-4a3686bb-eff2-4d9d-bc11-9b99181b8cb7 tempest-VolumesSnapshotTestJSON-1995063474 None] Acquiring lock "cinder-quobyte-f9ee7e20-7480-465f-a536-6b9f78a265f9" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:40:25 devstack sudo[112539]: pam_unix(sudo:session): session closed for user root Jun 29 03:40:25 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-694c031c-7261-4f72-bada-5a3386bf8fb3 tempest-VolumesSnapshotTestJSON-1995063474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf" returned: 0 in 0.701s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:40:25 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-694c031c-7261-4f72-bada-5a3386bf8fb3 tempest-VolumesSnapshotTestJSON-1995063474 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:40:25 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-4a3686bb-eff2-4d9d-bc11-9b99181b8cb7 tempest-VolumesSnapshotTestJSON-1995063474 None] Lock "cinder-quobyte-f9ee7e20-7480-465f-a536-6b9f78a265f9" acquired by "delete_volume" :: waited 0.031s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:40:25 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-694c031c-7261-4f72-bada-5a3386bf8fb3 tempest-VolumesSnapshotTestJSON-1995063474 None] Deleted volume successfully. Jun 29 03:40:25 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bba6a86-caf8-4cf2-bc42-45f9246ccdad]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:40:25 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-4a3686bb-eff2-4d9d-bc11-9b99181b8cb7 tempest-VolumesSnapshotTestJSON-1995063474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-f9ee7e20-7480-465f-a536-6b9f78a265f9 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:40:25 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-694c031c-7261-4f72-bada-5a3386bf8fb3 tempest-VolumesSnapshotTestJSON-1995063474 None] Lock "cinder-dbe2032c-173d-4363-8e8a-f85854c64198-delete_volume" released by "delete_volume" :: held 2.479s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:40:25 devstack sudo[112542]: pam_unix(sudo:session): session closed for user root Jun 29 03:40:25 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d1307b9d-58c9-4ea1-8703-1922da23307d tempest-VolumeAndVolumeTypeFromImageTest-1619514416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-2079bf51-be37-43ab-bf25-851be80bf8d3" returned: 0 in 0.696s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:40:25 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-d1307b9d-58c9-4ea1-8703-1922da23307d tempest-VolumeAndVolumeTypeFromImageTest-1619514416 None] Lock "cinder-quobyte-2079bf51-be37-43ab-bf25-851be80bf8d3" released by "delete_volume" :: held 2.304s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:40:25 devstack cinder-volume[93468]: WARNING cinder.quota [None req-d1307b9d-58c9-4ea1-8703-1922da23307d tempest-VolumeAndVolumeTypeFromImageTest-1619514416 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jun 29 03:40:25 devstack cinder-volume[93468]: WARNING cinder.quota [None req-d1307b9d-58c9-4ea1-8703-1922da23307d tempest-VolumeAndVolumeTypeFromImageTest-1619514416 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jun 29 03:40:26 devstack sudo[112546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-f9ee7e20-7480-465f-a536-6b9f78a265f9 Jun 29 03:40:26 devstack sudo[112546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:40:26 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-d1307b9d-58c9-4ea1-8703-1922da23307d tempest-VolumeAndVolumeTypeFromImageTest-1619514416 None] Created reservations ['6ed75146-f52b-441f-ad15-402bd5b3421d', 'cab41cfb-424c-4316-a6d4-160e3fed85ad', '5ffb8c54-6231-40dd-851d-f2f25b1a485a', '56807bf0-4dce-4558-868e-851f6cdf1d36'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:40:26 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-d1307b9d-58c9-4ea1-8703-1922da23307d tempest-VolumeAndVolumeTypeFromImageTest-1619514416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:40:26 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-d1307b9d-58c9-4ea1-8703-1922da23307d tempest-VolumeAndVolumeTypeFromImageTest-1619514416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:40:26 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-d1307b9d-58c9-4ea1-8703-1922da23307d tempest-VolumeAndVolumeTypeFromImageTest-1619514416 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:40:26 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-d1307b9d-58c9-4ea1-8703-1922da23307d tempest-VolumeAndVolumeTypeFromImageTest-1619514416 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:40:26 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-d1307b9d-58c9-4ea1-8703-1922da23307d tempest-VolumeAndVolumeTypeFromImageTest-1619514416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:40:26 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d1307b9d-58c9-4ea1-8703-1922da23307d tempest-VolumeAndVolumeTypeFromImageTest-1619514416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:40:26 devstack sudo[112548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf Jun 29 03:40:26 devstack sudo[112548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:40:26 devstack sudo[112546]: pam_unix(sudo:session): session closed for user root Jun 29 03:40:26 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-4a3686bb-eff2-4d9d-bc11-9b99181b8cb7 tempest-VolumesSnapshotTestJSON-1995063474 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-f9ee7e20-7480-465f-a536-6b9f78a265f9" returned: 0 in 0.763s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:40:26 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-4a3686bb-eff2-4d9d-bc11-9b99181b8cb7 tempest-VolumesSnapshotTestJSON-1995063474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-f9ee7e20-7480-465f-a536-6b9f78a265f9 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:40:26 devstack sudo[112560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-f9ee7e20-7480-465f-a536-6b9f78a265f9 Jun 29 03:40:26 devstack sudo[112560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:40:26 devstack sudo[112548]: pam_unix(sudo:session): session closed for user root Jun 29 03:40:26 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d1307b9d-58c9-4ea1-8703-1922da23307d tempest-VolumeAndVolumeTypeFromImageTest-1619514416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf" returned: 0 in 0.654s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:40:26 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-d1307b9d-58c9-4ea1-8703-1922da23307d tempest-VolumeAndVolumeTypeFromImageTest-1619514416 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:40:26 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-d1307b9d-58c9-4ea1-8703-1922da23307d tempest-VolumeAndVolumeTypeFromImageTest-1619514416 None] Deleted volume successfully. Jun 29 03:40:26 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-d1307b9d-58c9-4ea1-8703-1922da23307d tempest-VolumeAndVolumeTypeFromImageTest-1619514416 None] Lock "cinder-2079bf51-be37-43ab-bf25-851be80bf8d3-delete_volume" released by "delete_volume" :: held 3.161s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:40:27 devstack sudo[112560]: pam_unix(sudo:session): session closed for user root Jun 29 03:40:27 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-4a3686bb-eff2-4d9d-bc11-9b99181b8cb7 tempest-VolumesSnapshotTestJSON-1995063474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-f9ee7e20-7480-465f-a536-6b9f78a265f9" returned: 0 in 0.643s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:40:27 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-4a3686bb-eff2-4d9d-bc11-9b99181b8cb7 tempest-VolumesSnapshotTestJSON-1995063474 None] Lock "cinder-quobyte-f9ee7e20-7480-465f-a536-6b9f78a265f9" released by "delete_volume" :: held 1.477s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:40:27 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-4a3686bb-eff2-4d9d-bc11-9b99181b8cb7 tempest-VolumesSnapshotTestJSON-1995063474 None] Created reservations ['1ee2e482-bc83-4920-9f7e-3d7d231613f6', '52c32080-24ae-4362-9bf6-e9efac26a8aa', '281996a2-9cf7-42c1-b7fc-e8b68979b329', 'ea57e584-ac5b-4790-adf9-8c21d34a1b2e'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:40:27 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-4a3686bb-eff2-4d9d-bc11-9b99181b8cb7 tempest-VolumesSnapshotTestJSON-1995063474 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:40:27 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-4a3686bb-eff2-4d9d-bc11-9b99181b8cb7 tempest-VolumesSnapshotTestJSON-1995063474 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:40:27 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-4a3686bb-eff2-4d9d-bc11-9b99181b8cb7 tempest-VolumesSnapshotTestJSON-1995063474 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:40:27 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-4a3686bb-eff2-4d9d-bc11-9b99181b8cb7 tempest-VolumesSnapshotTestJSON-1995063474 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:40:27 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-4a3686bb-eff2-4d9d-bc11-9b99181b8cb7 tempest-VolumesSnapshotTestJSON-1995063474 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:40:27 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-4a3686bb-eff2-4d9d-bc11-9b99181b8cb7 tempest-VolumesSnapshotTestJSON-1995063474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:40:27 devstack sudo[112563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf Jun 29 03:40:27 devstack sudo[112563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:40:28 devstack sudo[112563]: pam_unix(sudo:session): session closed for user root Jun 29 03:40:28 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-4a3686bb-eff2-4d9d-bc11-9b99181b8cb7 tempest-VolumesSnapshotTestJSON-1995063474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf" returned: 0 in 0.675s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:40:28 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-4a3686bb-eff2-4d9d-bc11-9b99181b8cb7 tempest-VolumesSnapshotTestJSON-1995063474 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:40:28 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-4a3686bb-eff2-4d9d-bc11-9b99181b8cb7 tempest-VolumesSnapshotTestJSON-1995063474 None] Deleted volume successfully. Jun 29 03:40:28 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-4a3686bb-eff2-4d9d-bc11-9b99181b8cb7 tempest-VolumesSnapshotTestJSON-1995063474 None] Lock "cinder-f9ee7e20-7480-465f-a536-6b9f78a265f9-delete_volume" released by "delete_volume" :: held 2.408s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:40:31 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c517112-3b5e-4a7e-84f5-c8a05fc3957e tempest-CinderUnicodeTest-1329683184 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:40:31 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-8c517112-3b5e-4a7e-84f5-c8a05fc3957e tempest-CinderUnicodeTest-1329683184 None] Flow 'volume_create_manager' (cd790a46-248c-49eb-9cbd-f87e8a9acfba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:40:31 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-8c517112-3b5e-4a7e-84f5-c8a05fc3957e tempest-CinderUnicodeTest-1329683184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a92091af-0606-4d71-a9fc-5bdcee60bf7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:40:31 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-8c517112-3b5e-4a7e-84f5-c8a05fc3957e tempest-CinderUnicodeTest-1329683184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a92091af-0606-4d71-a9fc-5bdcee60bf7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:40:31Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bac770c-63c3-4d8b-82ab-4a9fae98f0db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25381448555d44d29e37d1ca5b7059c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:40:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:40:31Z,use_quota=True,user_id='0723518f084e472d9fb35875c2472708',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:40:31 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-8c517112-3b5e-4a7e-84f5-c8a05fc3957e tempest-CinderUnicodeTest-1329683184 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad657d4f-db2a-453c-b9eb-f3581dc708a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:40:31 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-8c517112-3b5e-4a7e-84f5-c8a05fc3957e tempest-CinderUnicodeTest-1329683184 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad657d4f-db2a-453c-b9eb-f3581dc708a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:40:31 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-8c517112-3b5e-4a7e-84f5-c8a05fc3957e tempest-CinderUnicodeTest-1329683184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c4816ea-5bd4-4a63-b911-2257e53acb2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:40:31 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-8c517112-3b5e-4a7e-84f5-c8a05fc3957e tempest-CinderUnicodeTest-1329683184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c4816ea-5bd4-4a63-b911-2257e53acb2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3bac770c-63c3-4d8b-82ab-4a9fae98f0db', 'volume_name': 'volume-3bac770c-63c3-4d8b-82ab-4a9fae98f0db', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:40:31 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-8c517112-3b5e-4a7e-84f5-c8a05fc3957e tempest-CinderUnicodeTest-1329683184 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f805ec26-9948-491d-8f92-cd77578c83b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:40:31 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-8c517112-3b5e-4a7e-84f5-c8a05fc3957e tempest-CinderUnicodeTest-1329683184 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f805ec26-9948-491d-8f92-cd77578c83b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:40:31 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-8c517112-3b5e-4a7e-84f5-c8a05fc3957e tempest-CinderUnicodeTest-1329683184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (848330d5-bb2b-4f04-986b-4f62ef86f76e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:40:31 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-8c517112-3b5e-4a7e-84f5-c8a05fc3957e tempest-CinderUnicodeTest-1329683184 None] Volume 3bac770c-63c3-4d8b-82ab-4a9fae98f0db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3bac770c-63c3-4d8b-82ab-4a9fae98f0db', 'volume_size': 1} Jun 29 03:40:31 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-8c517112-3b5e-4a7e-84f5-c8a05fc3957e tempest-CinderUnicodeTest-1329683184 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:40:31 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-8c517112-3b5e-4a7e-84f5-c8a05fc3957e tempest-CinderUnicodeTest-1329683184 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:40:31 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-8c517112-3b5e-4a7e-84f5-c8a05fc3957e tempest-CinderUnicodeTest-1329683184 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:40:31Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bac770c-63c3-4d8b-82ab-4a9fae98f0db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25381448555d44d29e37d1ca5b7059c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:40:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:40:31Z,use_quota=True,user_id='0723518f084e472d9fb35875c2472708',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:40:31 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-8c517112-3b5e-4a7e-84f5-c8a05fc3957e tempest-CinderUnicodeTest-1329683184 None] Creating volume 3bac770c-63c3-4d8b-82ab-4a9fae98f0db {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:40:31 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-8c517112-3b5e-4a7e-84f5-c8a05fc3957e tempest-CinderUnicodeTest-1329683184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:40:31 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-8c517112-3b5e-4a7e-84f5-c8a05fc3957e tempest-CinderUnicodeTest-1329683184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:40:31 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-8c517112-3b5e-4a7e-84f5-c8a05fc3957e tempest-CinderUnicodeTest-1329683184 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:40:31 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-8c517112-3b5e-4a7e-84f5-c8a05fc3957e tempest-CinderUnicodeTest-1329683184 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:40:31 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-8c517112-3b5e-4a7e-84f5-c8a05fc3957e tempest-CinderUnicodeTest-1329683184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:40:31 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-8c517112-3b5e-4a7e-84f5-c8a05fc3957e tempest-CinderUnicodeTest-1329683184 None] Selected osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:40:31 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-8c517112-3b5e-4a7e-84f5-c8a05fc3957e tempest-CinderUnicodeTest-1329683184 None] casted to osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f Jun 29 03:40:31 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-8c517112-3b5e-4a7e-84f5-c8a05fc3957e tempest-CinderUnicodeTest-1329683184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-3bac770c-63c3-4d8b-82ab-4a9fae98f0db 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:40:31 devstack sudo[112568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-3bac770c-63c3-4d8b-82ab-4a9fae98f0db 1073741824 Jun 29 03:40:31 devstack sudo[112568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:40:32 devstack sudo[112568]: pam_unix(sudo:session): session closed for user root Jun 29 03:40:32 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-8c517112-3b5e-4a7e-84f5-c8a05fc3957e tempest-CinderUnicodeTest-1329683184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-3bac770c-63c3-4d8b-82ab-4a9fae98f0db 1073741824" returned: 0 in 0.874s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:40:32 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-8c517112-3b5e-4a7e-84f5-c8a05fc3957e tempest-CinderUnicodeTest-1329683184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-3bac770c-63c3-4d8b-82ab-4a9fae98f0db {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:40:32 devstack sudo[112576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-3bac770c-63c3-4d8b-82ab-4a9fae98f0db Jun 29 03:40:32 devstack sudo[112576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:40:33 devstack sudo[112576]: pam_unix(sudo:session): session closed for user root Jun 29 03:40:33 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-8c517112-3b5e-4a7e-84f5-c8a05fc3957e tempest-CinderUnicodeTest-1329683184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-3bac770c-63c3-4d8b-82ab-4a9fae98f0db" returned: 0 in 0.673s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:40:33 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-8c517112-3b5e-4a7e-84f5-c8a05fc3957e tempest-CinderUnicodeTest-1329683184 None] <== create_volume: return (1595ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:40:33 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-8c517112-3b5e-4a7e-84f5-c8a05fc3957e tempest-CinderUnicodeTest-1329683184 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.598s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:40:33 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-8c517112-3b5e-4a7e-84f5-c8a05fc3957e tempest-CinderUnicodeTest-1329683184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (848330d5-bb2b-4f04-986b-4f62ef86f76e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3bac770c-63c3-4d8b-82ab-4a9fae98f0db', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:40:33 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-8c517112-3b5e-4a7e-84f5-c8a05fc3957e tempest-CinderUnicodeTest-1329683184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a256ef6-fa88-4ae1-9e92-72a7ceef4bf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:40:33 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-8c517112-3b5e-4a7e-84f5-c8a05fc3957e tempest-CinderUnicodeTest-1329683184 None] Volume volume-3bac770c-63c3-4d8b-82ab-4a9fae98f0db (3bac770c-63c3-4d8b-82ab-4a9fae98f0db): created successfully Jun 29 03:40:33 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-8c517112-3b5e-4a7e-84f5-c8a05fc3957e tempest-CinderUnicodeTest-1329683184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a256ef6-fa88-4ae1-9e92-72a7ceef4bf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:40:33 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-8c517112-3b5e-4a7e-84f5-c8a05fc3957e tempest-CinderUnicodeTest-1329683184 None] Flow 'volume_create_manager' (cd790a46-248c-49eb-9cbd-f87e8a9acfba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:40:33 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-8c517112-3b5e-4a7e-84f5-c8a05fc3957e tempest-CinderUnicodeTest-1329683184 None] Created volume successfully. Jun 29 03:40:33 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-a48307ee-8ffe-48fc-8903-f59b8ef5fcbb tempest-CinderUnicodeTest-1329683184 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:40:33 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-a48307ee-8ffe-48fc-8903-f59b8ef5fcbb tempest-CinderUnicodeTest-1329683184 None] Flow 'volume_create_manager' (70124f41-fbeb-4319-9124-4e4f172e4266) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:40:34 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-a48307ee-8ffe-48fc-8903-f59b8ef5fcbb tempest-CinderUnicodeTest-1329683184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (967f9158-8aa7-4e76-889e-d4029908007f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:40:34 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-a48307ee-8ffe-48fc-8903-f59b8ef5fcbb tempest-CinderUnicodeTest-1329683184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (967f9158-8aa7-4e76-889e-d4029908007f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:40:34Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-734332437',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08a32f42-5045-4d29-9b76-827753d2ac69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25381448555d44d29e37d1ca5b7059c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:40:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:40:34Z,use_quota=True,user_id='0723518f084e472d9fb35875c2472708',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:40:34 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-a48307ee-8ffe-48fc-8903-f59b8ef5fcbb tempest-CinderUnicodeTest-1329683184 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c32cf58-7ea8-4c22-a628-c9ba3a43beb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:40:34 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-a48307ee-8ffe-48fc-8903-f59b8ef5fcbb tempest-CinderUnicodeTest-1329683184 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c32cf58-7ea8-4c22-a628-c9ba3a43beb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:40:34 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-a48307ee-8ffe-48fc-8903-f59b8ef5fcbb tempest-CinderUnicodeTest-1329683184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (282d0a17-22a1-488e-abe0-9477a15f60fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:40:34 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-a48307ee-8ffe-48fc-8903-f59b8ef5fcbb tempest-CinderUnicodeTest-1329683184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (282d0a17-22a1-488e-abe0-9477a15f60fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '08a32f42-5045-4d29-9b76-827753d2ac69', 'volume_name': 'volume-08a32f42-5045-4d29-9b76-827753d2ac69', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:40:34 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-a48307ee-8ffe-48fc-8903-f59b8ef5fcbb tempest-CinderUnicodeTest-1329683184 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6725158-39d6-4328-949f-7163f4c2db57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:40:34 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-a48307ee-8ffe-48fc-8903-f59b8ef5fcbb tempest-CinderUnicodeTest-1329683184 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6725158-39d6-4328-949f-7163f4c2db57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:40:34 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-a48307ee-8ffe-48fc-8903-f59b8ef5fcbb tempest-CinderUnicodeTest-1329683184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0a57c9a-09c2-424b-bb2d-88f5fdb1f781) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:40:34 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-a48307ee-8ffe-48fc-8903-f59b8ef5fcbb tempest-CinderUnicodeTest-1329683184 None] Volume 08a32f42-5045-4d29-9b76-827753d2ac69: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-08a32f42-5045-4d29-9b76-827753d2ac69', 'volume_size': 1} Jun 29 03:40:34 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-a48307ee-8ffe-48fc-8903-f59b8ef5fcbb tempest-CinderUnicodeTest-1329683184 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:40:34 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-a48307ee-8ffe-48fc-8903-f59b8ef5fcbb tempest-CinderUnicodeTest-1329683184 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:40:34 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-a48307ee-8ffe-48fc-8903-f59b8ef5fcbb tempest-CinderUnicodeTest-1329683184 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:40:34Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-734332437',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08a32f42-5045-4d29-9b76-827753d2ac69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25381448555d44d29e37d1ca5b7059c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:40:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:40:34Z,use_quota=True,user_id='0723518f084e472d9fb35875c2472708',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:40:34 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-a48307ee-8ffe-48fc-8903-f59b8ef5fcbb tempest-CinderUnicodeTest-1329683184 None] Creating volume 08a32f42-5045-4d29-9b76-827753d2ac69 {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:40:34 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-a48307ee-8ffe-48fc-8903-f59b8ef5fcbb tempest-CinderUnicodeTest-1329683184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:40:34 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-a48307ee-8ffe-48fc-8903-f59b8ef5fcbb tempest-CinderUnicodeTest-1329683184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:40:34 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-a48307ee-8ffe-48fc-8903-f59b8ef5fcbb tempest-CinderUnicodeTest-1329683184 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:40:34 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-a48307ee-8ffe-48fc-8903-f59b8ef5fcbb tempest-CinderUnicodeTest-1329683184 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:40:34 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-a48307ee-8ffe-48fc-8903-f59b8ef5fcbb tempest-CinderUnicodeTest-1329683184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:40:34 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-a48307ee-8ffe-48fc-8903-f59b8ef5fcbb tempest-CinderUnicodeTest-1329683184 None] Selected osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:40:34 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-a48307ee-8ffe-48fc-8903-f59b8ef5fcbb tempest-CinderUnicodeTest-1329683184 None] casted to osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f Jun 29 03:40:34 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a48307ee-8ffe-48fc-8903-f59b8ef5fcbb tempest-CinderUnicodeTest-1329683184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-08a32f42-5045-4d29-9b76-827753d2ac69 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:40:34 devstack sudo[112579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-08a32f42-5045-4d29-9b76-827753d2ac69 1073741824 Jun 29 03:40:34 devstack sudo[112579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:40:34 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-af732917-d264-4ead-9d4f-499792caa718 tempest-VolumesSnapshotNegativeTestJSON-330901232 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:40:34 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-af732917-d264-4ead-9d4f-499792caa718 tempest-VolumesSnapshotNegativeTestJSON-330901232 None] Flow 'volume_create_manager' (7043cc29-950f-4b73-8d77-e4306ede80e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:40:34 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-af732917-d264-4ead-9d4f-499792caa718 tempest-VolumesSnapshotNegativeTestJSON-330901232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96652dc2-3676-47c7-8da9-c0ed79c508d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:40:34 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-af732917-d264-4ead-9d4f-499792caa718 tempest-VolumesSnapshotNegativeTestJSON-330901232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96652dc2-3676-47c7-8da9-c0ed79c508d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:40:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-379597770',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3bfcce6-1ad3-4e47-b991-50360ba14ab9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55e48377b6db46098b097852b0832c26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:40:34Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:40:34Z,use_quota=True,user_id='98294987f44440aa87b17d033b76bb99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:40:34 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-af732917-d264-4ead-9d4f-499792caa718 tempest-VolumesSnapshotNegativeTestJSON-330901232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebf0cb51-4269-401b-bedc-49c4364f4ad2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:40:34 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-af732917-d264-4ead-9d4f-499792caa718 tempest-VolumesSnapshotNegativeTestJSON-330901232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebf0cb51-4269-401b-bedc-49c4364f4ad2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:40:34 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-af732917-d264-4ead-9d4f-499792caa718 tempest-VolumesSnapshotNegativeTestJSON-330901232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc37ef6f-8874-4a58-83df-10a91168f843) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:40:34 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-af732917-d264-4ead-9d4f-499792caa718 tempest-VolumesSnapshotNegativeTestJSON-330901232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc37ef6f-8874-4a58-83df-10a91168f843) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b3bfcce6-1ad3-4e47-b991-50360ba14ab9', 'volume_name': 'volume-b3bfcce6-1ad3-4e47-b991-50360ba14ab9', 'volume_size': 2}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:40:34 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-af732917-d264-4ead-9d4f-499792caa718 tempest-VolumesSnapshotNegativeTestJSON-330901232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d68127a5-7de9-4daf-a7b4-a7ce31b53aee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:40:34 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-af732917-d264-4ead-9d4f-499792caa718 tempest-VolumesSnapshotNegativeTestJSON-330901232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d68127a5-7de9-4daf-a7b4-a7ce31b53aee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:40:34 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-af732917-d264-4ead-9d4f-499792caa718 tempest-VolumesSnapshotNegativeTestJSON-330901232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (730cf4a9-7d10-4ee8-81de-1c1a8c3ec34d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:40:34 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-af732917-d264-4ead-9d4f-499792caa718 tempest-VolumesSnapshotNegativeTestJSON-330901232 None] Volume b3bfcce6-1ad3-4e47-b991-50360ba14ab9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b3bfcce6-1ad3-4e47-b991-50360ba14ab9', 'volume_size': 2} Jun 29 03:40:34 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-af732917-d264-4ead-9d4f-499792caa718 tempest-VolumesSnapshotNegativeTestJSON-330901232 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:40:34 devstack sudo[112579]: pam_unix(sudo:session): session closed for user root Jun 29 03:40:34 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a48307ee-8ffe-48fc-8903-f59b8ef5fcbb tempest-CinderUnicodeTest-1329683184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-08a32f42-5045-4d29-9b76-827753d2ac69 1073741824" returned: 0 in 0.788s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:40:34 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a48307ee-8ffe-48fc-8903-f59b8ef5fcbb tempest-CinderUnicodeTest-1329683184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-08a32f42-5045-4d29-9b76-827753d2ac69 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:40:34 devstack sudo[112585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-08a32f42-5045-4d29-9b76-827753d2ac69 Jun 29 03:40:34 devstack sudo[112585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:40:35 devstack sudo[112585]: pam_unix(sudo:session): session closed for user root Jun 29 03:40:35 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a48307ee-8ffe-48fc-8903-f59b8ef5fcbb tempest-CinderUnicodeTest-1329683184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-08a32f42-5045-4d29-9b76-827753d2ac69" returned: 0 in 0.630s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:40:35 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-a48307ee-8ffe-48fc-8903-f59b8ef5fcbb tempest-CinderUnicodeTest-1329683184 None] <== create_volume: return (1457ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:40:35 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-a48307ee-8ffe-48fc-8903-f59b8ef5fcbb tempest-CinderUnicodeTest-1329683184 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.460s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:40:35 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-af732917-d264-4ead-9d4f-499792caa718 tempest-VolumesSnapshotNegativeTestJSON-330901232 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.264s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:40:35 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-af732917-d264-4ead-9d4f-499792caa718 tempest-VolumesSnapshotNegativeTestJSON-330901232 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:40:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-379597770',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3bfcce6-1ad3-4e47-b991-50360ba14ab9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55e48377b6db46098b097852b0832c26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:40:34Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:40:34Z,use_quota=True,user_id='98294987f44440aa87b17d033b76bb99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:40:35 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-af732917-d264-4ead-9d4f-499792caa718 tempest-VolumesSnapshotNegativeTestJSON-330901232 None] Creating volume b3bfcce6-1ad3-4e47-b991-50360ba14ab9 {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:40:35 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-af732917-d264-4ead-9d4f-499792caa718 tempest-VolumesSnapshotNegativeTestJSON-330901232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:40:35 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-af732917-d264-4ead-9d4f-499792caa718 tempest-VolumesSnapshotNegativeTestJSON-330901232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:40:35 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-af732917-d264-4ead-9d4f-499792caa718 tempest-VolumesSnapshotNegativeTestJSON-330901232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:40:35 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-af732917-d264-4ead-9d4f-499792caa718 tempest-VolumesSnapshotNegativeTestJSON-330901232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:40:35 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-af732917-d264-4ead-9d4f-499792caa718 tempest-VolumesSnapshotNegativeTestJSON-330901232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:40:35 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-af732917-d264-4ead-9d4f-499792caa718 tempest-VolumesSnapshotNegativeTestJSON-330901232 None] Selected osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:40:35 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-af732917-d264-4ead-9d4f-499792caa718 tempest-VolumesSnapshotNegativeTestJSON-330901232 None] casted to osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f Jun 29 03:40:35 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-af732917-d264-4ead-9d4f-499792caa718 tempest-VolumesSnapshotNegativeTestJSON-330901232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-b3bfcce6-1ad3-4e47-b991-50360ba14ab9 2147483648 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:40:35 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-a48307ee-8ffe-48fc-8903-f59b8ef5fcbb tempest-CinderUnicodeTest-1329683184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0a57c9a-09c2-424b-bb2d-88f5fdb1f781) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08a32f42-5045-4d29-9b76-827753d2ac69', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:40:35 devstack sudo[112588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-b3bfcce6-1ad3-4e47-b991-50360ba14ab9 2147483648 Jun 29 03:40:35 devstack sudo[112588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:40:35 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-a48307ee-8ffe-48fc-8903-f59b8ef5fcbb tempest-CinderUnicodeTest-1329683184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22b8ee59-8b79-4d58-adc6-bbdee998a2df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:40:35 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-a48307ee-8ffe-48fc-8903-f59b8ef5fcbb tempest-CinderUnicodeTest-1329683184 None] Volume volume-08a32f42-5045-4d29-9b76-827753d2ac69 (08a32f42-5045-4d29-9b76-827753d2ac69): created successfully Jun 29 03:40:35 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-a48307ee-8ffe-48fc-8903-f59b8ef5fcbb tempest-CinderUnicodeTest-1329683184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22b8ee59-8b79-4d58-adc6-bbdee998a2df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:40:35 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-a48307ee-8ffe-48fc-8903-f59b8ef5fcbb tempest-CinderUnicodeTest-1329683184 None] Flow 'volume_create_manager' (70124f41-fbeb-4319-9124-4e4f172e4266) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:40:35 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-a48307ee-8ffe-48fc-8903-f59b8ef5fcbb tempest-CinderUnicodeTest-1329683184 None] Created volume successfully. Jun 29 03:40:36 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-46b8b8b1-60ba-4c17-8380-32530cb5ca47 tempest-CinderUnicodeTest-1329683184 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:40:36 devstack sudo[112588]: pam_unix(sudo:session): session closed for user root Jun 29 03:40:36 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-af732917-d264-4ead-9d4f-499792caa718 tempest-VolumesSnapshotNegativeTestJSON-330901232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-b3bfcce6-1ad3-4e47-b991-50360ba14ab9 2147483648" returned: 0 in 0.907s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:40:36 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-af732917-d264-4ead-9d4f-499792caa718 tempest-VolumesSnapshotNegativeTestJSON-330901232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-b3bfcce6-1ad3-4e47-b991-50360ba14ab9 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:40:36 devstack sudo[112594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-b3bfcce6-1ad3-4e47-b991-50360ba14ab9 Jun 29 03:40:36 devstack sudo[112594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:40:37 devstack sudo[112594]: pam_unix(sudo:session): session closed for user root Jun 29 03:40:37 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-af732917-d264-4ead-9d4f-499792caa718 tempest-VolumesSnapshotNegativeTestJSON-330901232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-b3bfcce6-1ad3-4e47-b991-50360ba14ab9" returned: 0 in 0.640s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:40:37 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-af732917-d264-4ead-9d4f-499792caa718 tempest-VolumesSnapshotNegativeTestJSON-330901232 None] <== create_volume: return (1581ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:40:37 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-af732917-d264-4ead-9d4f-499792caa718 tempest-VolumesSnapshotNegativeTestJSON-330901232 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.584s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:40:37 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-46b8b8b1-60ba-4c17-8380-32530cb5ca47 tempest-CinderUnicodeTest-1329683184 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.882s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:40:37 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-46b8b8b1-60ba-4c17-8380-32530cb5ca47 tempest-CinderUnicodeTest-1329683184 None] Creating offline snapshot f53a7627-cb67-4a05-9bd5-df40f991ba29 of volume 08a32f42-5045-4d29-9b76-827753d2ac69 {{(pid=93468) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 29 03:40:37 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-af732917-d264-4ead-9d4f-499792caa718 tempest-VolumesSnapshotNegativeTestJSON-330901232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (730cf4a9-7d10-4ee8-81de-1c1a8c3ec34d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3bfcce6-1ad3-4e47-b991-50360ba14ab9', 'volume_size': 2}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:40:37 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-af732917-d264-4ead-9d4f-499792caa718 tempest-VolumesSnapshotNegativeTestJSON-330901232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d92efe5c-4199-4f8e-a92b-377be1c7b23d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:40:37 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[b97d82a4-3957-42c3-8452-c96aaa132ebe]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:40:37 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-46b8b8b1-60ba-4c17-8380-32530cb5ca47 tempest-CinderUnicodeTest-1329683184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-08a32f42-5045-4d29-9b76-827753d2ac69 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:40:37 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-af732917-d264-4ead-9d4f-499792caa718 tempest-VolumesSnapshotNegativeTestJSON-330901232 None] Volume volume-b3bfcce6-1ad3-4e47-b991-50360ba14ab9 (b3bfcce6-1ad3-4e47-b991-50360ba14ab9): created successfully Jun 29 03:40:37 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-af732917-d264-4ead-9d4f-499792caa718 tempest-VolumesSnapshotNegativeTestJSON-330901232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d92efe5c-4199-4f8e-a92b-377be1c7b23d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:40:37 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-af732917-d264-4ead-9d4f-499792caa718 tempest-VolumesSnapshotNegativeTestJSON-330901232 None] Flow 'volume_create_manager' (7043cc29-950f-4b73-8d77-e4306ede80e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:40:37 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-af732917-d264-4ead-9d4f-499792caa718 tempest-VolumesSnapshotNegativeTestJSON-330901232 None] Created volume successfully. Jun 29 03:40:37 devstack sudo[112597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-08a32f42-5045-4d29-9b76-827753d2ac69 Jun 29 03:40:37 devstack sudo[112597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:40:37 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-84e6dea2-d986-447d-92ef-89d49fe90776 tempest-VolumesSnapshotNegativeTestJSON-330901232 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:40:37 devstack sudo[112597]: pam_unix(sudo:session): session closed for user root Jun 29 03:40:37 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-46b8b8b1-60ba-4c17-8380-32530cb5ca47 tempest-CinderUnicodeTest-1329683184 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-08a32f42-5045-4d29-9b76-827753d2ac69" returned: 0 in 0.818s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:40:37 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-46b8b8b1-60ba-4c17-8380-32530cb5ca47 tempest-CinderUnicodeTest-1329683184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-08a32f42-5045-4d29-9b76-827753d2ac69,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-08a32f42-5045-4d29-9b76-827753d2ac69.f53a7627-cb67-4a05-9bd5-df40f991ba29 1G {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:40:37 devstack sudo[112602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-08a32f42-5045-4d29-9b76-827753d2ac69,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-08a32f42-5045-4d29-9b76-827753d2ac69.f53a7627-cb67-4a05-9bd5-df40f991ba29 1G Jun 29 03:40:38 devstack sudo[112602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:40:38 devstack sudo[112602]: pam_unix(sudo:session): session closed for user root Jun 29 03:40:38 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-46b8b8b1-60ba-4c17-8380-32530cb5ca47 tempest-CinderUnicodeTest-1329683184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-08a32f42-5045-4d29-9b76-827753d2ac69,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-08a32f42-5045-4d29-9b76-827753d2ac69.f53a7627-cb67-4a05-9bd5-df40f991ba29 1G" returned: 0 in 0.784s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:40:38 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-46b8b8b1-60ba-4c17-8380-32530cb5ca47 tempest-CinderUnicodeTest-1329683184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-08a32f42-5045-4d29-9b76-827753d2ac69 -F qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-08a32f42-5045-4d29-9b76-827753d2ac69.f53a7627-cb67-4a05-9bd5-df40f991ba29 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:40:38 devstack sudo[112607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-08a32f42-5045-4d29-9b76-827753d2ac69 -F qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-08a32f42-5045-4d29-9b76-827753d2ac69.f53a7627-cb67-4a05-9bd5-df40f991ba29 Jun 29 03:40:38 devstack sudo[112607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:40:39 devstack sudo[112607]: pam_unix(sudo:session): session closed for user root Jun 29 03:40:39 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-46b8b8b1-60ba-4c17-8380-32530cb5ca47 tempest-CinderUnicodeTest-1329683184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-08a32f42-5045-4d29-9b76-827753d2ac69 -F qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-08a32f42-5045-4d29-9b76-827753d2ac69.f53a7627-cb67-4a05-9bd5-df40f991ba29" returned: 0 in 0.675s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:40:39 devstack cinder-volume[93468]: WARNING cinder.volume.drivers.remotefs [None req-46b8b8b1-60ba-4c17-8380-32530cb5ca47 tempest-CinderUnicodeTest-1329683184 None] /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-08a32f42-5045-4d29-9b76-827753d2ac69.f53a7627-cb67-4a05-9bd5-df40f991ba29 is being set with open permissions: ugo+rw Jun 29 03:40:39 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-46b8b8b1-60ba-4c17-8380-32530cb5ca47 tempest-CinderUnicodeTest-1329683184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-08a32f42-5045-4d29-9b76-827753d2ac69.f53a7627-cb67-4a05-9bd5-df40f991ba29 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:40:39 devstack sudo[112612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-08a32f42-5045-4d29-9b76-827753d2ac69.f53a7627-cb67-4a05-9bd5-df40f991ba29 Jun 29 03:40:39 devstack sudo[112612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:40:40 devstack sudo[112612]: pam_unix(sudo:session): session closed for user root Jun 29 03:40:40 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-46b8b8b1-60ba-4c17-8380-32530cb5ca47 tempest-CinderUnicodeTest-1329683184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-08a32f42-5045-4d29-9b76-827753d2ac69.f53a7627-cb67-4a05-9bd5-df40f991ba29" returned: 0 in 0.635s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:40:40 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-46b8b8b1-60ba-4c17-8380-32530cb5ca47 tempest-CinderUnicodeTest-1329683184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-08a32f42-5045-4d29-9b76-827753d2ac69.info {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:40:40 devstack sudo[112615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-08a32f42-5045-4d29-9b76-827753d2ac69.info Jun 29 03:40:40 devstack sudo[112615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:40:40 devstack sudo[112615]: pam_unix(sudo:session): session closed for user root Jun 29 03:40:40 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-46b8b8b1-60ba-4c17-8380-32530cb5ca47 tempest-CinderUnicodeTest-1329683184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-08a32f42-5045-4d29-9b76-827753d2ac69.info" returned: 0 in 0.663s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:40:40 devstack cinder-volume[93468]: WARNING cinder.volume.drivers.remotefs [None req-46b8b8b1-60ba-4c17-8380-32530cb5ca47 tempest-CinderUnicodeTest-1329683184 None] /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-08a32f42-5045-4d29-9b76-827753d2ac69.info is being set with open permissions: ugo+rw Jun 29 03:40:40 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-46b8b8b1-60ba-4c17-8380-32530cb5ca47 tempest-CinderUnicodeTest-1329683184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-08a32f42-5045-4d29-9b76-827753d2ac69.info {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:40:40 devstack sudo[112618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-08a32f42-5045-4d29-9b76-827753d2ac69.info Jun 29 03:40:40 devstack sudo[112618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:40:41 devstack sudo[112618]: pam_unix(sudo:session): session closed for user root Jun 29 03:40:41 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-46b8b8b1-60ba-4c17-8380-32530cb5ca47 tempest-CinderUnicodeTest-1329683184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-08a32f42-5045-4d29-9b76-827753d2ac69.info" returned: 0 in 0.631s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:40:41 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-46b8b8b1-60ba-4c17-8380-32530cb5ca47 tempest-CinderUnicodeTest-1329683184 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.292s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:40:41 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-84e6dea2-d986-447d-92ef-89d49fe90776 tempest-VolumesSnapshotNegativeTestJSON-330901232 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.900s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:40:41 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-84e6dea2-d986-447d-92ef-89d49fe90776 tempest-VolumesSnapshotNegativeTestJSON-330901232 None] Creating offline snapshot d1cdb307-a5a5-4a17-b948-1961b774e03a of volume b3bfcce6-1ad3-4e47-b991-50360ba14ab9 {{(pid=93468) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 29 03:40:41 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-46b8b8b1-60ba-4c17-8380-32530cb5ca47 tempest-CinderUnicodeTest-1329683184 None] Create snapshot completed successfully Jun 29 03:40:41 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc5b2913-3ef3-451b-978b-adf373c17026]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:40:41 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-84e6dea2-d986-447d-92ef-89d49fe90776 tempest-VolumesSnapshotNegativeTestJSON-330901232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-b3bfcce6-1ad3-4e47-b991-50360ba14ab9 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:40:41 devstack sudo[112621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-b3bfcce6-1ad3-4e47-b991-50360ba14ab9 Jun 29 03:40:41 devstack sudo[112621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:40:42 devstack sudo[112621]: pam_unix(sudo:session): session closed for user root Jun 29 03:40:42 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-84e6dea2-d986-447d-92ef-89d49fe90776 tempest-VolumesSnapshotNegativeTestJSON-330901232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-b3bfcce6-1ad3-4e47-b991-50360ba14ab9" returned: 0 in 0.773s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:40:42 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-84e6dea2-d986-447d-92ef-89d49fe90776 tempest-VolumesSnapshotNegativeTestJSON-330901232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-b3bfcce6-1ad3-4e47-b991-50360ba14ab9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-b3bfcce6-1ad3-4e47-b991-50360ba14ab9.d1cdb307-a5a5-4a17-b948-1961b774e03a 2G {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:40:42 devstack sudo[112627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-b3bfcce6-1ad3-4e47-b991-50360ba14ab9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-b3bfcce6-1ad3-4e47-b991-50360ba14ab9.d1cdb307-a5a5-4a17-b948-1961b774e03a 2G Jun 29 03:40:42 devstack sudo[112627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:40:42 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-d8e2e937-4147-4e0d-9396-a2349e6a3f54 tempest-CinderUnicodeTest-1329683184 None] Acquiring lock "cinder-f53a7627-cb67-4a05-9bd5-df40f991ba29-delete_snapshot" by "delete_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:40:42 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-d8e2e937-4147-4e0d-9396-a2349e6a3f54 tempest-CinderUnicodeTest-1329683184 None] Lock "cinder-f53a7627-cb67-4a05-9bd5-df40f991ba29-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:40:42 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-d8e2e937-4147-4e0d-9396-a2349e6a3f54 tempest-CinderUnicodeTest-1329683184 None] Acquiring lock "cinder-quobyte-08a32f42-5045-4d29-9b76-827753d2ac69" by "delete_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:40:42 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-d8e2e937-4147-4e0d-9396-a2349e6a3f54 tempest-CinderUnicodeTest-1329683184 None] Lock "cinder-quobyte-08a32f42-5045-4d29-9b76-827753d2ac69" acquired by "delete_snapshot" :: waited 0.017s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:40:42 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-d8e2e937-4147-4e0d-9396-a2349e6a3f54 tempest-CinderUnicodeTest-1329683184 None] Acquiring lock "cinder-quobyte-f53a7627-cb67-4a05-9bd5-df40f991ba29" by "_delete_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:40:42 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-d8e2e937-4147-4e0d-9396-a2349e6a3f54 tempest-CinderUnicodeTest-1329683184 None] Lock "cinder-quobyte-f53a7627-cb67-4a05-9bd5-df40f991ba29" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:40:42 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-d8e2e937-4147-4e0d-9396-a2349e6a3f54 tempest-CinderUnicodeTest-1329683184 None] Deleting offline snapshot f53a7627-cb67-4a05-9bd5-df40f991ba29 of volume 08a32f42-5045-4d29-9b76-827753d2ac69 {{(pid=93468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 29 03:40:42 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-d8e2e937-4147-4e0d-9396-a2349e6a3f54 tempest-CinderUnicodeTest-1329683184 None] snapshot_file for this snap is: volume-08a32f42-5045-4d29-9b76-827753d2ac69.f53a7627-cb67-4a05-9bd5-df40f991ba29 {{(pid=93468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 29 03:40:42 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa9ed7a1-181e-48f1-a75b-9b716f330b6c]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:40:42 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d8e2e937-4147-4e0d-9396-a2349e6a3f54 tempest-CinderUnicodeTest-1329683184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-08a32f42-5045-4d29-9b76-827753d2ac69.f53a7627-cb67-4a05-9bd5-df40f991ba29 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:40:42 devstack sudo[112629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-08a32f42-5045-4d29-9b76-827753d2ac69.f53a7627-cb67-4a05-9bd5-df40f991ba29 Jun 29 03:40:42 devstack sudo[112629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:40:43 devstack sudo[112627]: pam_unix(sudo:session): session closed for user root Jun 29 03:40:43 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-84e6dea2-d986-447d-92ef-89d49fe90776 tempest-VolumesSnapshotNegativeTestJSON-330901232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-b3bfcce6-1ad3-4e47-b991-50360ba14ab9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-b3bfcce6-1ad3-4e47-b991-50360ba14ab9.d1cdb307-a5a5-4a17-b948-1961b774e03a 2G" returned: 0 in 0.800s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:40:43 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-84e6dea2-d986-447d-92ef-89d49fe90776 tempest-VolumesSnapshotNegativeTestJSON-330901232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b3bfcce6-1ad3-4e47-b991-50360ba14ab9 -F qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-b3bfcce6-1ad3-4e47-b991-50360ba14ab9.d1cdb307-a5a5-4a17-b948-1961b774e03a {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:40:43 devstack sudo[112634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b3bfcce6-1ad3-4e47-b991-50360ba14ab9 -F qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-b3bfcce6-1ad3-4e47-b991-50360ba14ab9.d1cdb307-a5a5-4a17-b948-1961b774e03a Jun 29 03:40:43 devstack sudo[112634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:40:43 devstack sudo[112629]: pam_unix(sudo:session): session closed for user root Jun 29 03:40:43 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d8e2e937-4147-4e0d-9396-a2349e6a3f54 tempest-CinderUnicodeTest-1329683184 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-08a32f42-5045-4d29-9b76-827753d2ac69.f53a7627-cb67-4a05-9bd5-df40f991ba29" returned: 0 in 0.785s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:40:43 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-d8e2e937-4147-4e0d-9396-a2349e6a3f54 tempest-CinderUnicodeTest-1329683184 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-08a32f42-5045-4d29-9b76-827753d2ac69(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93468) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 29 03:40:43 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c291fa0-ce94-440f-845a-cb0654cedd18]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:40:43 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d8e2e937-4147-4e0d-9396-a2349e6a3f54 tempest-CinderUnicodeTest-1329683184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-08a32f42-5045-4d29-9b76-827753d2ac69 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:40:43 devstack sudo[112640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-08a32f42-5045-4d29-9b76-827753d2ac69 Jun 29 03:40:43 devstack sudo[112640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:40:43 devstack sudo[112634]: pam_unix(sudo:session): session closed for user root Jun 29 03:40:43 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-84e6dea2-d986-447d-92ef-89d49fe90776 tempest-VolumesSnapshotNegativeTestJSON-330901232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b3bfcce6-1ad3-4e47-b991-50360ba14ab9 -F qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-b3bfcce6-1ad3-4e47-b991-50360ba14ab9.d1cdb307-a5a5-4a17-b948-1961b774e03a" returned: 0 in 0.694s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:40:43 devstack cinder-volume[93468]: WARNING cinder.volume.drivers.remotefs [None req-84e6dea2-d986-447d-92ef-89d49fe90776 tempest-VolumesSnapshotNegativeTestJSON-330901232 None] /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-b3bfcce6-1ad3-4e47-b991-50360ba14ab9.d1cdb307-a5a5-4a17-b948-1961b774e03a is being set with open permissions: ugo+rw Jun 29 03:40:43 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-84e6dea2-d986-447d-92ef-89d49fe90776 tempest-VolumesSnapshotNegativeTestJSON-330901232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-b3bfcce6-1ad3-4e47-b991-50360ba14ab9.d1cdb307-a5a5-4a17-b948-1961b774e03a {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:40:43 devstack sudo[112645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-b3bfcce6-1ad3-4e47-b991-50360ba14ab9.d1cdb307-a5a5-4a17-b948-1961b774e03a Jun 29 03:40:43 devstack sudo[112645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:40:44 devstack sudo[112640]: pam_unix(sudo:session): session closed for user root Jun 29 03:40:44 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d8e2e937-4147-4e0d-9396-a2349e6a3f54 tempest-CinderUnicodeTest-1329683184 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-08a32f42-5045-4d29-9b76-827753d2ac69" returned: 0 in 0.782s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:40:44 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d8e2e937-4147-4e0d-9396-a2349e6a3f54 tempest-CinderUnicodeTest-1329683184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-08a32f42-5045-4d29-9b76-827753d2ac69.f53a7627-cb67-4a05-9bd5-df40f991ba29 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:40:44 devstack sudo[112650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-08a32f42-5045-4d29-9b76-827753d2ac69.f53a7627-cb67-4a05-9bd5-df40f991ba29 Jun 29 03:40:44 devstack sudo[112650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:40:44 devstack sudo[112645]: pam_unix(sudo:session): session closed for user root Jun 29 03:40:44 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-84e6dea2-d986-447d-92ef-89d49fe90776 tempest-VolumesSnapshotNegativeTestJSON-330901232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-b3bfcce6-1ad3-4e47-b991-50360ba14ab9.d1cdb307-a5a5-4a17-b948-1961b774e03a" returned: 0 in 0.629s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:40:44 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-84e6dea2-d986-447d-92ef-89d49fe90776 tempest-VolumesSnapshotNegativeTestJSON-330901232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-b3bfcce6-1ad3-4e47-b991-50360ba14ab9.info {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:40:44 devstack sudo[112653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-b3bfcce6-1ad3-4e47-b991-50360ba14ab9.info Jun 29 03:40:44 devstack sudo[112653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:40:44 devstack sudo[112650]: pam_unix(sudo:session): session closed for user root Jun 29 03:40:44 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d8e2e937-4147-4e0d-9396-a2349e6a3f54 tempest-CinderUnicodeTest-1329683184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-08a32f42-5045-4d29-9b76-827753d2ac69.f53a7627-cb67-4a05-9bd5-df40f991ba29" returned: 0 in 0.729s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:40:44 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d8e2e937-4147-4e0d-9396-a2349e6a3f54 tempest-CinderUnicodeTest-1329683184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-08a32f42-5045-4d29-9b76-827753d2ac69.f53a7627-cb67-4a05-9bd5-df40f991ba29 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:40:44 devstack sudo[112659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-08a32f42-5045-4d29-9b76-827753d2ac69.f53a7627-cb67-4a05-9bd5-df40f991ba29 Jun 29 03:40:44 devstack sudo[112659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:40:45 devstack sudo[112653]: pam_unix(sudo:session): session closed for user root Jun 29 03:40:45 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-84e6dea2-d986-447d-92ef-89d49fe90776 tempest-VolumesSnapshotNegativeTestJSON-330901232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-b3bfcce6-1ad3-4e47-b991-50360ba14ab9.info" returned: 0 in 0.661s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:40:45 devstack cinder-volume[93468]: WARNING cinder.volume.drivers.remotefs [None req-84e6dea2-d986-447d-92ef-89d49fe90776 tempest-VolumesSnapshotNegativeTestJSON-330901232 None] /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-b3bfcce6-1ad3-4e47-b991-50360ba14ab9.info is being set with open permissions: ugo+rw Jun 29 03:40:45 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-84e6dea2-d986-447d-92ef-89d49fe90776 tempest-VolumesSnapshotNegativeTestJSON-330901232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-b3bfcce6-1ad3-4e47-b991-50360ba14ab9.info {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:40:45 devstack sudo[112661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-b3bfcce6-1ad3-4e47-b991-50360ba14ab9.info Jun 29 03:40:45 devstack sudo[112661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:40:45 devstack sudo[112659]: pam_unix(sudo:session): session closed for user root Jun 29 03:40:45 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d8e2e937-4147-4e0d-9396-a2349e6a3f54 tempest-CinderUnicodeTest-1329683184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-08a32f42-5045-4d29-9b76-827753d2ac69.f53a7627-cb67-4a05-9bd5-df40f991ba29" returned: 0 in 0.651s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:40:45 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-d8e2e937-4147-4e0d-9396-a2349e6a3f54 tempest-CinderUnicodeTest-1329683184 None] Lock "cinder-quobyte-f53a7627-cb67-4a05-9bd5-df40f991ba29" released by "_delete_snapshot" :: held 3.055s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:40:45 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-d8e2e937-4147-4e0d-9396-a2349e6a3f54 tempest-CinderUnicodeTest-1329683184 None] Lock "cinder-quobyte-08a32f42-5045-4d29-9b76-827753d2ac69" released by "delete_snapshot" :: held 3.079s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:40:45 devstack sudo[112661]: pam_unix(sudo:session): session closed for user root Jun 29 03:40:45 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-84e6dea2-d986-447d-92ef-89d49fe90776 tempest-VolumesSnapshotNegativeTestJSON-330901232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-b3bfcce6-1ad3-4e47-b991-50360ba14ab9.info" returned: 0 in 0.634s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:40:45 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-84e6dea2-d986-447d-92ef-89d49fe90776 tempest-VolumesSnapshotNegativeTestJSON-330901232 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.290s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:40:45 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-d8e2e937-4147-4e0d-9396-a2349e6a3f54 tempest-CinderUnicodeTest-1329683184 None] Created reservations ['fd33b6cd-e9c8-4c7a-b6ad-4ab06471064f', 'e1a974ba-05e2-4112-b11d-4825e25bc6a4', 'bcf386f4-8d72-44d9-961e-546624ea2cfb', 'b809e8bb-d719-4ea0-b43d-581b3cd531ca'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:40:45 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-84e6dea2-d986-447d-92ef-89d49fe90776 tempest-VolumesSnapshotNegativeTestJSON-330901232 None] Create snapshot completed successfully Jun 29 03:40:45 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-d8e2e937-4147-4e0d-9396-a2349e6a3f54 tempest-CinderUnicodeTest-1329683184 None] Delete snapshot completed successfully. Jun 29 03:40:45 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-d8e2e937-4147-4e0d-9396-a2349e6a3f54 tempest-CinderUnicodeTest-1329683184 None] Lock "cinder-f53a7627-cb67-4a05-9bd5-df40f991ba29-delete_snapshot" released by "delete_snapshot" :: held 3.252s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:40:46 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-44b71681-8e5d-41f7-ad09-23fbfd55f1bf tempest-CinderUnicodeTest-1329683184 None] Acquiring lock "cinder-08a32f42-5045-4d29-9b76-827753d2ac69-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:40:46 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-44b71681-8e5d-41f7-ad09-23fbfd55f1bf tempest-CinderUnicodeTest-1329683184 None] Lock "cinder-08a32f42-5045-4d29-9b76-827753d2ac69-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:40:46 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-44b71681-8e5d-41f7-ad09-23fbfd55f1bf tempest-CinderUnicodeTest-1329683184 None] Acquiring lock "cinder-quobyte-08a32f42-5045-4d29-9b76-827753d2ac69" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:40:46 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-44b71681-8e5d-41f7-ad09-23fbfd55f1bf tempest-CinderUnicodeTest-1329683184 None] Lock "cinder-quobyte-08a32f42-5045-4d29-9b76-827753d2ac69" acquired by "delete_volume" :: waited 0.019s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:40:46 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[875ad8c5-db1e-4a93-9402-156a4d5d26ee]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:40:46 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-44b71681-8e5d-41f7-ad09-23fbfd55f1bf tempest-CinderUnicodeTest-1329683184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-08a32f42-5045-4d29-9b76-827753d2ac69 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:40:46 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-368a2e98-8095-4e47-9925-a96ba76139d7 tempest-VolumesSnapshotNegativeTestJSON-330901232 None] Acquiring lock "cinder-d1cdb307-a5a5-4a17-b948-1961b774e03a-delete_snapshot" by "delete_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:40:46 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-368a2e98-8095-4e47-9925-a96ba76139d7 tempest-VolumesSnapshotNegativeTestJSON-330901232 None] Lock "cinder-d1cdb307-a5a5-4a17-b948-1961b774e03a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:40:46 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-368a2e98-8095-4e47-9925-a96ba76139d7 tempest-VolumesSnapshotNegativeTestJSON-330901232 None] Acquiring lock "cinder-quobyte-b3bfcce6-1ad3-4e47-b991-50360ba14ab9" by "delete_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:40:46 devstack sudo[112699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-08a32f42-5045-4d29-9b76-827753d2ac69 Jun 29 03:40:46 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-368a2e98-8095-4e47-9925-a96ba76139d7 tempest-VolumesSnapshotNegativeTestJSON-330901232 None] Lock "cinder-quobyte-b3bfcce6-1ad3-4e47-b991-50360ba14ab9" acquired by "delete_snapshot" :: waited 0.014s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:40:46 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-368a2e98-8095-4e47-9925-a96ba76139d7 tempest-VolumesSnapshotNegativeTestJSON-330901232 None] Acquiring lock "cinder-quobyte-d1cdb307-a5a5-4a17-b948-1961b774e03a" by "_delete_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:40:46 devstack sudo[112699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:40:47 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-368a2e98-8095-4e47-9925-a96ba76139d7 tempest-VolumesSnapshotNegativeTestJSON-330901232 None] Lock "cinder-quobyte-d1cdb307-a5a5-4a17-b948-1961b774e03a" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:40:47 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-368a2e98-8095-4e47-9925-a96ba76139d7 tempest-VolumesSnapshotNegativeTestJSON-330901232 None] Deleting offline snapshot d1cdb307-a5a5-4a17-b948-1961b774e03a of volume b3bfcce6-1ad3-4e47-b991-50360ba14ab9 {{(pid=93468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 29 03:40:47 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-368a2e98-8095-4e47-9925-a96ba76139d7 tempest-VolumesSnapshotNegativeTestJSON-330901232 None] snapshot_file for this snap is: volume-b3bfcce6-1ad3-4e47-b991-50360ba14ab9.d1cdb307-a5a5-4a17-b948-1961b774e03a {{(pid=93468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 29 03:40:47 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[79914bc3-dfd9-433e-959e-5a8ee47a7ab2]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:40:47 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-368a2e98-8095-4e47-9925-a96ba76139d7 tempest-VolumesSnapshotNegativeTestJSON-330901232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-b3bfcce6-1ad3-4e47-b991-50360ba14ab9.d1cdb307-a5a5-4a17-b948-1961b774e03a {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:40:47 devstack sudo[112701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-b3bfcce6-1ad3-4e47-b991-50360ba14ab9.d1cdb307-a5a5-4a17-b948-1961b774e03a Jun 29 03:40:47 devstack sudo[112701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:40:47 devstack sudo[112699]: pam_unix(sudo:session): session closed for user root Jun 29 03:40:47 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-44b71681-8e5d-41f7-ad09-23fbfd55f1bf tempest-CinderUnicodeTest-1329683184 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-08a32f42-5045-4d29-9b76-827753d2ac69" returned: 0 in 0.812s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:40:47 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-44b71681-8e5d-41f7-ad09-23fbfd55f1bf tempest-CinderUnicodeTest-1329683184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-08a32f42-5045-4d29-9b76-827753d2ac69 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:40:47 devstack sudo[112708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-08a32f42-5045-4d29-9b76-827753d2ac69 Jun 29 03:40:47 devstack sudo[112708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:40:47 devstack sudo[112701]: pam_unix(sudo:session): session closed for user root Jun 29 03:40:47 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-368a2e98-8095-4e47-9925-a96ba76139d7 tempest-VolumesSnapshotNegativeTestJSON-330901232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-b3bfcce6-1ad3-4e47-b991-50360ba14ab9.d1cdb307-a5a5-4a17-b948-1961b774e03a" returned: 0 in 0.802s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:40:47 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-368a2e98-8095-4e47-9925-a96ba76139d7 tempest-VolumesSnapshotNegativeTestJSON-330901232 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b3bfcce6-1ad3-4e47-b991-50360ba14ab9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93468) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 29 03:40:47 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cdc8d0f-82f9-437a-a388-aaa12d9ca8a1]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:40:47 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-368a2e98-8095-4e47-9925-a96ba76139d7 tempest-VolumesSnapshotNegativeTestJSON-330901232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-b3bfcce6-1ad3-4e47-b991-50360ba14ab9 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:40:47 devstack sudo[112713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-b3bfcce6-1ad3-4e47-b991-50360ba14ab9 Jun 29 03:40:47 devstack sudo[112713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:40:48 devstack sudo[112708]: pam_unix(sudo:session): session closed for user root Jun 29 03:40:48 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-44b71681-8e5d-41f7-ad09-23fbfd55f1bf tempest-CinderUnicodeTest-1329683184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-08a32f42-5045-4d29-9b76-827753d2ac69" returned: 0 in 0.667s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:40:48 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-44b71681-8e5d-41f7-ad09-23fbfd55f1bf tempest-CinderUnicodeTest-1329683184 None] Lock "cinder-quobyte-08a32f42-5045-4d29-9b76-827753d2ac69" released by "delete_volume" :: held 1.561s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:40:48 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-44b71681-8e5d-41f7-ad09-23fbfd55f1bf tempest-CinderUnicodeTest-1329683184 None] Created reservations ['1acdef59-d6b6-4eec-b9dc-5eacd19e9088', 'ac03394b-b342-45dc-8de1-27d3526c56ee', '62141773-6a00-4c85-8cc6-f7c43545e9e0', '1d01f6ae-26da-4e57-ae44-e1078f15621d'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:40:48 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-44b71681-8e5d-41f7-ad09-23fbfd55f1bf tempest-CinderUnicodeTest-1329683184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:40:48 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-44b71681-8e5d-41f7-ad09-23fbfd55f1bf tempest-CinderUnicodeTest-1329683184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:40:48 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-44b71681-8e5d-41f7-ad09-23fbfd55f1bf tempest-CinderUnicodeTest-1329683184 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:40:48 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-44b71681-8e5d-41f7-ad09-23fbfd55f1bf tempest-CinderUnicodeTest-1329683184 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:40:48 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-44b71681-8e5d-41f7-ad09-23fbfd55f1bf tempest-CinderUnicodeTest-1329683184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:40:48 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-44b71681-8e5d-41f7-ad09-23fbfd55f1bf tempest-CinderUnicodeTest-1329683184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:40:48 devstack sudo[112716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf Jun 29 03:40:48 devstack sudo[112716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:40:48 devstack sudo[112713]: pam_unix(sudo:session): session closed for user root Jun 29 03:40:48 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-368a2e98-8095-4e47-9925-a96ba76139d7 tempest-VolumesSnapshotNegativeTestJSON-330901232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-b3bfcce6-1ad3-4e47-b991-50360ba14ab9" returned: 0 in 0.789s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:40:48 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-368a2e98-8095-4e47-9925-a96ba76139d7 tempest-VolumesSnapshotNegativeTestJSON-330901232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-b3bfcce6-1ad3-4e47-b991-50360ba14ab9.d1cdb307-a5a5-4a17-b948-1961b774e03a {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:40:48 devstack sudo[112721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-b3bfcce6-1ad3-4e47-b991-50360ba14ab9.d1cdb307-a5a5-4a17-b948-1961b774e03a Jun 29 03:40:48 devstack sudo[112721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:40:48 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-27372467-a491-409d-ad75-42e772b3f2ce tempest-CinderUnicodeTest-1329683184 None] Acquiring lock "cinder-3bac770c-63c3-4d8b-82ab-4a9fae98f0db-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:40:48 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-27372467-a491-409d-ad75-42e772b3f2ce tempest-CinderUnicodeTest-1329683184 None] Lock "cinder-3bac770c-63c3-4d8b-82ab-4a9fae98f0db-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:40:49 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-27372467-a491-409d-ad75-42e772b3f2ce tempest-CinderUnicodeTest-1329683184 None] Acquiring lock "cinder-quobyte-3bac770c-63c3-4d8b-82ab-4a9fae98f0db" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:40:49 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-27372467-a491-409d-ad75-42e772b3f2ce tempest-CinderUnicodeTest-1329683184 None] Lock "cinder-quobyte-3bac770c-63c3-4d8b-82ab-4a9fae98f0db" acquired by "delete_volume" :: waited 0.030s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:40:49 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[84362795-e467-42f6-a6c3-f1cf70560c3b]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:40:49 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-27372467-a491-409d-ad75-42e772b3f2ce tempest-CinderUnicodeTest-1329683184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-3bac770c-63c3-4d8b-82ab-4a9fae98f0db {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:40:49 devstack sudo[112716]: pam_unix(sudo:session): session closed for user root Jun 29 03:40:49 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-44b71681-8e5d-41f7-ad09-23fbfd55f1bf tempest-CinderUnicodeTest-1329683184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf" returned: 0 in 0.688s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:40:49 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-44b71681-8e5d-41f7-ad09-23fbfd55f1bf tempest-CinderUnicodeTest-1329683184 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:40:49 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-44b71681-8e5d-41f7-ad09-23fbfd55f1bf tempest-CinderUnicodeTest-1329683184 None] Deleted volume successfully. Jun 29 03:40:49 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-44b71681-8e5d-41f7-ad09-23fbfd55f1bf tempest-CinderUnicodeTest-1329683184 None] Lock "cinder-08a32f42-5045-4d29-9b76-827753d2ac69-delete_volume" released by "delete_volume" :: held 2.466s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:40:49 devstack sudo[112724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-3bac770c-63c3-4d8b-82ab-4a9fae98f0db Jun 29 03:40:49 devstack sudo[112724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:40:49 devstack sudo[112721]: pam_unix(sudo:session): session closed for user root Jun 29 03:40:49 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-368a2e98-8095-4e47-9925-a96ba76139d7 tempest-VolumesSnapshotNegativeTestJSON-330901232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-b3bfcce6-1ad3-4e47-b991-50360ba14ab9.d1cdb307-a5a5-4a17-b948-1961b774e03a" returned: 0 in 0.788s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:40:49 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-368a2e98-8095-4e47-9925-a96ba76139d7 tempest-VolumesSnapshotNegativeTestJSON-330901232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-b3bfcce6-1ad3-4e47-b991-50360ba14ab9.d1cdb307-a5a5-4a17-b948-1961b774e03a {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:40:49 devstack sudo[112729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-b3bfcce6-1ad3-4e47-b991-50360ba14ab9.d1cdb307-a5a5-4a17-b948-1961b774e03a Jun 29 03:40:49 devstack sudo[112729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:40:49 devstack sudo[112724]: pam_unix(sudo:session): session closed for user root Jun 29 03:40:49 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-27372467-a491-409d-ad75-42e772b3f2ce tempest-CinderUnicodeTest-1329683184 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-3bac770c-63c3-4d8b-82ab-4a9fae98f0db" returned: 0 in 0.782s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:40:49 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-27372467-a491-409d-ad75-42e772b3f2ce tempest-CinderUnicodeTest-1329683184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-3bac770c-63c3-4d8b-82ab-4a9fae98f0db {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:40:49 devstack sudo[112734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-3bac770c-63c3-4d8b-82ab-4a9fae98f0db Jun 29 03:40:49 devstack sudo[112734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:40:50 devstack sudo[112729]: pam_unix(sudo:session): session closed for user root Jun 29 03:40:50 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-368a2e98-8095-4e47-9925-a96ba76139d7 tempest-VolumesSnapshotNegativeTestJSON-330901232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-b3bfcce6-1ad3-4e47-b991-50360ba14ab9.d1cdb307-a5a5-4a17-b948-1961b774e03a" returned: 0 in 0.621s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:40:50 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-368a2e98-8095-4e47-9925-a96ba76139d7 tempest-VolumesSnapshotNegativeTestJSON-330901232 None] Lock "cinder-quobyte-d1cdb307-a5a5-4a17-b948-1961b774e03a" released by "_delete_snapshot" :: held 3.135s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:40:50 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-368a2e98-8095-4e47-9925-a96ba76139d7 tempest-VolumesSnapshotNegativeTestJSON-330901232 None] Lock "cinder-quobyte-b3bfcce6-1ad3-4e47-b991-50360ba14ab9" released by "delete_snapshot" :: held 3.160s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:40:50 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-368a2e98-8095-4e47-9925-a96ba76139d7 tempest-VolumesSnapshotNegativeTestJSON-330901232 None] Created reservations ['79e2927c-0c26-4ba3-9bf6-f287ae4a8a35', 'a13ce2b3-728e-4aa4-a95e-354a8f0ed454', 'e16186a2-844e-4482-add7-62af0d5c4ef1', '5bb8df02-b316-4e2b-80e3-31e7b39fc596'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:40:50 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-368a2e98-8095-4e47-9925-a96ba76139d7 tempest-VolumesSnapshotNegativeTestJSON-330901232 None] Delete snapshot completed successfully. Jun 29 03:40:50 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-368a2e98-8095-4e47-9925-a96ba76139d7 tempest-VolumesSnapshotNegativeTestJSON-330901232 None] Lock "cinder-d1cdb307-a5a5-4a17-b948-1961b774e03a-delete_snapshot" released by "delete_snapshot" :: held 3.293s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:40:50 devstack sudo[112734]: pam_unix(sudo:session): session closed for user root Jun 29 03:40:50 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-27372467-a491-409d-ad75-42e772b3f2ce tempest-CinderUnicodeTest-1329683184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-3bac770c-63c3-4d8b-82ab-4a9fae98f0db" returned: 0 in 0.642s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:40:50 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-27372467-a491-409d-ad75-42e772b3f2ce tempest-CinderUnicodeTest-1329683184 None] Lock "cinder-quobyte-3bac770c-63c3-4d8b-82ab-4a9fae98f0db" released by "delete_volume" :: held 1.470s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:40:50 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-27372467-a491-409d-ad75-42e772b3f2ce tempest-CinderUnicodeTest-1329683184 None] Created reservations ['e3fb5a7b-4f3f-434d-b772-022de5ee598f', '863e2bfe-9a3d-4482-b4b0-0534790d232e', '6a7ddced-8cb7-4d11-a024-41a2fe94d4d4', 'b0ccc8e4-38ec-45d6-81a2-1de7f730df68'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:40:50 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-27372467-a491-409d-ad75-42e772b3f2ce tempest-CinderUnicodeTest-1329683184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:40:50 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-27372467-a491-409d-ad75-42e772b3f2ce tempest-CinderUnicodeTest-1329683184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:40:50 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-27372467-a491-409d-ad75-42e772b3f2ce tempest-CinderUnicodeTest-1329683184 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:40:50 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-27372467-a491-409d-ad75-42e772b3f2ce tempest-CinderUnicodeTest-1329683184 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:40:50 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-27372467-a491-409d-ad75-42e772b3f2ce tempest-CinderUnicodeTest-1329683184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:40:50 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-27372467-a491-409d-ad75-42e772b3f2ce tempest-CinderUnicodeTest-1329683184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:40:50 devstack sudo[112738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf Jun 29 03:40:50 devstack sudo[112738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:40:51 devstack sudo[112738]: pam_unix(sudo:session): session closed for user root Jun 29 03:40:51 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-80e62cc8-8100-462c-88a2-045e25c89991 tempest-VolumesSnapshotNegativeTestJSON-330901232 None] Acquiring lock "cinder-b3bfcce6-1ad3-4e47-b991-50360ba14ab9-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:40:51 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-27372467-a491-409d-ad75-42e772b3f2ce tempest-CinderUnicodeTest-1329683184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf" returned: 0 in 0.654s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:40:51 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-27372467-a491-409d-ad75-42e772b3f2ce tempest-CinderUnicodeTest-1329683184 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:40:51 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-80e62cc8-8100-462c-88a2-045e25c89991 tempest-VolumesSnapshotNegativeTestJSON-330901232 None] Lock "cinder-b3bfcce6-1ad3-4e47-b991-50360ba14ab9-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:40:51 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-27372467-a491-409d-ad75-42e772b3f2ce tempest-CinderUnicodeTest-1329683184 None] Deleted volume successfully. Jun 29 03:40:51 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-27372467-a491-409d-ad75-42e772b3f2ce tempest-CinderUnicodeTest-1329683184 None] Lock "cinder-3bac770c-63c3-4d8b-82ab-4a9fae98f0db-delete_volume" released by "delete_volume" :: held 2.346s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:40:51 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-80e62cc8-8100-462c-88a2-045e25c89991 tempest-VolumesSnapshotNegativeTestJSON-330901232 None] Acquiring lock "cinder-quobyte-b3bfcce6-1ad3-4e47-b991-50360ba14ab9" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:40:51 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-80e62cc8-8100-462c-88a2-045e25c89991 tempest-VolumesSnapshotNegativeTestJSON-330901232 None] Lock "cinder-quobyte-b3bfcce6-1ad3-4e47-b991-50360ba14ab9" acquired by "delete_volume" :: waited 0.016s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:40:51 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[7286dece-5abb-4cb2-a1c3-65489f19ed7d]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:40:51 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-80e62cc8-8100-462c-88a2-045e25c89991 tempest-VolumesSnapshotNegativeTestJSON-330901232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-b3bfcce6-1ad3-4e47-b991-50360ba14ab9 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:40:51 devstack sudo[112741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-b3bfcce6-1ad3-4e47-b991-50360ba14ab9 Jun 29 03:40:51 devstack sudo[112741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:40:52 devstack sudo[112741]: pam_unix(sudo:session): session closed for user root Jun 29 03:40:52 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-80e62cc8-8100-462c-88a2-045e25c89991 tempest-VolumesSnapshotNegativeTestJSON-330901232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-b3bfcce6-1ad3-4e47-b991-50360ba14ab9" returned: 0 in 0.795s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:40:52 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-80e62cc8-8100-462c-88a2-045e25c89991 tempest-VolumesSnapshotNegativeTestJSON-330901232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-b3bfcce6-1ad3-4e47-b991-50360ba14ab9 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:40:52 devstack sudo[112747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-b3bfcce6-1ad3-4e47-b991-50360ba14ab9 Jun 29 03:40:52 devstack sudo[112747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:40:52 devstack sudo[112747]: pam_unix(sudo:session): session closed for user root Jun 29 03:40:52 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-80e62cc8-8100-462c-88a2-045e25c89991 tempest-VolumesSnapshotNegativeTestJSON-330901232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-b3bfcce6-1ad3-4e47-b991-50360ba14ab9" returned: 0 in 0.699s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:40:52 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-80e62cc8-8100-462c-88a2-045e25c89991 tempest-VolumesSnapshotNegativeTestJSON-330901232 None] Lock "cinder-quobyte-b3bfcce6-1ad3-4e47-b991-50360ba14ab9" released by "delete_volume" :: held 1.564s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:40:52 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-80e62cc8-8100-462c-88a2-045e25c89991 tempest-VolumesSnapshotNegativeTestJSON-330901232 None] Created reservations ['55a4a49c-9d56-4207-8c5e-76cd9590b679', '1d6c6abb-5bde-4e40-b4c7-b6a1e539ec61', 'fbb33ccc-7b37-44fb-ab6b-87cfb872003f', 'a8bb4274-a51d-4dd6-b8b1-40d10b1d3ef0'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:40:53 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-80e62cc8-8100-462c-88a2-045e25c89991 tempest-VolumesSnapshotNegativeTestJSON-330901232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:40:53 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-80e62cc8-8100-462c-88a2-045e25c89991 tempest-VolumesSnapshotNegativeTestJSON-330901232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:40:53 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-80e62cc8-8100-462c-88a2-045e25c89991 tempest-VolumesSnapshotNegativeTestJSON-330901232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:40:53 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-80e62cc8-8100-462c-88a2-045e25c89991 tempest-VolumesSnapshotNegativeTestJSON-330901232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:40:53 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-80e62cc8-8100-462c-88a2-045e25c89991 tempest-VolumesSnapshotNegativeTestJSON-330901232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:40:53 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-80e62cc8-8100-462c-88a2-045e25c89991 tempest-VolumesSnapshotNegativeTestJSON-330901232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:40:53 devstack sudo[112750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf Jun 29 03:40:53 devstack sudo[112750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:40:53 devstack sudo[112750]: pam_unix(sudo:session): session closed for user root Jun 29 03:40:53 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-80e62cc8-8100-462c-88a2-045e25c89991 tempest-VolumesSnapshotNegativeTestJSON-330901232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf" returned: 0 in 0.669s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:40:53 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-80e62cc8-8100-462c-88a2-045e25c89991 tempest-VolumesSnapshotNegativeTestJSON-330901232 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:40:53 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-80e62cc8-8100-462c-88a2-045e25c89991 tempest-VolumesSnapshotNegativeTestJSON-330901232 None] Deleted volume successfully. Jun 29 03:40:53 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-80e62cc8-8100-462c-88a2-045e25c89991 tempest-VolumesSnapshotNegativeTestJSON-330901232 None] Lock "cinder-b3bfcce6-1ad3-4e47-b991-50360ba14ab9-delete_volume" released by "delete_volume" :: held 2.464s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:41:00 devstack cinder-volume[93468]: DEBUG dbcounter [-] [93468] Writing DB stats cinder:SELECT=92,cinder:INSERT=33,cinder:UPDATE=107,cinder:DELETE=7 {{(pid=93468) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 29 03:41:00 devstack cinder-volume[93468]: DEBUG dbcounter [-] [93468] Writing DB stats cinder:SELECT=79,cinder:INSERT=29,cinder:UPDATE=100,cinder:DELETE=10 {{(pid=93468) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 29 03:41:11 devstack cinder-volume[93468]: DEBUG oslo_service.periodic_task [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93468) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 29 03:41:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:41:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:41:11 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:41:11 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:41:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:41:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:41:11 devstack sudo[112756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf Jun 29 03:41:11 devstack sudo[112756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:41:12 devstack sudo[112756]: pam_unix(sudo:session): session closed for user root Jun 29 03:41:12 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf" returned: 0 in 0.785s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:41:12 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:41:12 devstack cinder-volume[93468]: DEBUG oslo_service.periodic_task [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Running periodic task VolumeManager._thread_info {{(pid=93468) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 29 03:41:12 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] thread count: 28 {{(pid=93468) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 29 03:41:12 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] thread info: [<_MainThread(MainThread, started 132331377287296)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93468) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 29 03:41:14 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-a07a9dbc-6315-4f2b-ab85-16746caf6d15 tempest-SnapshotDependencyTests-1670886533 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:41:14 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-a07a9dbc-6315-4f2b-ab85-16746caf6d15 tempest-SnapshotDependencyTests-1670886533 None] Flow 'volume_create_manager' (55044678-270c-42a9-9817-b2351a799134) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:41:14 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-a07a9dbc-6315-4f2b-ab85-16746caf6d15 tempest-SnapshotDependencyTests-1670886533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55761fc6-6b21-4177-ae9f-b5bed088554b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:41:14 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-a07a9dbc-6315-4f2b-ab85-16746caf6d15 tempest-SnapshotDependencyTests-1670886533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55761fc6-6b21-4177-ae9f-b5bed088554b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:41:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-2099893613',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=acd27224-a801-44a9-8292-402b90b9e242,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7589b4d732b9472cbb90dad79d39e75a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:41:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:41:15Z,use_quota=True,user_id='6fdfa99bd19b4b75a5cc23e9b9beb2b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:41:14 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-a07a9dbc-6315-4f2b-ab85-16746caf6d15 tempest-SnapshotDependencyTests-1670886533 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fc45546-9509-431f-87e2-ef4f9df05dcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:41:14 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-a07a9dbc-6315-4f2b-ab85-16746caf6d15 tempest-SnapshotDependencyTests-1670886533 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fc45546-9509-431f-87e2-ef4f9df05dcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:41:14 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-a07a9dbc-6315-4f2b-ab85-16746caf6d15 tempest-SnapshotDependencyTests-1670886533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79fc30da-e890-47f2-bc54-b14376e8a2f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:41:14 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-a07a9dbc-6315-4f2b-ab85-16746caf6d15 tempest-SnapshotDependencyTests-1670886533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79fc30da-e890-47f2-bc54-b14376e8a2f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'acd27224-a801-44a9-8292-402b90b9e242', 'volume_name': 'volume-acd27224-a801-44a9-8292-402b90b9e242', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:41:15 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-a07a9dbc-6315-4f2b-ab85-16746caf6d15 tempest-SnapshotDependencyTests-1670886533 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bca55797-3f00-40c2-9c56-f44122be2d39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:41:15 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-a07a9dbc-6315-4f2b-ab85-16746caf6d15 tempest-SnapshotDependencyTests-1670886533 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bca55797-3f00-40c2-9c56-f44122be2d39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:41:15 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-a07a9dbc-6315-4f2b-ab85-16746caf6d15 tempest-SnapshotDependencyTests-1670886533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a87edbb-cbef-4dc8-aa48-d7e17485420b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:41:15 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-a07a9dbc-6315-4f2b-ab85-16746caf6d15 tempest-SnapshotDependencyTests-1670886533 None] Volume acd27224-a801-44a9-8292-402b90b9e242: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-acd27224-a801-44a9-8292-402b90b9e242', 'volume_size': 1} Jun 29 03:41:15 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-a07a9dbc-6315-4f2b-ab85-16746caf6d15 tempest-SnapshotDependencyTests-1670886533 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:41:15 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-a07a9dbc-6315-4f2b-ab85-16746caf6d15 tempest-SnapshotDependencyTests-1670886533 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:41:15 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-a07a9dbc-6315-4f2b-ab85-16746caf6d15 tempest-SnapshotDependencyTests-1670886533 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:41:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-2099893613',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=acd27224-a801-44a9-8292-402b90b9e242,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7589b4d732b9472cbb90dad79d39e75a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:41:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:41:15Z,use_quota=True,user_id='6fdfa99bd19b4b75a5cc23e9b9beb2b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:41:15 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-a07a9dbc-6315-4f2b-ab85-16746caf6d15 tempest-SnapshotDependencyTests-1670886533 None] Creating volume acd27224-a801-44a9-8292-402b90b9e242 {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:41:15 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-a07a9dbc-6315-4f2b-ab85-16746caf6d15 tempest-SnapshotDependencyTests-1670886533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:41:15 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-a07a9dbc-6315-4f2b-ab85-16746caf6d15 tempest-SnapshotDependencyTests-1670886533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:41:15 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-a07a9dbc-6315-4f2b-ab85-16746caf6d15 tempest-SnapshotDependencyTests-1670886533 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:41:15 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-a07a9dbc-6315-4f2b-ab85-16746caf6d15 tempest-SnapshotDependencyTests-1670886533 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:41:15 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-a07a9dbc-6315-4f2b-ab85-16746caf6d15 tempest-SnapshotDependencyTests-1670886533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:41:15 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-a07a9dbc-6315-4f2b-ab85-16746caf6d15 tempest-SnapshotDependencyTests-1670886533 None] Selected osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:41:15 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-a07a9dbc-6315-4f2b-ab85-16746caf6d15 tempest-SnapshotDependencyTests-1670886533 None] casted to osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f Jun 29 03:41:15 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a07a9dbc-6315-4f2b-ab85-16746caf6d15 tempest-SnapshotDependencyTests-1670886533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-acd27224-a801-44a9-8292-402b90b9e242 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:41:15 devstack sudo[112760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-acd27224-a801-44a9-8292-402b90b9e242 1073741824 Jun 29 03:41:15 devstack sudo[112760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:41:16 devstack sudo[112760]: pam_unix(sudo:session): session closed for user root Jun 29 03:41:16 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a07a9dbc-6315-4f2b-ab85-16746caf6d15 tempest-SnapshotDependencyTests-1670886533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-acd27224-a801-44a9-8292-402b90b9e242 1073741824" returned: 0 in 0.983s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:41:16 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a07a9dbc-6315-4f2b-ab85-16746caf6d15 tempest-SnapshotDependencyTests-1670886533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-acd27224-a801-44a9-8292-402b90b9e242 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:41:16 devstack sudo[112767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-acd27224-a801-44a9-8292-402b90b9e242 Jun 29 03:41:16 devstack sudo[112767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:41:16 devstack sudo[112767]: pam_unix(sudo:session): session closed for user root Jun 29 03:41:16 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a07a9dbc-6315-4f2b-ab85-16746caf6d15 tempest-SnapshotDependencyTests-1670886533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-acd27224-a801-44a9-8292-402b90b9e242" returned: 0 in 0.683s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:41:16 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-a07a9dbc-6315-4f2b-ab85-16746caf6d15 tempest-SnapshotDependencyTests-1670886533 None] <== create_volume: return (1710ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:41:16 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-a07a9dbc-6315-4f2b-ab85-16746caf6d15 tempest-SnapshotDependencyTests-1670886533 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.713s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:41:16 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-a07a9dbc-6315-4f2b-ab85-16746caf6d15 tempest-SnapshotDependencyTests-1670886533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a87edbb-cbef-4dc8-aa48-d7e17485420b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-acd27224-a801-44a9-8292-402b90b9e242', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:41:16 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-a07a9dbc-6315-4f2b-ab85-16746caf6d15 tempest-SnapshotDependencyTests-1670886533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ab04fa8-4eae-4634-88dc-135a73334c1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:41:16 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-a07a9dbc-6315-4f2b-ab85-16746caf6d15 tempest-SnapshotDependencyTests-1670886533 None] Volume volume-acd27224-a801-44a9-8292-402b90b9e242 (acd27224-a801-44a9-8292-402b90b9e242): created successfully Jun 29 03:41:16 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-a07a9dbc-6315-4f2b-ab85-16746caf6d15 tempest-SnapshotDependencyTests-1670886533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ab04fa8-4eae-4634-88dc-135a73334c1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:41:16 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-a07a9dbc-6315-4f2b-ab85-16746caf6d15 tempest-SnapshotDependencyTests-1670886533 None] Flow 'volume_create_manager' (55044678-270c-42a9-9817-b2351a799134) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:41:16 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-a07a9dbc-6315-4f2b-ab85-16746caf6d15 tempest-SnapshotDependencyTests-1670886533 None] Created volume successfully. Jun 29 03:41:17 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-72936ffe-aebe-44b1-9625-d62dfcc1da64 tempest-SnapshotDependencyTests-1670886533 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:41:17 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-72936ffe-aebe-44b1-9625-d62dfcc1da64 tempest-SnapshotDependencyTests-1670886533 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:41:17 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-72936ffe-aebe-44b1-9625-d62dfcc1da64 tempest-SnapshotDependencyTests-1670886533 None] Creating offline snapshot e4498cbb-21b7-438b-bd93-e6b0be058e22 of volume acd27224-a801-44a9-8292-402b90b9e242 {{(pid=93468) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 29 03:41:17 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[63b32c86-6aaf-4305-a2be-374b833bf49b]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:41:17 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-72936ffe-aebe-44b1-9625-d62dfcc1da64 tempest-SnapshotDependencyTests-1670886533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-acd27224-a801-44a9-8292-402b90b9e242 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:41:17 devstack sudo[112772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-acd27224-a801-44a9-8292-402b90b9e242 Jun 29 03:41:17 devstack sudo[112772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:41:18 devstack sudo[112772]: pam_unix(sudo:session): session closed for user root Jun 29 03:41:18 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-72936ffe-aebe-44b1-9625-d62dfcc1da64 tempest-SnapshotDependencyTests-1670886533 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-acd27224-a801-44a9-8292-402b90b9e242" returned: 0 in 0.831s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:41:18 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-72936ffe-aebe-44b1-9625-d62dfcc1da64 tempest-SnapshotDependencyTests-1670886533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-acd27224-a801-44a9-8292-402b90b9e242,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-acd27224-a801-44a9-8292-402b90b9e242.e4498cbb-21b7-438b-bd93-e6b0be058e22 1G {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:41:18 devstack sudo[112777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-acd27224-a801-44a9-8292-402b90b9e242,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-acd27224-a801-44a9-8292-402b90b9e242.e4498cbb-21b7-438b-bd93-e6b0be058e22 1G Jun 29 03:41:18 devstack sudo[112777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:41:18 devstack sudo[112777]: pam_unix(sudo:session): session closed for user root Jun 29 03:41:18 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-72936ffe-aebe-44b1-9625-d62dfcc1da64 tempest-SnapshotDependencyTests-1670886533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-acd27224-a801-44a9-8292-402b90b9e242,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-acd27224-a801-44a9-8292-402b90b9e242.e4498cbb-21b7-438b-bd93-e6b0be058e22 1G" returned: 0 in 0.869s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:41:18 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-72936ffe-aebe-44b1-9625-d62dfcc1da64 tempest-SnapshotDependencyTests-1670886533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-acd27224-a801-44a9-8292-402b90b9e242 -F qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-acd27224-a801-44a9-8292-402b90b9e242.e4498cbb-21b7-438b-bd93-e6b0be058e22 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:41:19 devstack sudo[112783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-acd27224-a801-44a9-8292-402b90b9e242 -F qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-acd27224-a801-44a9-8292-402b90b9e242.e4498cbb-21b7-438b-bd93-e6b0be058e22 Jun 29 03:41:19 devstack sudo[112783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:41:19 devstack sudo[112783]: pam_unix(sudo:session): session closed for user root Jun 29 03:41:19 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-72936ffe-aebe-44b1-9625-d62dfcc1da64 tempest-SnapshotDependencyTests-1670886533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-acd27224-a801-44a9-8292-402b90b9e242 -F qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-acd27224-a801-44a9-8292-402b90b9e242.e4498cbb-21b7-438b-bd93-e6b0be058e22" returned: 0 in 0.704s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:41:19 devstack cinder-volume[93468]: WARNING cinder.volume.drivers.remotefs [None req-72936ffe-aebe-44b1-9625-d62dfcc1da64 tempest-SnapshotDependencyTests-1670886533 None] /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-acd27224-a801-44a9-8292-402b90b9e242.e4498cbb-21b7-438b-bd93-e6b0be058e22 is being set with open permissions: ugo+rw Jun 29 03:41:19 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-72936ffe-aebe-44b1-9625-d62dfcc1da64 tempest-SnapshotDependencyTests-1670886533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-acd27224-a801-44a9-8292-402b90b9e242.e4498cbb-21b7-438b-bd93-e6b0be058e22 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:41:19 devstack sudo[112788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-acd27224-a801-44a9-8292-402b90b9e242.e4498cbb-21b7-438b-bd93-e6b0be058e22 Jun 29 03:41:19 devstack sudo[112788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:41:20 devstack sudo[112788]: pam_unix(sudo:session): session closed for user root Jun 29 03:41:20 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-72936ffe-aebe-44b1-9625-d62dfcc1da64 tempest-SnapshotDependencyTests-1670886533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-acd27224-a801-44a9-8292-402b90b9e242.e4498cbb-21b7-438b-bd93-e6b0be058e22" returned: 0 in 0.659s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:41:20 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-72936ffe-aebe-44b1-9625-d62dfcc1da64 tempest-SnapshotDependencyTests-1670886533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-acd27224-a801-44a9-8292-402b90b9e242.info {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:41:20 devstack sudo[112791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-acd27224-a801-44a9-8292-402b90b9e242.info Jun 29 03:41:20 devstack sudo[112791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:41:21 devstack sudo[112791]: pam_unix(sudo:session): session closed for user root Jun 29 03:41:21 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-72936ffe-aebe-44b1-9625-d62dfcc1da64 tempest-SnapshotDependencyTests-1670886533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-acd27224-a801-44a9-8292-402b90b9e242.info" returned: 0 in 0.692s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:41:21 devstack cinder-volume[93468]: WARNING cinder.volume.drivers.remotefs [None req-72936ffe-aebe-44b1-9625-d62dfcc1da64 tempest-SnapshotDependencyTests-1670886533 None] /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-acd27224-a801-44a9-8292-402b90b9e242.info is being set with open permissions: ugo+rw Jun 29 03:41:21 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-72936ffe-aebe-44b1-9625-d62dfcc1da64 tempest-SnapshotDependencyTests-1670886533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-acd27224-a801-44a9-8292-402b90b9e242.info {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:41:21 devstack sudo[112794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-acd27224-a801-44a9-8292-402b90b9e242.info Jun 29 03:41:21 devstack sudo[112794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:41:21 devstack sudo[112794]: pam_unix(sudo:session): session closed for user root Jun 29 03:41:21 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-72936ffe-aebe-44b1-9625-d62dfcc1da64 tempest-SnapshotDependencyTests-1670886533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-acd27224-a801-44a9-8292-402b90b9e242.info" returned: 0 in 0.647s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:41:21 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-72936ffe-aebe-44b1-9625-d62dfcc1da64 tempest-SnapshotDependencyTests-1670886533 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.509s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:41:21 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-72936ffe-aebe-44b1-9625-d62dfcc1da64 tempest-SnapshotDependencyTests-1670886533 None] Create snapshot completed successfully Jun 29 03:41:23 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e5082ef-2a8b-49a7-b32f-0a3e6d150cba tempest-SnapshotDependencyTests-1670886533 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:41:23 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-2e5082ef-2a8b-49a7-b32f-0a3e6d150cba tempest-SnapshotDependencyTests-1670886533 None] Flow 'volume_create_manager' (8089ac4a-9f5f-4c02-bbbb-d625461f3a27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:41:23 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-2e5082ef-2a8b-49a7-b32f-0a3e6d150cba tempest-SnapshotDependencyTests-1670886533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3455a726-d8b2-44e3-8b73-54617aac18ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:41:23 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-2e5082ef-2a8b-49a7-b32f-0a3e6d150cba tempest-SnapshotDependencyTests-1670886533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3455a726-d8b2-44e3-8b73-54617aac18ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:41:23Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ccb786d4-15ae-45d3-89a9-ef198279fc68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7589b4d732b9472cbb90dad79d39e75a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:41:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=e4498cbb-21b7-438b-bd93-e6b0be058e22,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:41:23Z,use_quota=True,user_id='6fdfa99bd19b4b75a5cc23e9b9beb2b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:41:23 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-2e5082ef-2a8b-49a7-b32f-0a3e6d150cba tempest-SnapshotDependencyTests-1670886533 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a29eb576-9ce2-4c98-8f78-92200dd0c3ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:41:23 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-2e5082ef-2a8b-49a7-b32f-0a3e6d150cba tempest-SnapshotDependencyTests-1670886533 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a29eb576-9ce2-4c98-8f78-92200dd0c3ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:41:23 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-2e5082ef-2a8b-49a7-b32f-0a3e6d150cba tempest-SnapshotDependencyTests-1670886533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1af92e9-43c5-4260-9a10-353ffbec43b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:41:23 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-2e5082ef-2a8b-49a7-b32f-0a3e6d150cba tempest-SnapshotDependencyTests-1670886533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1af92e9-43c5-4260-9a10-353ffbec43b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'ccb786d4-15ae-45d3-89a9-ef198279fc68', 'volume_name': 'volume-ccb786d4-15ae-45d3-89a9-ef198279fc68', 'volume_size': 1, 'snapshot_id': 'e4498cbb-21b7-438b-bd93-e6b0be058e22'}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:41:23 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-2e5082ef-2a8b-49a7-b32f-0a3e6d150cba tempest-SnapshotDependencyTests-1670886533 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e61f0cb5-26f8-4a97-b4b6-84059751ec8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:41:23 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-2e5082ef-2a8b-49a7-b32f-0a3e6d150cba tempest-SnapshotDependencyTests-1670886533 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e61f0cb5-26f8-4a97-b4b6-84059751ec8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:41:23 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-2e5082ef-2a8b-49a7-b32f-0a3e6d150cba tempest-SnapshotDependencyTests-1670886533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2f4105f-114a-47fb-9785-5925677f6617) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:41:23 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-2e5082ef-2a8b-49a7-b32f-0a3e6d150cba tempest-SnapshotDependencyTests-1670886533 None] Volume ccb786d4-15ae-45d3-89a9-ef198279fc68: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-ccb786d4-15ae-45d3-89a9-ef198279fc68', 'volume_size': 1, 'snapshot_id': 'e4498cbb-21b7-438b-bd93-e6b0be058e22'} Jun 29 03:41:23 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-2e5082ef-2a8b-49a7-b32f-0a3e6d150cba tempest-SnapshotDependencyTests-1670886533 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:41:23 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-2e5082ef-2a8b-49a7-b32f-0a3e6d150cba tempest-SnapshotDependencyTests-1670886533 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:41:23 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-2e5082ef-2a8b-49a7-b32f-0a3e6d150cba tempest-SnapshotDependencyTests-1670886533 None] Acquiring lock "cinder-quobyte-e4498cbb-21b7-438b-bd93-e6b0be058e22-ccb786d4-15ae-45d3-89a9-ef198279fc68" by "_create_volume_from_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:41:23 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-2e5082ef-2a8b-49a7-b32f-0a3e6d150cba tempest-SnapshotDependencyTests-1670886533 None] Lock "cinder-quobyte-e4498cbb-21b7-438b-bd93-e6b0be058e22-ccb786d4-15ae-45d3-89a9-ef198279fc68" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:41:23 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-2e5082ef-2a8b-49a7-b32f-0a3e6d150cba tempest-SnapshotDependencyTests-1670886533 None] Creating volume ccb786d4-15ae-45d3-89a9-ef198279fc68 from snapshot e4498cbb-21b7-438b-bd93-e6b0be058e22 {{(pid=93468) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 29 03:41:23 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-2e5082ef-2a8b-49a7-b32f-0a3e6d150cba tempest-SnapshotDependencyTests-1670886533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:41:23 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-2e5082ef-2a8b-49a7-b32f-0a3e6d150cba tempest-SnapshotDependencyTests-1670886533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:41:23 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-2e5082ef-2a8b-49a7-b32f-0a3e6d150cba tempest-SnapshotDependencyTests-1670886533 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:41:23 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-2e5082ef-2a8b-49a7-b32f-0a3e6d150cba tempest-SnapshotDependencyTests-1670886533 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:41:23 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-2e5082ef-2a8b-49a7-b32f-0a3e6d150cba tempest-SnapshotDependencyTests-1670886533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:41:23 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-2e5082ef-2a8b-49a7-b32f-0a3e6d150cba tempest-SnapshotDependencyTests-1670886533 None] Selected osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:41:23 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-2e5082ef-2a8b-49a7-b32f-0a3e6d150cba tempest-SnapshotDependencyTests-1670886533 None] Acquiring lock "cinder-quobyte-ccb786d4-15ae-45d3-89a9-ef198279fc68" by "_copy_volume_from_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:41:23 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-2e5082ef-2a8b-49a7-b32f-0a3e6d150cba tempest-SnapshotDependencyTests-1670886533 None] Lock "cinder-quobyte-ccb786d4-15ae-45d3-89a9-ef198279fc68" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:41:23 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-2e5082ef-2a8b-49a7-b32f-0a3e6d150cba tempest-SnapshotDependencyTests-1670886533 None] snapshot: e4498cbb-21b7-438b-bd93-e6b0be058e22, volume: ccb786d4-15ae-45d3-89a9-ef198279fc68, {{(pid=93468) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 29 03:41:23 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-2e5082ef-2a8b-49a7-b32f-0a3e6d150cba tempest-SnapshotDependencyTests-1670886533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:41:23 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-2e5082ef-2a8b-49a7-b32f-0a3e6d150cba tempest-SnapshotDependencyTests-1670886533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:41:23 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-2e5082ef-2a8b-49a7-b32f-0a3e6d150cba tempest-SnapshotDependencyTests-1670886533 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:41:23 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-2e5082ef-2a8b-49a7-b32f-0a3e6d150cba tempest-SnapshotDependencyTests-1670886533 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:41:23 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-2e5082ef-2a8b-49a7-b32f-0a3e6d150cba tempest-SnapshotDependencyTests-1670886533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:41:23 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd856dd7-e9d7-4a50-870a-4765dfa55e33]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:41:23 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2e5082ef-2a8b-49a7-b32f-0a3e6d150cba tempest-SnapshotDependencyTests-1670886533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-acd27224-a801-44a9-8292-402b90b9e242.e4498cbb-21b7-438b-bd93-e6b0be058e22 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:41:23 devstack sudo[112798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-acd27224-a801-44a9-8292-402b90b9e242.e4498cbb-21b7-438b-bd93-e6b0be058e22 Jun 29 03:41:23 devstack sudo[112798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:41:24 devstack sudo[112798]: pam_unix(sudo:session): session closed for user root Jun 29 03:41:24 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2e5082ef-2a8b-49a7-b32f-0a3e6d150cba tempest-SnapshotDependencyTests-1670886533 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-acd27224-a801-44a9-8292-402b90b9e242.e4498cbb-21b7-438b-bd93-e6b0be058e22" returned: 0 in 0.785s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:41:24 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-2e5082ef-2a8b-49a7-b32f-0a3e6d150cba tempest-SnapshotDependencyTests-1670886533 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-acd27224-a801-44a9-8292-402b90b9e242(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93468) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 29 03:41:24 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-2e5082ef-2a8b-49a7-b32f-0a3e6d150cba tempest-SnapshotDependencyTests-1670886533 None] will copy from snapshot at /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-acd27224-a801-44a9-8292-402b90b9e242 {{(pid=93468) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 29 03:41:24 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-2e5082ef-2a8b-49a7-b32f-0a3e6d150cba tempest-SnapshotDependencyTests-1670886533 None] Creating direct copy from snapshot {{(pid=93468) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 29 03:41:24 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d5274d1-3b6e-4f41-960c-f6a69e6b8ee1]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:41:24 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2e5082ef-2a8b-49a7-b32f-0a3e6d150cba tempest-SnapshotDependencyTests-1670886533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-acd27224-a801-44a9-8292-402b90b9e242 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:41:24 devstack sudo[112804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-acd27224-a801-44a9-8292-402b90b9e242 Jun 29 03:41:24 devstack sudo[112804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:41:25 devstack sudo[112804]: pam_unix(sudo:session): session closed for user root Jun 29 03:41:25 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2e5082ef-2a8b-49a7-b32f-0a3e6d150cba tempest-SnapshotDependencyTests-1670886533 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-acd27224-a801-44a9-8292-402b90b9e242" returned: 0 in 0.889s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:41:25 devstack cinder-volume[93468]: DEBUG cinder.utils [None req-2e5082ef-2a8b-49a7-b32f-0a3e6d150cba tempest-SnapshotDependencyTests-1670886533 None] Path /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-ccb786d4-15ae-45d3-89a9-ef198279fc68 not found in is_blk_device check {{(pid=93468) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 29 03:41:25 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2e5082ef-2a8b-49a7-b32f-0a3e6d150cba tempest-SnapshotDependencyTests-1670886533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-acd27224-a801-44a9-8292-402b90b9e242 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-ccb786d4-15ae-45d3-89a9-ef198279fc68 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:41:25 devstack sudo[112809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-acd27224-a801-44a9-8292-402b90b9e242 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-ccb786d4-15ae-45d3-89a9-ef198279fc68 Jun 29 03:41:25 devstack sudo[112809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:41:30 devstack sudo[112809]: pam_unix(sudo:session): session closed for user root Jun 29 03:41:30 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2e5082ef-2a8b-49a7-b32f-0a3e6d150cba tempest-SnapshotDependencyTests-1670886533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-acd27224-a801-44a9-8292-402b90b9e242 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-ccb786d4-15ae-45d3-89a9-ef198279fc68" returned: 0 in 5.258s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:41:30 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea2e4be2-9dfd-48c9-b702-71dbeb3e48f8]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:41:30 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2e5082ef-2a8b-49a7-b32f-0a3e6d150cba tempest-SnapshotDependencyTests-1670886533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-acd27224-a801-44a9-8292-402b90b9e242 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:41:30 devstack sudo[112829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-acd27224-a801-44a9-8292-402b90b9e242 Jun 29 03:41:30 devstack sudo[112829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:41:31 devstack sudo[112829]: pam_unix(sudo:session): session closed for user root Jun 29 03:41:31 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2e5082ef-2a8b-49a7-b32f-0a3e6d150cba tempest-SnapshotDependencyTests-1670886533 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-acd27224-a801-44a9-8292-402b90b9e242" returned: 0 in 0.945s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:41:31 devstack cinder-volume[93468]: DEBUG cinder.image.image_utils [None req-2e5082ef-2a8b-49a7-b32f-0a3e6d150cba tempest-SnapshotDependencyTests-1670886533 None] Image conversion details: src /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-acd27224-a801-44a9-8292-402b90b9e242, size 1024.00 MB, duration 5.26 sec, destination /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-ccb786d4-15ae-45d3-89a9-ef198279fc68 {{(pid=93468) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 29 03:41:31 devstack cinder-volume[93468]: INFO cinder.image.image_utils [None req-2e5082ef-2a8b-49a7-b32f-0a3e6d150cba tempest-SnapshotDependencyTests-1670886533 None] Converted 1024.00 MB image at 194.72 MB/s Jun 29 03:41:31 devstack cinder-volume[93468]: WARNING cinder.volume.drivers.remotefs [None req-2e5082ef-2a8b-49a7-b32f-0a3e6d150cba tempest-SnapshotDependencyTests-1670886533 None] /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-ccb786d4-15ae-45d3-89a9-ef198279fc68 is being set with open permissions: ugo+rw Jun 29 03:41:31 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2e5082ef-2a8b-49a7-b32f-0a3e6d150cba tempest-SnapshotDependencyTests-1670886533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-ccb786d4-15ae-45d3-89a9-ef198279fc68 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:41:31 devstack sudo[112834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-ccb786d4-15ae-45d3-89a9-ef198279fc68 Jun 29 03:41:31 devstack sudo[112834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:41:31 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-3092a8ee-3377-48ef-b470-3c47f10767e3 tempest-TestShelveInstance-60316550 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:41:31 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-3092a8ee-3377-48ef-b470-3c47f10767e3 tempest-TestShelveInstance-60316550 None] Flow 'volume_create_manager' (61753386-086e-457f-834b-b89cedfa0c50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:41:32 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-3092a8ee-3377-48ef-b470-3c47f10767e3 tempest-TestShelveInstance-60316550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22f26b40-6fa3-4172-9880-b41c8efeb807) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:41:32 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-3092a8ee-3377-48ef-b470-3c47f10767e3 tempest-TestShelveInstance-60316550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22f26b40-6fa3-4172-9880-b41c8efeb807) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:41:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1253883001',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5bb6207-142c-4e22-bfe7-dd3f9e9fc80c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2038e9e409f2410ab46a97d24c0ceb0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:41:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:41:32Z,use_quota=True,user_id='4318b0ccd00544a4a7757ebacaa8f390',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:41:32 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-3092a8ee-3377-48ef-b470-3c47f10767e3 tempest-TestShelveInstance-60316550 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4cb48bb7-0f59-4bea-af2c-a981585b09b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:41:32 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-3092a8ee-3377-48ef-b470-3c47f10767e3 tempest-TestShelveInstance-60316550 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4cb48bb7-0f59-4bea-af2c-a981585b09b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:41:32 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-3092a8ee-3377-48ef-b470-3c47f10767e3 tempest-TestShelveInstance-60316550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0fbe8d5-79cc-48ab-b279-b7d0c089f85b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:41:32 devstack cinder-volume[93468]: DEBUG cinder.image.glance [None req-3092a8ee-3377-48ef-b470-3c47f10767e3 tempest-TestShelveInstance-60316550 None] Creating Keystone auth plugin from conf {{(pid=93468) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 29 03:41:32 devstack sudo[112834]: pam_unix(sudo:session): session closed for user root Jun 29 03:41:32 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2e5082ef-2a8b-49a7-b32f-0a3e6d150cba tempest-SnapshotDependencyTests-1670886533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-ccb786d4-15ae-45d3-89a9-ef198279fc68" returned: 0 in 0.684s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:41:32 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-2e5082ef-2a8b-49a7-b32f-0a3e6d150cba tempest-SnapshotDependencyTests-1670886533 None] Lock "cinder-quobyte-ccb786d4-15ae-45d3-89a9-ef198279fc68" released by "_copy_volume_from_snapshot" :: held 8.658s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:41:32 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-2e5082ef-2a8b-49a7-b32f-0a3e6d150cba tempest-SnapshotDependencyTests-1670886533 None] Lock "cinder-quobyte-e4498cbb-21b7-438b-bd93-e6b0be058e22-ccb786d4-15ae-45d3-89a9-ef198279fc68" released by "_create_volume_from_snapshot" :: held 8.689s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:41:32 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-2e5082ef-2a8b-49a7-b32f-0a3e6d150cba tempest-SnapshotDependencyTests-1670886533 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.705s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:41:32 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-2e5082ef-2a8b-49a7-b32f-0a3e6d150cba tempest-SnapshotDependencyTests-1670886533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2f4105f-114a-47fb-9785-5925677f6617) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ccb786d4-15ae-45d3-89a9-ef198279fc68', 'volume_size': 1, 'snapshot_id': 'e4498cbb-21b7-438b-bd93-e6b0be058e22'}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:41:32 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-2e5082ef-2a8b-49a7-b32f-0a3e6d150cba tempest-SnapshotDependencyTests-1670886533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa23afa1-0a79-458b-99c4-527b1ba2c519) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:41:32 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-2e5082ef-2a8b-49a7-b32f-0a3e6d150cba tempest-SnapshotDependencyTests-1670886533 None] Volume volume-ccb786d4-15ae-45d3-89a9-ef198279fc68 (ccb786d4-15ae-45d3-89a9-ef198279fc68): created successfully Jun 29 03:41:32 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-2e5082ef-2a8b-49a7-b32f-0a3e6d150cba tempest-SnapshotDependencyTests-1670886533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa23afa1-0a79-458b-99c4-527b1ba2c519) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:41:32 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-2e5082ef-2a8b-49a7-b32f-0a3e6d150cba tempest-SnapshotDependencyTests-1670886533 None] Flow 'volume_create_manager' (8089ac4a-9f5f-4c02-bbbb-d625461f3a27) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:41:32 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-2e5082ef-2a8b-49a7-b32f-0a3e6d150cba tempest-SnapshotDependencyTests-1670886533 None] Created volume successfully. Jun 29 03:41:32 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-3092a8ee-3377-48ef-b470-3c47f10767e3 tempest-TestShelveInstance-60316550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0fbe8d5-79cc-48ab-b279-b7d0c089f85b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e5bb6207-142c-4e22-bfe7-dd3f9e9fc80c', 'volume_name': 'volume-e5bb6207-142c-4e22-bfe7-dd3f9e9fc80c', 'volume_size': 1, 'image_id': '24cf6ce1-1d2d-493f-a115-2a39928c82fb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/24cf6ce1-1d2d-493f-a115-2a39928c82fb', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1335b5873eea4762b9fea7f84dd1615c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '24cf6ce1-1d2d-493f-a115-2a39928c82fb', 'created_at': datetime.datetime(2026, 6, 29, 1, 13, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 29, 1, 13, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/24cf6ce1-1d2d-493f-a115-2a39928c82fb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:41:32 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-3092a8ee-3377-48ef-b470-3c47f10767e3 tempest-TestShelveInstance-60316550 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11d3f94d-dae1-4146-87e4-b7adf4088ad2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:41:32 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-3092a8ee-3377-48ef-b470-3c47f10767e3 tempest-TestShelveInstance-60316550 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11d3f94d-dae1-4146-87e4-b7adf4088ad2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:41:32 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-3092a8ee-3377-48ef-b470-3c47f10767e3 tempest-TestShelveInstance-60316550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f54807d9-b146-4319-9fed-4aae1e73583b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:41:32 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-3092a8ee-3377-48ef-b470-3c47f10767e3 tempest-TestShelveInstance-60316550 None] Volume e5bb6207-142c-4e22-bfe7-dd3f9e9fc80c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e5bb6207-142c-4e22-bfe7-dd3f9e9fc80c', 'volume_size': 1, 'image_id': '24cf6ce1-1d2d-493f-a115-2a39928c82fb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/24cf6ce1-1d2d-493f-a115-2a39928c82fb', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1335b5873eea4762b9fea7f84dd1615c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '24cf6ce1-1d2d-493f-a115-2a39928c82fb', 'created_at': datetime.datetime(2026, 6, 29, 1, 13, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 29, 1, 13, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/24cf6ce1-1d2d-493f-a115-2a39928c82fb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jun 29 03:41:32 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-3092a8ee-3377-48ef-b470-3c47f10767e3 tempest-TestShelveInstance-60316550 None] Trying to clone e5bb6207-142c-4e22-bfe7-dd3f9e9fc80c from image 24cf6ce1-1d2d-493f-a115-2a39928c82fb at location (None, [{'url': 'file:///opt/stack/data/glance/images/24cf6ce1-1d2d-493f-a115-2a39928c82fb', 'metadata': {}}]). {{(pid=93468) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 29 03:41:32 devstack cinder-volume[93468]: DEBUG cinder.image.image_utils [None req-3092a8ee-3377-48ef-b470-3c47f10767e3 tempest-TestShelveInstance-60316550 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_24cf6ce1-1d2d-493f-a115-2a39928c82fb_5i9kfosbdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=93468) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 29 03:41:32 devstack cinder-volume[93468]: INFO cinder.image.image_utils [None req-3092a8ee-3377-48ef-b470-3c47f10767e3 tempest-TestShelveInstance-60316550 None] Image download 20.69 MB at 20.69 MB/s Jun 29 03:41:32 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bbe73f1-2a78-41ea-be54-db972564a1cc]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:41:32 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-3092a8ee-3377-48ef-b470-3c47f10767e3 tempest-TestShelveInstance-60316550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_24cf6ce1-1d2d-493f-a115-2a39928c82fb_5i9kfosbdevstack@QuobyteHD {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:41:32 devstack sudo[112839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_24cf6ce1-1d2d-493f-a115-2a39928c82fb_5i9kfosbdevstack@QuobyteHD Jun 29 03:41:32 devstack sudo[112839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:41:33 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-683ce452-8dc4-4d41-9cdb-253cde321b81 tempest-SnapshotDependencyTests-1670886533 None] Acquiring lock "cinder-e4498cbb-21b7-438b-bd93-e6b0be058e22-delete_snapshot" by "delete_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:41:33 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-683ce452-8dc4-4d41-9cdb-253cde321b81 tempest-SnapshotDependencyTests-1670886533 None] Lock "cinder-e4498cbb-21b7-438b-bd93-e6b0be058e22-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:41:33 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-683ce452-8dc4-4d41-9cdb-253cde321b81 tempest-SnapshotDependencyTests-1670886533 None] Acquiring lock "cinder-quobyte-acd27224-a801-44a9-8292-402b90b9e242" by "delete_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:41:33 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-683ce452-8dc4-4d41-9cdb-253cde321b81 tempest-SnapshotDependencyTests-1670886533 None] Lock "cinder-quobyte-acd27224-a801-44a9-8292-402b90b9e242" acquired by "delete_snapshot" :: waited 0.021s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:41:33 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-683ce452-8dc4-4d41-9cdb-253cde321b81 tempest-SnapshotDependencyTests-1670886533 None] Acquiring lock "cinder-quobyte-e4498cbb-21b7-438b-bd93-e6b0be058e22" by "_delete_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:41:33 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-683ce452-8dc4-4d41-9cdb-253cde321b81 tempest-SnapshotDependencyTests-1670886533 None] Lock "cinder-quobyte-e4498cbb-21b7-438b-bd93-e6b0be058e22" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:41:33 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-683ce452-8dc4-4d41-9cdb-253cde321b81 tempest-SnapshotDependencyTests-1670886533 None] Deleting offline snapshot e4498cbb-21b7-438b-bd93-e6b0be058e22 of volume acd27224-a801-44a9-8292-402b90b9e242 {{(pid=93468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 29 03:41:33 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-683ce452-8dc4-4d41-9cdb-253cde321b81 tempest-SnapshotDependencyTests-1670886533 None] snapshot_file for this snap is: volume-acd27224-a801-44a9-8292-402b90b9e242.e4498cbb-21b7-438b-bd93-e6b0be058e22 {{(pid=93468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 29 03:41:33 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aa41dd6-4db0-4b23-aa07-67ed219b81ad]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:41:33 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-683ce452-8dc4-4d41-9cdb-253cde321b81 tempest-SnapshotDependencyTests-1670886533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-acd27224-a801-44a9-8292-402b90b9e242.e4498cbb-21b7-438b-bd93-e6b0be058e22 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:41:33 devstack sudo[112839]: pam_unix(sudo:session): session closed for user root Jun 29 03:41:33 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-3092a8ee-3377-48ef-b470-3c47f10767e3 tempest-TestShelveInstance-60316550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_24cf6ce1-1d2d-493f-a115-2a39928c82fb_5i9kfosbdevstack@QuobyteHD" returned: 0 in 0.754s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:41:33 devstack cinder-volume[93468]: DEBUG cinder.image.image_utils [None req-3092a8ee-3377-48ef-b470-3c47f10767e3 tempest-TestShelveInstance-60316550 None] Temporary image 24cf6ce1-1d2d-493f-a115-2a39928c82fb is fetched for user 4318b0ccd00544a4a7757ebacaa8f390. {{(pid=93468) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 29 03:41:33 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf4a57c8-92cb-4328-b2a5-7aae7aeca89c]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:41:33 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-3092a8ee-3377-48ef-b470-3c47f10767e3 tempest-TestShelveInstance-60316550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_24cf6ce1-1d2d-493f-a115-2a39928c82fb_5i9kfosbdevstack@QuobyteHD {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:41:33 devstack sudo[112844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-acd27224-a801-44a9-8292-402b90b9e242.e4498cbb-21b7-438b-bd93-e6b0be058e22 Jun 29 03:41:33 devstack sudo[112844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:41:33 devstack sudo[112845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_24cf6ce1-1d2d-493f-a115-2a39928c82fb_5i9kfosbdevstack@QuobyteHD Jun 29 03:41:33 devstack sudo[112845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:41:34 devstack sudo[112844]: pam_unix(sudo:session): session closed for user root Jun 29 03:41:34 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-683ce452-8dc4-4d41-9cdb-253cde321b81 tempest-SnapshotDependencyTests-1670886533 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-acd27224-a801-44a9-8292-402b90b9e242.e4498cbb-21b7-438b-bd93-e6b0be058e22" returned: 0 in 0.775s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:41:34 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-683ce452-8dc4-4d41-9cdb-253cde321b81 tempest-SnapshotDependencyTests-1670886533 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-acd27224-a801-44a9-8292-402b90b9e242(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93468) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 29 03:41:34 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[283601af-162b-45f2-bd44-89f88cbaacb9]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:41:34 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-683ce452-8dc4-4d41-9cdb-253cde321b81 tempest-SnapshotDependencyTests-1670886533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-acd27224-a801-44a9-8292-402b90b9e242 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:41:34 devstack sudo[112845]: pam_unix(sudo:session): session closed for user root Jun 29 03:41:34 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-3092a8ee-3377-48ef-b470-3c47f10767e3 tempest-TestShelveInstance-60316550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_24cf6ce1-1d2d-493f-a115-2a39928c82fb_5i9kfosbdevstack@QuobyteHD" returned: 0 in 0.745s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:41:34 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-3092a8ee-3377-48ef-b470-3c47f10767e3 tempest-TestShelveInstance-60316550 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:41:34 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-3092a8ee-3377-48ef-b470-3c47f10767e3 tempest-TestShelveInstance-60316550 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:41:34 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-3092a8ee-3377-48ef-b470-3c47f10767e3 tempest-TestShelveInstance-60316550 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:41:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1253883001',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5bb6207-142c-4e22-bfe7-dd3f9e9fc80c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2038e9e409f2410ab46a97d24c0ceb0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:41:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:41:32Z,use_quota=True,user_id='4318b0ccd00544a4a7757ebacaa8f390',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:41:34 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-3092a8ee-3377-48ef-b470-3c47f10767e3 tempest-TestShelveInstance-60316550 None] Creating volume e5bb6207-142c-4e22-bfe7-dd3f9e9fc80c {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:41:34 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-3092a8ee-3377-48ef-b470-3c47f10767e3 tempest-TestShelveInstance-60316550 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:41:34 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-3092a8ee-3377-48ef-b470-3c47f10767e3 tempest-TestShelveInstance-60316550 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:41:34 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-3092a8ee-3377-48ef-b470-3c47f10767e3 tempest-TestShelveInstance-60316550 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:41:34 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-3092a8ee-3377-48ef-b470-3c47f10767e3 tempest-TestShelveInstance-60316550 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:41:34 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-3092a8ee-3377-48ef-b470-3c47f10767e3 tempest-TestShelveInstance-60316550 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:41:34 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-3092a8ee-3377-48ef-b470-3c47f10767e3 tempest-TestShelveInstance-60316550 None] Selected osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:41:34 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-3092a8ee-3377-48ef-b470-3c47f10767e3 tempest-TestShelveInstance-60316550 None] casted to osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f Jun 29 03:41:34 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-3092a8ee-3377-48ef-b470-3c47f10767e3 tempest-TestShelveInstance-60316550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-e5bb6207-142c-4e22-bfe7-dd3f9e9fc80c 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:41:34 devstack sudo[112855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-e5bb6207-142c-4e22-bfe7-dd3f9e9fc80c 1073741824 Jun 29 03:41:34 devstack sudo[112855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:41:34 devstack sudo[112854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-acd27224-a801-44a9-8292-402b90b9e242 Jun 29 03:41:34 devstack sudo[112854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:41:35 devstack sudo[112854]: pam_unix(sudo:session): session closed for user root Jun 29 03:41:35 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-683ce452-8dc4-4d41-9cdb-253cde321b81 tempest-SnapshotDependencyTests-1670886533 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-acd27224-a801-44a9-8292-402b90b9e242" returned: 0 in 0.765s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:41:35 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-683ce452-8dc4-4d41-9cdb-253cde321b81 tempest-SnapshotDependencyTests-1670886533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-acd27224-a801-44a9-8292-402b90b9e242.e4498cbb-21b7-438b-bd93-e6b0be058e22 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:41:35 devstack sudo[112865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-acd27224-a801-44a9-8292-402b90b9e242.e4498cbb-21b7-438b-bd93-e6b0be058e22 Jun 29 03:41:35 devstack sudo[112865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:41:35 devstack sudo[112855]: pam_unix(sudo:session): session closed for user root Jun 29 03:41:35 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-3092a8ee-3377-48ef-b470-3c47f10767e3 tempest-TestShelveInstance-60316550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-e5bb6207-142c-4e22-bfe7-dd3f9e9fc80c 1073741824" returned: 0 in 0.833s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:41:35 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-3092a8ee-3377-48ef-b470-3c47f10767e3 tempest-TestShelveInstance-60316550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-e5bb6207-142c-4e22-bfe7-dd3f9e9fc80c {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:41:35 devstack sudo[112867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-e5bb6207-142c-4e22-bfe7-dd3f9e9fc80c Jun 29 03:41:35 devstack sudo[112867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:41:35 devstack sudo[112865]: pam_unix(sudo:session): session closed for user root Jun 29 03:41:35 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-683ce452-8dc4-4d41-9cdb-253cde321b81 tempest-SnapshotDependencyTests-1670886533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-acd27224-a801-44a9-8292-402b90b9e242.e4498cbb-21b7-438b-bd93-e6b0be058e22" returned: 0 in 0.728s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:41:35 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-683ce452-8dc4-4d41-9cdb-253cde321b81 tempest-SnapshotDependencyTests-1670886533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-acd27224-a801-44a9-8292-402b90b9e242.e4498cbb-21b7-438b-bd93-e6b0be058e22 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:41:35 devstack sudo[112873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-acd27224-a801-44a9-8292-402b90b9e242.e4498cbb-21b7-438b-bd93-e6b0be058e22 Jun 29 03:41:35 devstack sudo[112873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:41:35 devstack sudo[112867]: pam_unix(sudo:session): session closed for user root Jun 29 03:41:35 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-3092a8ee-3377-48ef-b470-3c47f10767e3 tempest-TestShelveInstance-60316550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-e5bb6207-142c-4e22-bfe7-dd3f9e9fc80c" returned: 0 in 0.639s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:41:35 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-3092a8ee-3377-48ef-b470-3c47f10767e3 tempest-TestShelveInstance-60316550 None] <== create_volume: return (1521ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:41:35 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-3092a8ee-3377-48ef-b470-3c47f10767e3 tempest-TestShelveInstance-60316550 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.524s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:41:35 devstack cinder-volume[93468]: DEBUG cinder.volume.volume_utils [None req-3092a8ee-3377-48ef-b470-3c47f10767e3 tempest-TestShelveInstance-60316550 None] Attempting download of 24cf6ce1-1d2d-493f-a115-2a39928c82fb ((None, [{'url': 'file:///opt/stack/data/glance/images/24cf6ce1-1d2d-493f-a115-2a39928c82fb', 'metadata': {}}])) to volume e5bb6207-142c-4e22-bfe7-dd3f9e9fc80c. {{(pid=93468) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 29 03:41:35 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e6f2487-5fe2-4cf9-b515-5ae194ea2bc0]: (4, 'raw') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:41:35 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-3092a8ee-3377-48ef-b470-3c47f10767e3 tempest-TestShelveInstance-60316550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_24cf6ce1-1d2d-493f-a115-2a39928c82fb_2maq0jxi {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:41:36 devstack sudo[112875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_24cf6ce1-1d2d-493f-a115-2a39928c82fb_2maq0jxi Jun 29 03:41:36 devstack sudo[112875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:41:36 devstack sudo[112873]: pam_unix(sudo:session): session closed for user root Jun 29 03:41:36 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-683ce452-8dc4-4d41-9cdb-253cde321b81 tempest-SnapshotDependencyTests-1670886533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-acd27224-a801-44a9-8292-402b90b9e242.e4498cbb-21b7-438b-bd93-e6b0be058e22" returned: 0 in 0.656s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:41:36 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-683ce452-8dc4-4d41-9cdb-253cde321b81 tempest-SnapshotDependencyTests-1670886533 None] Lock "cinder-quobyte-e4498cbb-21b7-438b-bd93-e6b0be058e22" released by "_delete_snapshot" :: held 3.026s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:41:36 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-683ce452-8dc4-4d41-9cdb-253cde321b81 tempest-SnapshotDependencyTests-1670886533 None] Lock "cinder-quobyte-acd27224-a801-44a9-8292-402b90b9e242" released by "delete_snapshot" :: held 3.046s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:41:36 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-683ce452-8dc4-4d41-9cdb-253cde321b81 tempest-SnapshotDependencyTests-1670886533 None] Created reservations ['1fb56723-08cd-49c4-83cc-7af4257f7bb9', 'f56d45c9-2e41-494a-97c3-2568e398da48', 'c260f515-61fe-45be-856a-c1d923f13637', '3e4077f7-9d84-4e77-b3a6-e2e90354e7f9'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:41:36 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-683ce452-8dc4-4d41-9cdb-253cde321b81 tempest-SnapshotDependencyTests-1670886533 None] Delete snapshot completed successfully. Jun 29 03:41:36 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-683ce452-8dc4-4d41-9cdb-253cde321b81 tempest-SnapshotDependencyTests-1670886533 None] Lock "cinder-e4498cbb-21b7-438b-bd93-e6b0be058e22-delete_snapshot" released by "delete_snapshot" :: held 3.191s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:41:36 devstack sudo[112875]: pam_unix(sudo:session): session closed for user root Jun 29 03:41:36 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-3092a8ee-3377-48ef-b470-3c47f10767e3 tempest-TestShelveInstance-60316550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_24cf6ce1-1d2d-493f-a115-2a39928c82fb_2maq0jxi" returned: 0 in 0.734s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:41:36 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-3092a8ee-3377-48ef-b470-3c47f10767e3 tempest-TestShelveInstance-60316550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_24cf6ce1-1d2d-493f-a115-2a39928c82fb_2maq0jxi {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:41:36 devstack sudo[112880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_24cf6ce1-1d2d-493f-a115-2a39928c82fb_2maq0jxi Jun 29 03:41:36 devstack sudo[112880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:41:37 devstack sudo[112880]: pam_unix(sudo:session): session closed for user root Jun 29 03:41:37 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-3092a8ee-3377-48ef-b470-3c47f10767e3 tempest-TestShelveInstance-60316550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_24cf6ce1-1d2d-493f-a115-2a39928c82fb_2maq0jxi" returned: 1 in 0.726s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:41:37 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-3092a8ee-3377-48ef-b470-3c47f10767e3 tempest-TestShelveInstance-60316550 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_24cf6ce1-1d2d-493f-a115-2a39928c82fb_2maq0jxi' failed. Not Retrying. {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 29 03:41:37 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[13f78ab4-b86e-4c22-994e-853b8ef94272]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:41:37 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-3092a8ee-3377-48ef-b470-3c47f10767e3 tempest-TestShelveInstance-60316550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_24cf6ce1-1d2d-493f-a115-2a39928c82fb_5i9kfosbdevstack@QuobyteHD {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:41:37 devstack sudo[112884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_24cf6ce1-1d2d-493f-a115-2a39928c82fb_5i9kfosbdevstack@QuobyteHD Jun 29 03:41:37 devstack sudo[112884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:41:37 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-d183186c-9bcb-4597-9da3-7e85e430f254 tempest-SnapshotDependencyTests-1670886533 None] Acquiring lock "cinder-acd27224-a801-44a9-8292-402b90b9e242-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:41:37 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-d183186c-9bcb-4597-9da3-7e85e430f254 tempest-SnapshotDependencyTests-1670886533 None] Lock "cinder-acd27224-a801-44a9-8292-402b90b9e242-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:41:37 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-d183186c-9bcb-4597-9da3-7e85e430f254 tempest-SnapshotDependencyTests-1670886533 None] Acquiring lock "cinder-quobyte-acd27224-a801-44a9-8292-402b90b9e242" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:41:37 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-d183186c-9bcb-4597-9da3-7e85e430f254 tempest-SnapshotDependencyTests-1670886533 None] Lock "cinder-quobyte-acd27224-a801-44a9-8292-402b90b9e242" acquired by "delete_volume" :: waited 0.015s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:41:37 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[012bfecb-56b6-4246-b6aa-d9b481ef37c1]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:41:37 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d183186c-9bcb-4597-9da3-7e85e430f254 tempest-SnapshotDependencyTests-1670886533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-acd27224-a801-44a9-8292-402b90b9e242 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:41:37 devstack sudo[112886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-acd27224-a801-44a9-8292-402b90b9e242 Jun 29 03:41:37 devstack sudo[112886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:41:38 devstack sudo[112884]: pam_unix(sudo:session): session closed for user root Jun 29 03:41:38 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-3092a8ee-3377-48ef-b470-3c47f10767e3 tempest-TestShelveInstance-60316550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_24cf6ce1-1d2d-493f-a115-2a39928c82fb_5i9kfosbdevstack@QuobyteHD" returned: 0 in 0.722s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:41:38 devstack cinder-volume[93468]: DEBUG cinder.image.image_utils [None req-3092a8ee-3377-48ef-b470-3c47f10767e3 tempest-TestShelveInstance-60316550 None] 24cf6ce1-1d2d-493f-a115-2a39928c82fb was qcow2, converting to raw {{(pid=93468) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 29 03:41:38 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-3092a8ee-3377-48ef-b470-3c47f10767e3 tempest-TestShelveInstance-60316550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_24cf6ce1-1d2d-493f-a115-2a39928c82fb_5i9kfosbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-e5bb6207-142c-4e22-bfe7-dd3f9e9fc80c {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:41:38 devstack sudo[112891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_24cf6ce1-1d2d-493f-a115-2a39928c82fb_5i9kfosbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-e5bb6207-142c-4e22-bfe7-dd3f9e9fc80c Jun 29 03:41:38 devstack sudo[112891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:41:38 devstack sudo[112886]: pam_unix(sudo:session): session closed for user root Jun 29 03:41:38 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d183186c-9bcb-4597-9da3-7e85e430f254 tempest-SnapshotDependencyTests-1670886533 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-acd27224-a801-44a9-8292-402b90b9e242" returned: 0 in 0.773s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:41:38 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d183186c-9bcb-4597-9da3-7e85e430f254 tempest-SnapshotDependencyTests-1670886533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-acd27224-a801-44a9-8292-402b90b9e242 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:41:38 devstack sudo[112896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-acd27224-a801-44a9-8292-402b90b9e242 Jun 29 03:41:38 devstack sudo[112896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:41:39 devstack sudo[112896]: pam_unix(sudo:session): session closed for user root Jun 29 03:41:39 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d183186c-9bcb-4597-9da3-7e85e430f254 tempest-SnapshotDependencyTests-1670886533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-acd27224-a801-44a9-8292-402b90b9e242" returned: 0 in 0.751s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:41:39 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-d183186c-9bcb-4597-9da3-7e85e430f254 tempest-SnapshotDependencyTests-1670886533 None] Lock "cinder-quobyte-acd27224-a801-44a9-8292-402b90b9e242" released by "delete_volume" :: held 1.583s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:41:39 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-d183186c-9bcb-4597-9da3-7e85e430f254 tempest-SnapshotDependencyTests-1670886533 None] Created reservations ['a819bf1d-fc6a-4916-b749-342051f25d6a', '0d90e563-1d48-47b7-89fa-df4f86d3e465', '72b0fe45-58b6-4d94-995b-044a3ff3a888', '2fd3abf0-7cb5-47fb-b06b-96d00fd261be'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:41:39 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-d183186c-9bcb-4597-9da3-7e85e430f254 tempest-SnapshotDependencyTests-1670886533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:41:39 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-d183186c-9bcb-4597-9da3-7e85e430f254 tempest-SnapshotDependencyTests-1670886533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:41:39 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-d183186c-9bcb-4597-9da3-7e85e430f254 tempest-SnapshotDependencyTests-1670886533 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:41:39 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-d183186c-9bcb-4597-9da3-7e85e430f254 tempest-SnapshotDependencyTests-1670886533 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:41:39 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-d183186c-9bcb-4597-9da3-7e85e430f254 tempest-SnapshotDependencyTests-1670886533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:41:39 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d183186c-9bcb-4597-9da3-7e85e430f254 tempest-SnapshotDependencyTests-1670886533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:41:39 devstack sudo[112905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf Jun 29 03:41:39 devstack sudo[112905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:41:39 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-176d77dc-b657-4535-95a2-ec27f91af31e tempest-SnapshotDependencyTests-1670886533 None] Acquiring lock "cinder-ccb786d4-15ae-45d3-89a9-ef198279fc68-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:41:39 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-176d77dc-b657-4535-95a2-ec27f91af31e tempest-SnapshotDependencyTests-1670886533 None] Lock "cinder-ccb786d4-15ae-45d3-89a9-ef198279fc68-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:41:40 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-176d77dc-b657-4535-95a2-ec27f91af31e tempest-SnapshotDependencyTests-1670886533 None] Acquiring lock "cinder-quobyte-ccb786d4-15ae-45d3-89a9-ef198279fc68" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:41:40 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-176d77dc-b657-4535-95a2-ec27f91af31e tempest-SnapshotDependencyTests-1670886533 None] Lock "cinder-quobyte-ccb786d4-15ae-45d3-89a9-ef198279fc68" acquired by "delete_volume" :: waited 0.021s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:41:40 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[55d325ea-b324-4a19-b062-cb6a91a24417]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:41:40 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-176d77dc-b657-4535-95a2-ec27f91af31e tempest-SnapshotDependencyTests-1670886533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-ccb786d4-15ae-45d3-89a9-ef198279fc68 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:41:40 devstack sudo[112891]: pam_unix(sudo:session): session closed for user root Jun 29 03:41:40 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-3092a8ee-3377-48ef-b470-3c47f10767e3 tempest-TestShelveInstance-60316550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_24cf6ce1-1d2d-493f-a115-2a39928c82fb_5i9kfosbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-e5bb6207-142c-4e22-bfe7-dd3f9e9fc80c" returned: 0 in 1.897s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:41:40 devstack cinder-volume[93468]: DEBUG cinder.image.image_utils [None req-3092a8ee-3377-48ef-b470-3c47f10767e3 tempest-TestShelveInstance-60316550 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_24cf6ce1-1d2d-493f-a115-2a39928c82fb_5i9kfosbdevstack@QuobyteHD, size 112.00 MB, duration 1.90 sec, destination /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-e5bb6207-142c-4e22-bfe7-dd3f9e9fc80c {{(pid=93468) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 29 03:41:40 devstack cinder-volume[93468]: INFO cinder.image.image_utils [None req-3092a8ee-3377-48ef-b470-3c47f10767e3 tempest-TestShelveInstance-60316550 None] Converted 112.00 MB image at 58.97 MB/s Jun 29 03:41:40 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-3092a8ee-3377-48ef-b470-3c47f10767e3 tempest-TestShelveInstance-60316550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-e5bb6207-142c-4e22-bfe7-dd3f9e9fc80c 1G {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:41:40 devstack sudo[112909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-e5bb6207-142c-4e22-bfe7-dd3f9e9fc80c 1G Jun 29 03:41:40 devstack sudo[112909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:41:40 devstack sudo[112907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-ccb786d4-15ae-45d3-89a9-ef198279fc68 Jun 29 03:41:40 devstack sudo[112907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:41:40 devstack sudo[112905]: pam_unix(sudo:session): session closed for user root Jun 29 03:41:40 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d183186c-9bcb-4597-9da3-7e85e430f254 tempest-SnapshotDependencyTests-1670886533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf" returned: 0 in 0.689s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:41:40 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-d183186c-9bcb-4597-9da3-7e85e430f254 tempest-SnapshotDependencyTests-1670886533 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:41:40 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-d183186c-9bcb-4597-9da3-7e85e430f254 tempest-SnapshotDependencyTests-1670886533 None] Deleted volume successfully. Jun 29 03:41:40 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-d183186c-9bcb-4597-9da3-7e85e430f254 tempest-SnapshotDependencyTests-1670886533 None] Lock "cinder-acd27224-a801-44a9-8292-402b90b9e242-delete_volume" released by "delete_volume" :: held 2.505s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:41:40 devstack sudo[112909]: pam_unix(sudo:session): session closed for user root Jun 29 03:41:40 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-3092a8ee-3377-48ef-b470-3c47f10767e3 tempest-TestShelveInstance-60316550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-e5bb6207-142c-4e22-bfe7-dd3f9e9fc80c 1G" returned: 0 in 0.711s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:41:40 devstack sudo[112907]: pam_unix(sudo:session): session closed for user root Jun 29 03:41:40 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-176d77dc-b657-4535-95a2-ec27f91af31e tempest-SnapshotDependencyTests-1670886533 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-ccb786d4-15ae-45d3-89a9-ef198279fc68" returned: 0 in 0.752s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:41:40 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-176d77dc-b657-4535-95a2-ec27f91af31e tempest-SnapshotDependencyTests-1670886533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-ccb786d4-15ae-45d3-89a9-ef198279fc68 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:41:40 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb8dbbfa-dcb9-40ef-aee5-18a0a421b395]: (4, 'raw') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:41:40 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-3092a8ee-3377-48ef-b470-3c47f10767e3 tempest-TestShelveInstance-60316550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-e5bb6207-142c-4e22-bfe7-dd3f9e9fc80c {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:41:40 devstack sudo[112918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-ccb786d4-15ae-45d3-89a9-ef198279fc68 Jun 29 03:41:40 devstack sudo[112918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:41:40 devstack sudo[112919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-e5bb6207-142c-4e22-bfe7-dd3f9e9fc80c Jun 29 03:41:40 devstack sudo[112919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:41:41 devstack sudo[112918]: pam_unix(sudo:session): session closed for user root Jun 29 03:41:41 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-176d77dc-b657-4535-95a2-ec27f91af31e tempest-SnapshotDependencyTests-1670886533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-ccb786d4-15ae-45d3-89a9-ef198279fc68" returned: 0 in 0.644s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:41:41 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-176d77dc-b657-4535-95a2-ec27f91af31e tempest-SnapshotDependencyTests-1670886533 None] Lock "cinder-quobyte-ccb786d4-15ae-45d3-89a9-ef198279fc68" released by "delete_volume" :: held 1.437s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:41:41 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-176d77dc-b657-4535-95a2-ec27f91af31e tempest-SnapshotDependencyTests-1670886533 None] Created reservations ['2968b707-9d24-40d8-aa59-01a89dc40d6b', 'b0945d5d-7b80-49d2-a444-02a9ef66836a', '6733539c-442b-47c6-bab8-37bed6249fc6', 'a0035046-e3ef-4f8b-bc73-0c2d19b3b487'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:41:41 devstack sudo[112919]: pam_unix(sudo:session): session closed for user root Jun 29 03:41:41 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-3092a8ee-3377-48ef-b470-3c47f10767e3 tempest-TestShelveInstance-60316550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-e5bb6207-142c-4e22-bfe7-dd3f9e9fc80c" returned: 0 in 0.731s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:41:41 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-3092a8ee-3377-48ef-b470-3c47f10767e3 tempest-TestShelveInstance-60316550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-e5bb6207-142c-4e22-bfe7-dd3f9e9fc80c {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:41:41 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-176d77dc-b657-4535-95a2-ec27f91af31e tempest-SnapshotDependencyTests-1670886533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:41:41 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-176d77dc-b657-4535-95a2-ec27f91af31e tempest-SnapshotDependencyTests-1670886533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:41:41 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-176d77dc-b657-4535-95a2-ec27f91af31e tempest-SnapshotDependencyTests-1670886533 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:41:41 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-176d77dc-b657-4535-95a2-ec27f91af31e tempest-SnapshotDependencyTests-1670886533 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:41:41 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-176d77dc-b657-4535-95a2-ec27f91af31e tempest-SnapshotDependencyTests-1670886533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:41:41 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-176d77dc-b657-4535-95a2-ec27f91af31e tempest-SnapshotDependencyTests-1670886533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:41:41 devstack sudo[112926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf Jun 29 03:41:41 devstack sudo[112926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:41:41 devstack sudo[112925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-e5bb6207-142c-4e22-bfe7-dd3f9e9fc80c Jun 29 03:41:41 devstack sudo[112925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:41:42 devstack sudo[112926]: pam_unix(sudo:session): session closed for user root Jun 29 03:41:42 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-176d77dc-b657-4535-95a2-ec27f91af31e tempest-SnapshotDependencyTests-1670886533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf" returned: 0 in 0.663s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:41:42 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-176d77dc-b657-4535-95a2-ec27f91af31e tempest-SnapshotDependencyTests-1670886533 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:41:42 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-176d77dc-b657-4535-95a2-ec27f91af31e tempest-SnapshotDependencyTests-1670886533 None] Deleted volume successfully. Jun 29 03:41:42 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-176d77dc-b657-4535-95a2-ec27f91af31e tempest-SnapshotDependencyTests-1670886533 None] Lock "cinder-ccb786d4-15ae-45d3-89a9-ef198279fc68-delete_volume" released by "delete_volume" :: held 2.339s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:41:42 devstack sudo[112925]: pam_unix(sudo:session): session closed for user root Jun 29 03:41:42 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-3092a8ee-3377-48ef-b470-3c47f10767e3 tempest-TestShelveInstance-60316550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-e5bb6207-142c-4e22-bfe7-dd3f9e9fc80c" returned: 1 in 0.802s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:41:42 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-3092a8ee-3377-48ef-b470-3c47f10767e3 tempest-TestShelveInstance-60316550 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-e5bb6207-142c-4e22-bfe7-dd3f9e9fc80c' failed. Not Retrying. {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 29 03:41:42 devstack cinder-volume[93468]: DEBUG cinder.volume.volume_utils [None req-3092a8ee-3377-48ef-b470-3c47f10767e3 tempest-TestShelveInstance-60316550 None] Downloaded image 24cf6ce1-1d2d-493f-a115-2a39928c82fb ((None, [{'url': 'file:///opt/stack/data/glance/images/24cf6ce1-1d2d-493f-a115-2a39928c82fb', 'metadata': {}}])) to volume e5bb6207-142c-4e22-bfe7-dd3f9e9fc80c successfully. {{(pid=93468) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 29 03:41:42 devstack cinder-volume[93468]: DEBUG cinder.image.image_utils [None req-3092a8ee-3377-48ef-b470-3c47f10767e3 tempest-TestShelveInstance-60316550 None] Temporary image 24cf6ce1-1d2d-493f-a115-2a39928c82fb for user 4318b0ccd00544a4a7757ebacaa8f390 is deleted. {{(pid=93468) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 29 03:41:42 devstack cinder-volume[93468]: DEBUG cinder.volume.volume_utils [None req-3092a8ee-3377-48ef-b470-3c47f10767e3 tempest-TestShelveInstance-60316550 None] Marking volume e5bb6207-142c-4e22-bfe7-dd3f9e9fc80c as bootable. {{(pid=93468) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 29 03:41:42 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-3092a8ee-3377-48ef-b470-3c47f10767e3 tempest-TestShelveInstance-60316550 None] Copying metadata from image 24cf6ce1-1d2d-493f-a115-2a39928c82fb to e5bb6207-142c-4e22-bfe7-dd3f9e9fc80c. {{(pid=93468) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 29 03:41:42 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-3092a8ee-3377-48ef-b470-3c47f10767e3 tempest-TestShelveInstance-60316550 None] Creating volume glance metadata for volume e5bb6207-142c-4e22-bfe7-dd3f9e9fc80c backed by image 24cf6ce1-1d2d-493f-a115-2a39928c82fb with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '24cf6ce1-1d2d-493f-a115-2a39928c82fb', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=93468) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 29 03:41:42 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-3092a8ee-3377-48ef-b470-3c47f10767e3 tempest-TestShelveInstance-60316550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f54807d9-b146-4319-9fed-4aae1e73583b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e5bb6207-142c-4e22-bfe7-dd3f9e9fc80c', 'volume_size': 1, 'image_id': '24cf6ce1-1d2d-493f-a115-2a39928c82fb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/24cf6ce1-1d2d-493f-a115-2a39928c82fb', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1335b5873eea4762b9fea7f84dd1615c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '24cf6ce1-1d2d-493f-a115-2a39928c82fb', 'created_at': datetime.datetime(2026, 6, 29, 1, 13, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 29, 1, 13, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/24cf6ce1-1d2d-493f-a115-2a39928c82fb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:41:42 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-3092a8ee-3377-48ef-b470-3c47f10767e3 tempest-TestShelveInstance-60316550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fa21bd7-8d47-4e56-bc34-07f41227153e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:41:42 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-3092a8ee-3377-48ef-b470-3c47f10767e3 tempest-TestShelveInstance-60316550 None] Volume volume-e5bb6207-142c-4e22-bfe7-dd3f9e9fc80c (e5bb6207-142c-4e22-bfe7-dd3f9e9fc80c): created successfully Jun 29 03:41:42 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-3092a8ee-3377-48ef-b470-3c47f10767e3 tempest-TestShelveInstance-60316550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fa21bd7-8d47-4e56-bc34-07f41227153e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:41:42 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-3092a8ee-3377-48ef-b470-3c47f10767e3 tempest-TestShelveInstance-60316550 None] Flow 'volume_create_manager' (61753386-086e-457f-834b-b89cedfa0c50) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:41:42 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-3092a8ee-3377-48ef-b470-3c47f10767e3 tempest-TestShelveInstance-60316550 None] Created volume successfully. Jun 29 03:41:51 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [req-0f88705c-8378-4590-a768-fe785452e585 req-df3c5d0e-d7e6-4783-bafe-75e463551688 tempest-TestShelveInstance-60316550 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:41:51 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [req-0f88705c-8378-4590-a768-fe785452e585 req-df3c5d0e-d7e6-4783-bafe-75e463551688 tempest-TestShelveInstance-60316550 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:41:51 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d1e8e11-afc1-4d7b-b284-11319157600b]: (4, 'raw') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:41:51 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [req-0f88705c-8378-4590-a768-fe785452e585 req-df3c5d0e-d7e6-4783-bafe-75e463551688 tempest-TestShelveInstance-60316550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-e5bb6207-142c-4e22-bfe7-dd3f9e9fc80c {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:41:51 devstack sudo[112987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-e5bb6207-142c-4e22-bfe7-dd3f9e9fc80c Jun 29 03:41:51 devstack sudo[112987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:41:51 devstack sudo[112987]: pam_unix(sudo:session): session closed for user root Jun 29 03:41:51 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [req-0f88705c-8378-4590-a768-fe785452e585 req-df3c5d0e-d7e6-4783-bafe-75e463551688 tempest-TestShelveInstance-60316550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-e5bb6207-142c-4e22-bfe7-dd3f9e9fc80c" returned: 0 in 0.838s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:41:51 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [req-0f88705c-8378-4590-a768-fe785452e585 req-df3c5d0e-d7e6-4783-bafe-75e463551688 tempest-TestShelveInstance-60316550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-e5bb6207-142c-4e22-bfe7-dd3f9e9fc80c {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:41:52 devstack sudo[112993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-e5bb6207-142c-4e22-bfe7-dd3f9e9fc80c Jun 29 03:41:52 devstack sudo[112993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:41:52 devstack sudo[112993]: pam_unix(sudo:session): session closed for user root Jun 29 03:41:52 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [req-0f88705c-8378-4590-a768-fe785452e585 req-df3c5d0e-d7e6-4783-bafe-75e463551688 tempest-TestShelveInstance-60316550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-e5bb6207-142c-4e22-bfe7-dd3f9e9fc80c" returned: 1 in 0.768s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:41:52 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [req-0f88705c-8378-4590-a768-fe785452e585 req-df3c5d0e-d7e6-4783-bafe-75e463551688 tempest-TestShelveInstance-60316550 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-e5bb6207-142c-4e22-bfe7-dd3f9e9fc80c' failed. Not Retrying. {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 29 03:41:52 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [req-0f88705c-8378-4590-a768-fe785452e585 req-df3c5d0e-d7e6-4783-bafe-75e463551688 tempest-TestShelveInstance-60316550 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.655s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:41:52 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [req-0f88705c-8378-4590-a768-fe785452e585 req-df3c5d0e-d7e6-4783-bafe-75e463551688 tempest-TestShelveInstance-60316550 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f', 'name': 'volume-e5bb6207-142c-4e22-bfe7-dd3f9e9fc80c', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '495ac9b8-56e5-4759-aa84-eed74555abe0', 'enforce_multipath': True} {{(pid=93468) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 29 03:41:52 devstack cinder-volume[93468]: INFO cinder.volume.manager [req-0f88705c-8378-4590-a768-fe785452e585 req-df3c5d0e-d7e6-4783-bafe-75e463551688 tempest-TestShelveInstance-60316550 None] attachment_update completed successfully. Jun 29 03:42:02 devstack cinder-volume[93468]: DEBUG dbcounter [-] [93468] Writing DB stats cinder:SELECT=34,cinder:UPDATE=41,cinder:INSERT=14,cinder:DELETE=4 {{(pid=93468) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 29 03:42:02 devstack cinder-volume[93468]: DEBUG dbcounter [-] [93468] Writing DB stats cinder:SELECT=43,cinder:UPDATE=27,cinder:INSERT=14,cinder:DELETE=2 {{(pid=93468) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 29 03:42:11 devstack cinder-volume[93468]: DEBUG oslo_service.periodic_task [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93468) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 29 03:42:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:42:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:42:11 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:42:11 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:42:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:42:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:42:11 devstack sudo[113464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf Jun 29 03:42:11 devstack sudo[113464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:42:12 devstack sudo[113464]: pam_unix(sudo:session): session closed for user root Jun 29 03:42:12 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf" returned: 0 in 0.646s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:42:12 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:42:12 devstack cinder-volume[93468]: DEBUG oslo_service.periodic_task [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Running periodic task VolumeManager._thread_info {{(pid=93468) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 29 03:42:12 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] thread count: 28 {{(pid=93468) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 29 03:42:12 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] thread info: [<_MainThread(MainThread, started 132331377287296)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93468) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 29 03:42:29 devstack cinder-volume[93468]: INFO cinder.volume.manager [req-6c50bee4-4103-44f6-935a-52e7d6624000 req-e896bdab-feb8-4823-8995-549cb81a49d1 tempest-TestShelveInstance-60316550 None] Terminate volume connection completed successfully. Jun 29 03:42:29 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [req-6c50bee4-4103-44f6-935a-52e7d6624000 req-e896bdab-feb8-4823-8995-549cb81a49d1 tempest-TestShelveInstance-60316550 None] Deleting attachment 495ac9b8-56e5-4759-aa84-eed74555abe0. {{(pid=93468) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 29 03:42:34 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [req-3569b905-81af-4406-8364-4369a97f016d req-de4eed5e-9293-4277-b10b-1c5d8a6670fd tempest-TestShelveInstance-60316550 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:42:34 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [req-3569b905-81af-4406-8364-4369a97f016d req-de4eed5e-9293-4277-b10b-1c5d8a6670fd tempest-TestShelveInstance-60316550 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:42:34 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[edd688d6-1ec7-4325-9e2c-906452cb6c3e]: (4, 'raw') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:42:34 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [req-3569b905-81af-4406-8364-4369a97f016d req-de4eed5e-9293-4277-b10b-1c5d8a6670fd tempest-TestShelveInstance-60316550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-e5bb6207-142c-4e22-bfe7-dd3f9e9fc80c {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:42:34 devstack sudo[113641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-e5bb6207-142c-4e22-bfe7-dd3f9e9fc80c Jun 29 03:42:34 devstack sudo[113641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:42:35 devstack sudo[113641]: pam_unix(sudo:session): session closed for user root Jun 29 03:42:35 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [req-3569b905-81af-4406-8364-4369a97f016d req-de4eed5e-9293-4277-b10b-1c5d8a6670fd tempest-TestShelveInstance-60316550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-e5bb6207-142c-4e22-bfe7-dd3f9e9fc80c" returned: 0 in 0.755s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:42:35 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [req-3569b905-81af-4406-8364-4369a97f016d req-de4eed5e-9293-4277-b10b-1c5d8a6670fd tempest-TestShelveInstance-60316550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-e5bb6207-142c-4e22-bfe7-dd3f9e9fc80c {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:42:35 devstack sudo[113645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-e5bb6207-142c-4e22-bfe7-dd3f9e9fc80c Jun 29 03:42:35 devstack sudo[113645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:42:36 devstack sudo[113645]: pam_unix(sudo:session): session closed for user root Jun 29 03:42:36 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [req-3569b905-81af-4406-8364-4369a97f016d req-de4eed5e-9293-4277-b10b-1c5d8a6670fd tempest-TestShelveInstance-60316550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-e5bb6207-142c-4e22-bfe7-dd3f9e9fc80c" returned: 1 in 0.748s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:42:36 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [req-3569b905-81af-4406-8364-4369a97f016d req-de4eed5e-9293-4277-b10b-1c5d8a6670fd tempest-TestShelveInstance-60316550 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-e5bb6207-142c-4e22-bfe7-dd3f9e9fc80c' failed. Not Retrying. {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 29 03:42:36 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [req-3569b905-81af-4406-8364-4369a97f016d req-de4eed5e-9293-4277-b10b-1c5d8a6670fd tempest-TestShelveInstance-60316550 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.541s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:42:36 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [req-3569b905-81af-4406-8364-4369a97f016d req-de4eed5e-9293-4277-b10b-1c5d8a6670fd tempest-TestShelveInstance-60316550 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f', 'name': 'volume-e5bb6207-142c-4e22-bfe7-dd3f9e9fc80c', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b4abc516-9c66-47e9-a747-71cb586b3136', 'enforce_multipath': True} {{(pid=93468) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 29 03:42:36 devstack cinder-volume[93468]: INFO cinder.volume.manager [req-3569b905-81af-4406-8364-4369a97f016d req-de4eed5e-9293-4277-b10b-1c5d8a6670fd tempest-TestShelveInstance-60316550 None] attachment_update completed successfully. Jun 29 03:42:46 devstack cinder-volume[93468]: DEBUG dbcounter [-] [93468] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=93468) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 29 03:42:46 devstack cinder-volume[93468]: DEBUG dbcounter [-] [93468] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=93468) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 29 03:43:10 devstack cinder-volume[93468]: DEBUG dbcounter [-] [93468] Writing DB stats cinder:SELECT=1 {{(pid=93468) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 29 03:43:10 devstack cinder-volume[93468]: DEBUG dbcounter [-] [93468] Writing DB stats cinder:UPDATE=1 {{(pid=93468) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 29 03:43:11 devstack cinder-volume[93468]: DEBUG oslo_service.periodic_task [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93468) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 29 03:43:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:43:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:43:11 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:43:11 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:43:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:43:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:43:11 devstack sudo[114189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf Jun 29 03:43:11 devstack sudo[114189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:43:12 devstack sudo[114189]: pam_unix(sudo:session): session closed for user root Jun 29 03:43:12 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf" returned: 0 in 0.708s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:43:12 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:43:12 devstack cinder-volume[93468]: DEBUG oslo_service.periodic_task [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Running periodic task VolumeManager._thread_info {{(pid=93468) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 29 03:43:12 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] thread count: 28 {{(pid=93468) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 29 03:43:12 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] thread info: [<_MainThread(MainThread, started 132331377287296)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93468) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 29 03:43:16 devstack cinder-volume[93468]: INFO cinder.volume.manager [req-7a8f9872-5194-4b3d-9509-1c5151d695f7 req-31815a45-7ad3-404b-a435-64df3108362a tempest-TestShelveInstance-60316550 None] Terminate volume connection completed successfully. Jun 29 03:43:16 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [req-7a8f9872-5194-4b3d-9509-1c5151d695f7 req-31815a45-7ad3-404b-a435-64df3108362a tempest-TestShelveInstance-60316550 None] Deleting attachment b4abc516-9c66-47e9-a747-71cb586b3136. {{(pid=93468) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 29 03:43:17 devstack cinder-volume[93468]: DEBUG cinder.coordination [req-7a8f9872-5194-4b3d-9509-1c5151d695f7 req-14d5f216-0ff3-47d2-9520-76c3d4f0fd85 tempest-TestShelveInstance-60316550 None] Acquiring lock "cinder-e5bb6207-142c-4e22-bfe7-dd3f9e9fc80c-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:43:17 devstack cinder-volume[93468]: DEBUG cinder.coordination [req-7a8f9872-5194-4b3d-9509-1c5151d695f7 req-14d5f216-0ff3-47d2-9520-76c3d4f0fd85 tempest-TestShelveInstance-60316550 None] Lock "cinder-e5bb6207-142c-4e22-bfe7-dd3f9e9fc80c-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:43:17 devstack cinder-volume[93468]: DEBUG cinder.coordination [req-7a8f9872-5194-4b3d-9509-1c5151d695f7 req-14d5f216-0ff3-47d2-9520-76c3d4f0fd85 tempest-TestShelveInstance-60316550 None] Acquiring lock "cinder-quobyte-e5bb6207-142c-4e22-bfe7-dd3f9e9fc80c" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:43:17 devstack cinder-volume[93468]: DEBUG cinder.coordination [req-7a8f9872-5194-4b3d-9509-1c5151d695f7 req-14d5f216-0ff3-47d2-9520-76c3d4f0fd85 tempest-TestShelveInstance-60316550 None] Lock "cinder-quobyte-e5bb6207-142c-4e22-bfe7-dd3f9e9fc80c" acquired by "delete_volume" :: waited 0.018s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:43:17 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c65f7e5-b084-4eb1-8862-5143984aa044]: (4, 'raw') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:43:17 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [req-7a8f9872-5194-4b3d-9509-1c5151d695f7 req-14d5f216-0ff3-47d2-9520-76c3d4f0fd85 tempest-TestShelveInstance-60316550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-e5bb6207-142c-4e22-bfe7-dd3f9e9fc80c {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:43:17 devstack sudo[114241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-e5bb6207-142c-4e22-bfe7-dd3f9e9fc80c Jun 29 03:43:17 devstack sudo[114241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:43:18 devstack sudo[114241]: pam_unix(sudo:session): session closed for user root Jun 29 03:43:18 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [req-7a8f9872-5194-4b3d-9509-1c5151d695f7 req-14d5f216-0ff3-47d2-9520-76c3d4f0fd85 tempest-TestShelveInstance-60316550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-e5bb6207-142c-4e22-bfe7-dd3f9e9fc80c" returned: 0 in 0.798s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:43:18 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [req-7a8f9872-5194-4b3d-9509-1c5151d695f7 req-14d5f216-0ff3-47d2-9520-76c3d4f0fd85 tempest-TestShelveInstance-60316550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-e5bb6207-142c-4e22-bfe7-dd3f9e9fc80c {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:43:18 devstack sudo[114245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-e5bb6207-142c-4e22-bfe7-dd3f9e9fc80c Jun 29 03:43:18 devstack sudo[114245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:43:18 devstack sudo[114245]: pam_unix(sudo:session): session closed for user root Jun 29 03:43:18 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [req-7a8f9872-5194-4b3d-9509-1c5151d695f7 req-14d5f216-0ff3-47d2-9520-76c3d4f0fd85 tempest-TestShelveInstance-60316550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-e5bb6207-142c-4e22-bfe7-dd3f9e9fc80c" returned: 1 in 0.729s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:43:18 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [req-7a8f9872-5194-4b3d-9509-1c5151d695f7 req-14d5f216-0ff3-47d2-9520-76c3d4f0fd85 tempest-TestShelveInstance-60316550 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-e5bb6207-142c-4e22-bfe7-dd3f9e9fc80c' failed. Not Retrying. {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 29 03:43:18 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [req-7a8f9872-5194-4b3d-9509-1c5151d695f7 req-14d5f216-0ff3-47d2-9520-76c3d4f0fd85 tempest-TestShelveInstance-60316550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-e5bb6207-142c-4e22-bfe7-dd3f9e9fc80c {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:43:18 devstack sudo[114250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-e5bb6207-142c-4e22-bfe7-dd3f9e9fc80c Jun 29 03:43:18 devstack sudo[114250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:43:19 devstack sudo[114250]: pam_unix(sudo:session): session closed for user root Jun 29 03:43:19 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [req-7a8f9872-5194-4b3d-9509-1c5151d695f7 req-14d5f216-0ff3-47d2-9520-76c3d4f0fd85 tempest-TestShelveInstance-60316550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-e5bb6207-142c-4e22-bfe7-dd3f9e9fc80c" returned: 0 in 0.657s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:43:19 devstack cinder-volume[93468]: DEBUG cinder.coordination [req-7a8f9872-5194-4b3d-9509-1c5151d695f7 req-14d5f216-0ff3-47d2-9520-76c3d4f0fd85 tempest-TestShelveInstance-60316550 None] Lock "cinder-quobyte-e5bb6207-142c-4e22-bfe7-dd3f9e9fc80c" released by "delete_volume" :: held 2.246s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:43:19 devstack cinder-volume[93468]: DEBUG cinder.quota [req-7a8f9872-5194-4b3d-9509-1c5151d695f7 req-14d5f216-0ff3-47d2-9520-76c3d4f0fd85 tempest-TestShelveInstance-60316550 None] Created reservations ['fb178fbf-d27d-4a8e-a67c-8ac3c23a6645', 'fb6a8398-c087-4fa6-98d7-d2343eb58975', 'd8553f59-0dc0-49da-8444-199cfaa5b62d', '15419412-5134-4b46-bb1d-b3ab37ca6093'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:43:19 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [req-7a8f9872-5194-4b3d-9509-1c5151d695f7 req-14d5f216-0ff3-47d2-9520-76c3d4f0fd85 tempest-TestShelveInstance-60316550 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:43:19 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [req-7a8f9872-5194-4b3d-9509-1c5151d695f7 req-14d5f216-0ff3-47d2-9520-76c3d4f0fd85 tempest-TestShelveInstance-60316550 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:43:19 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [req-7a8f9872-5194-4b3d-9509-1c5151d695f7 req-14d5f216-0ff3-47d2-9520-76c3d4f0fd85 tempest-TestShelveInstance-60316550 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:43:19 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [req-7a8f9872-5194-4b3d-9509-1c5151d695f7 req-14d5f216-0ff3-47d2-9520-76c3d4f0fd85 tempest-TestShelveInstance-60316550 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:43:19 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [req-7a8f9872-5194-4b3d-9509-1c5151d695f7 req-14d5f216-0ff3-47d2-9520-76c3d4f0fd85 tempest-TestShelveInstance-60316550 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:43:19 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [req-7a8f9872-5194-4b3d-9509-1c5151d695f7 req-14d5f216-0ff3-47d2-9520-76c3d4f0fd85 tempest-TestShelveInstance-60316550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:43:19 devstack sudo[114255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf Jun 29 03:43:19 devstack sudo[114255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:43:20 devstack sudo[114255]: pam_unix(sudo:session): session closed for user root Jun 29 03:43:20 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [req-7a8f9872-5194-4b3d-9509-1c5151d695f7 req-14d5f216-0ff3-47d2-9520-76c3d4f0fd85 tempest-TestShelveInstance-60316550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf" returned: 0 in 0.647s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:43:20 devstack cinder-volume[93468]: DEBUG cinder.manager [req-7a8f9872-5194-4b3d-9509-1c5151d695f7 req-14d5f216-0ff3-47d2-9520-76c3d4f0fd85 tempest-TestShelveInstance-60316550 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:43:20 devstack cinder-volume[93468]: INFO cinder.volume.manager [req-7a8f9872-5194-4b3d-9509-1c5151d695f7 req-14d5f216-0ff3-47d2-9520-76c3d4f0fd85 tempest-TestShelveInstance-60316550 None] Deleted volume successfully. Jun 29 03:43:20 devstack cinder-volume[93468]: DEBUG cinder.coordination [req-7a8f9872-5194-4b3d-9509-1c5151d695f7 req-14d5f216-0ff3-47d2-9520-76c3d4f0fd85 tempest-TestShelveInstance-60316550 None] Lock "cinder-e5bb6207-142c-4e22-bfe7-dd3f9e9fc80c-delete_volume" released by "delete_volume" :: held 3.091s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:43:29 devstack cinder-volume[93468]: DEBUG dbcounter [-] [93468] Writing DB stats cinder:SELECT=6,cinder:UPDATE=12,cinder:INSERT=3 {{(pid=93468) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 29 03:43:30 devstack cinder-volume[93468]: DEBUG dbcounter [-] [93468] Writing DB stats cinder:SELECT=6,cinder:INSERT=1,cinder:UPDATE=4,cinder:DELETE=1 {{(pid=93468) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 29 03:43:40 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae08230e-7726-4e81-aa9c-fec08abd5e72 tempest-CreateVolumesFromImageTest-210232301 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:43:40 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-ae08230e-7726-4e81-aa9c-fec08abd5e72 tempest-CreateVolumesFromImageTest-210232301 None] Flow 'volume_create_manager' (23faf2b2-d79b-4ca5-9f04-6cc732963b48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:43:40 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-ae08230e-7726-4e81-aa9c-fec08abd5e72 tempest-CreateVolumesFromImageTest-210232301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6456fe1-3618-4189-a628-f0f35b8107cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:43:40 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-ae08230e-7726-4e81-aa9c-fec08abd5e72 tempest-CreateVolumesFromImageTest-210232301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6456fe1-3618-4189-a628-f0f35b8107cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:43:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1778770363',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=532e0e13-477b-4cdf-9cf0-c776136c6001,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8cec79e1c9d24d3caa87712d26347595',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:43:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:43:41Z,use_quota=True,user_id='b0582c0d0f3344dbb005a5150f676904',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:43:40 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-ae08230e-7726-4e81-aa9c-fec08abd5e72 tempest-CreateVolumesFromImageTest-210232301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af0e06e5-98c9-495f-a373-df1065fac95d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:43:40 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-ae08230e-7726-4e81-aa9c-fec08abd5e72 tempest-CreateVolumesFromImageTest-210232301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af0e06e5-98c9-495f-a373-df1065fac95d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:43:40 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-ae08230e-7726-4e81-aa9c-fec08abd5e72 tempest-CreateVolumesFromImageTest-210232301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61d930f4-46e5-43cb-8aa9-1a6f5d590ec2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:43:40 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-ae08230e-7726-4e81-aa9c-fec08abd5e72 tempest-CreateVolumesFromImageTest-210232301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61d930f4-46e5-43cb-8aa9-1a6f5d590ec2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '532e0e13-477b-4cdf-9cf0-c776136c6001', 'volume_name': 'volume-532e0e13-477b-4cdf-9cf0-c776136c6001', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:43:40 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-ae08230e-7726-4e81-aa9c-fec08abd5e72 tempest-CreateVolumesFromImageTest-210232301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (360feb64-0b45-4043-8e05-8da008a48b11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:43:40 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-ae08230e-7726-4e81-aa9c-fec08abd5e72 tempest-CreateVolumesFromImageTest-210232301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (360feb64-0b45-4043-8e05-8da008a48b11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:43:40 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-ae08230e-7726-4e81-aa9c-fec08abd5e72 tempest-CreateVolumesFromImageTest-210232301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cbc71ce-8bbc-44c4-b32e-ffbf6a2741a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:43:40 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-ae08230e-7726-4e81-aa9c-fec08abd5e72 tempest-CreateVolumesFromImageTest-210232301 None] Volume 532e0e13-477b-4cdf-9cf0-c776136c6001: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-532e0e13-477b-4cdf-9cf0-c776136c6001', 'volume_size': 1} Jun 29 03:43:40 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-ae08230e-7726-4e81-aa9c-fec08abd5e72 tempest-CreateVolumesFromImageTest-210232301 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:43:40 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-ae08230e-7726-4e81-aa9c-fec08abd5e72 tempest-CreateVolumesFromImageTest-210232301 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:43:40 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-ae08230e-7726-4e81-aa9c-fec08abd5e72 tempest-CreateVolumesFromImageTest-210232301 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:43:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1778770363',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=532e0e13-477b-4cdf-9cf0-c776136c6001,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8cec79e1c9d24d3caa87712d26347595',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:43:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:43:41Z,use_quota=True,user_id='b0582c0d0f3344dbb005a5150f676904',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:43:40 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-ae08230e-7726-4e81-aa9c-fec08abd5e72 tempest-CreateVolumesFromImageTest-210232301 None] Creating volume 532e0e13-477b-4cdf-9cf0-c776136c6001 {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:43:40 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-ae08230e-7726-4e81-aa9c-fec08abd5e72 tempest-CreateVolumesFromImageTest-210232301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:43:40 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-ae08230e-7726-4e81-aa9c-fec08abd5e72 tempest-CreateVolumesFromImageTest-210232301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:43:40 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-ae08230e-7726-4e81-aa9c-fec08abd5e72 tempest-CreateVolumesFromImageTest-210232301 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:43:40 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-ae08230e-7726-4e81-aa9c-fec08abd5e72 tempest-CreateVolumesFromImageTest-210232301 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:43:40 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-ae08230e-7726-4e81-aa9c-fec08abd5e72 tempest-CreateVolumesFromImageTest-210232301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:43:40 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-ae08230e-7726-4e81-aa9c-fec08abd5e72 tempest-CreateVolumesFromImageTest-210232301 None] Selected osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:43:40 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-ae08230e-7726-4e81-aa9c-fec08abd5e72 tempest-CreateVolumesFromImageTest-210232301 None] casted to osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f Jun 29 03:43:40 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ae08230e-7726-4e81-aa9c-fec08abd5e72 tempest-CreateVolumesFromImageTest-210232301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-532e0e13-477b-4cdf-9cf0-c776136c6001 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:43:40 devstack sudo[114310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-532e0e13-477b-4cdf-9cf0-c776136c6001 1073741824 Jun 29 03:43:40 devstack sudo[114310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:43:41 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b4f1998-5e18-40a3-acab-0e13ed72733c tempest-CreateVolumesFromSnapshotTest-1093373581 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:43:41 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-4b4f1998-5e18-40a3-acab-0e13ed72733c tempest-CreateVolumesFromSnapshotTest-1093373581 None] Flow 'volume_create_manager' (3e55fb3d-b003-4be5-bab5-9176e5de1204) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:43:41 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-4b4f1998-5e18-40a3-acab-0e13ed72733c tempest-CreateVolumesFromSnapshotTest-1093373581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb67ceea-d25c-4e23-bcc5-301ea4ca8bef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:43:41 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-4b4f1998-5e18-40a3-acab-0e13ed72733c tempest-CreateVolumesFromSnapshotTest-1093373581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb67ceea-d25c-4e23-bcc5-301ea4ca8bef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:43:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1152520074',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9148723b-25c2-4581-884c-91a072699cbd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64bb520d993e427c9c4490b050e40a72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:43:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:43:41Z,use_quota=True,user_id='998a078d10ae4063a2f3b87f6f1d255d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:43:41 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-4b4f1998-5e18-40a3-acab-0e13ed72733c tempest-CreateVolumesFromSnapshotTest-1093373581 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94b5056a-aa9a-41e4-af3e-64678cc00762) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:43:41 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-4b4f1998-5e18-40a3-acab-0e13ed72733c tempest-CreateVolumesFromSnapshotTest-1093373581 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94b5056a-aa9a-41e4-af3e-64678cc00762) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:43:41 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-4b4f1998-5e18-40a3-acab-0e13ed72733c tempest-CreateVolumesFromSnapshotTest-1093373581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80344324-3803-427c-ab20-02285e8217d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:43:41 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-4b4f1998-5e18-40a3-acab-0e13ed72733c tempest-CreateVolumesFromSnapshotTest-1093373581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80344324-3803-427c-ab20-02285e8217d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9148723b-25c2-4581-884c-91a072699cbd', 'volume_name': 'volume-9148723b-25c2-4581-884c-91a072699cbd', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:43:41 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-4b4f1998-5e18-40a3-acab-0e13ed72733c tempest-CreateVolumesFromSnapshotTest-1093373581 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3703c153-b0f9-40ff-8ec9-569dcca33982) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:43:41 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-4b4f1998-5e18-40a3-acab-0e13ed72733c tempest-CreateVolumesFromSnapshotTest-1093373581 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3703c153-b0f9-40ff-8ec9-569dcca33982) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:43:41 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-4b4f1998-5e18-40a3-acab-0e13ed72733c tempest-CreateVolumesFromSnapshotTest-1093373581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eec6494b-a444-474c-93ba-18954d5e9d71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:43:41 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-4b4f1998-5e18-40a3-acab-0e13ed72733c tempest-CreateVolumesFromSnapshotTest-1093373581 None] Volume 9148723b-25c2-4581-884c-91a072699cbd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9148723b-25c2-4581-884c-91a072699cbd', 'volume_size': 1} Jun 29 03:43:41 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-4b4f1998-5e18-40a3-acab-0e13ed72733c tempest-CreateVolumesFromSnapshotTest-1093373581 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:43:41 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-584945bf-f0a2-4d26-99c6-ea8f18836013 tempest-CreateVolumesFromImageTest-210232301 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:43:41 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-584945bf-f0a2-4d26-99c6-ea8f18836013 tempest-CreateVolumesFromImageTest-210232301 None] Flow 'volume_create_manager' (9bff091f-da26-47d0-a99f-27d47137774a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:43:41 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-584945bf-f0a2-4d26-99c6-ea8f18836013 tempest-CreateVolumesFromImageTest-210232301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (539a121e-dc1b-48e8-ab08-14b94a1b68a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:43:41 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-584945bf-f0a2-4d26-99c6-ea8f18836013 tempest-CreateVolumesFromImageTest-210232301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (539a121e-dc1b-48e8-ab08-14b94a1b68a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:43:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1877350340',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f10d343-140c-4c83-97b8-1f5dc5253f5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8cec79e1c9d24d3caa87712d26347595',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:43:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:43:41Z,use_quota=True,user_id='b0582c0d0f3344dbb005a5150f676904',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:43:41 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-584945bf-f0a2-4d26-99c6-ea8f18836013 tempest-CreateVolumesFromImageTest-210232301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2204fd6-45c3-4b8d-9e11-26f727e2eba1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:43:41 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-584945bf-f0a2-4d26-99c6-ea8f18836013 tempest-CreateVolumesFromImageTest-210232301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2204fd6-45c3-4b8d-9e11-26f727e2eba1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:43:41 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-584945bf-f0a2-4d26-99c6-ea8f18836013 tempest-CreateVolumesFromImageTest-210232301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c2bf4d3-7fef-430a-81bc-8b93845079e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:43:41 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-584945bf-f0a2-4d26-99c6-ea8f18836013 tempest-CreateVolumesFromImageTest-210232301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c2bf4d3-7fef-430a-81bc-8b93845079e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f10d343-140c-4c83-97b8-1f5dc5253f5b', 'volume_name': 'volume-4f10d343-140c-4c83-97b8-1f5dc5253f5b', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:43:41 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-584945bf-f0a2-4d26-99c6-ea8f18836013 tempest-CreateVolumesFromImageTest-210232301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64f4b25d-bba3-4e43-a6fa-d00a1109a2b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:43:41 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-584945bf-f0a2-4d26-99c6-ea8f18836013 tempest-CreateVolumesFromImageTest-210232301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64f4b25d-bba3-4e43-a6fa-d00a1109a2b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:43:41 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-584945bf-f0a2-4d26-99c6-ea8f18836013 tempest-CreateVolumesFromImageTest-210232301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4670a1d9-303c-4a38-9272-19f78baa61b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:43:41 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-584945bf-f0a2-4d26-99c6-ea8f18836013 tempest-CreateVolumesFromImageTest-210232301 None] Volume 4f10d343-140c-4c83-97b8-1f5dc5253f5b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f10d343-140c-4c83-97b8-1f5dc5253f5b', 'volume_size': 1} Jun 29 03:43:41 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-584945bf-f0a2-4d26-99c6-ea8f18836013 tempest-CreateVolumesFromImageTest-210232301 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:43:41 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-46add7be-802e-4c58-9d07-5b7e6d11e5fe tempest-CreateVolumesFromImageTest-210232301 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:43:41 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-46add7be-802e-4c58-9d07-5b7e6d11e5fe tempest-CreateVolumesFromImageTest-210232301 None] Flow 'volume_create_manager' (6fbe437a-a793-40f8-856a-8974f21b1a4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:43:41 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-46add7be-802e-4c58-9d07-5b7e6d11e5fe tempest-CreateVolumesFromImageTest-210232301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47d7a5e9-a088-45cf-ad83-6536c7bfe0ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:43:41 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-46add7be-802e-4c58-9d07-5b7e6d11e5fe tempest-CreateVolumesFromImageTest-210232301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47d7a5e9-a088-45cf-ad83-6536c7bfe0ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:43:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-903314355',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2bd84b5-5052-4ee0-8dae-1979f0fabf16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8cec79e1c9d24d3caa87712d26347595',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:43:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:43:42Z,use_quota=True,user_id='b0582c0d0f3344dbb005a5150f676904',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:43:41 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-46add7be-802e-4c58-9d07-5b7e6d11e5fe tempest-CreateVolumesFromImageTest-210232301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b32ec989-b867-489a-a865-fbdb57b8647e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:43:41 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-46add7be-802e-4c58-9d07-5b7e6d11e5fe tempest-CreateVolumesFromImageTest-210232301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b32ec989-b867-489a-a865-fbdb57b8647e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:43:41 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-46add7be-802e-4c58-9d07-5b7e6d11e5fe tempest-CreateVolumesFromImageTest-210232301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13643b33-3d05-4d88-85f3-6059cbd2baaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:43:41 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-46add7be-802e-4c58-9d07-5b7e6d11e5fe tempest-CreateVolumesFromImageTest-210232301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13643b33-3d05-4d88-85f3-6059cbd2baaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f2bd84b5-5052-4ee0-8dae-1979f0fabf16', 'volume_name': 'volume-f2bd84b5-5052-4ee0-8dae-1979f0fabf16', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:43:41 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-46add7be-802e-4c58-9d07-5b7e6d11e5fe tempest-CreateVolumesFromImageTest-210232301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (412418e0-dc8c-4506-b6b9-2bb60e531b31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:43:41 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-46add7be-802e-4c58-9d07-5b7e6d11e5fe tempest-CreateVolumesFromImageTest-210232301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (412418e0-dc8c-4506-b6b9-2bb60e531b31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:43:41 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-46add7be-802e-4c58-9d07-5b7e6d11e5fe tempest-CreateVolumesFromImageTest-210232301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9883bbb1-f47d-403d-b850-a1c272dc614c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:43:41 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-46add7be-802e-4c58-9d07-5b7e6d11e5fe tempest-CreateVolumesFromImageTest-210232301 None] Volume f2bd84b5-5052-4ee0-8dae-1979f0fabf16: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f2bd84b5-5052-4ee0-8dae-1979f0fabf16', 'volume_size': 1} Jun 29 03:43:41 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-46add7be-802e-4c58-9d07-5b7e6d11e5fe tempest-CreateVolumesFromImageTest-210232301 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:43:42 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-9316504f-1184-4dac-a379-a922afaae9d6 tempest-VolumeDependencyTests-1245577734 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:43:42 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-9316504f-1184-4dac-a379-a922afaae9d6 tempest-VolumeDependencyTests-1245577734 None] Flow 'volume_create_manager' (bd0eb05e-66eb-4f42-8942-035a8183d1d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:43:42 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-9316504f-1184-4dac-a379-a922afaae9d6 tempest-VolumeDependencyTests-1245577734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33cf9651-e822-4aa7-a6cf-8e37503f77cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:43:42 devstack sudo[114310]: pam_unix(sudo:session): session closed for user root Jun 29 03:43:42 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ae08230e-7726-4e81-aa9c-fec08abd5e72 tempest-CreateVolumesFromImageTest-210232301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-532e0e13-477b-4cdf-9cf0-c776136c6001 1073741824" returned: 0 in 1.308s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:43:42 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-9316504f-1184-4dac-a379-a922afaae9d6 tempest-VolumeDependencyTests-1245577734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33cf9651-e822-4aa7-a6cf-8e37503f77cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:43:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2094034403',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1aad3d1f-6a61-4b52-a9a0-ddf7ca5fbe87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5508a57794ce42feae62d6afae7f9f1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:43:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:43:42Z,use_quota=True,user_id='e879ab76007945178088d532c2c38294',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:43:42 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-9316504f-1184-4dac-a379-a922afaae9d6 tempest-VolumeDependencyTests-1245577734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90fbe6cf-1608-413e-9a4b-f538d4c74545) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:43:42 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-9316504f-1184-4dac-a379-a922afaae9d6 tempest-VolumeDependencyTests-1245577734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90fbe6cf-1608-413e-9a4b-f538d4c74545) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:43:42 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-9316504f-1184-4dac-a379-a922afaae9d6 tempest-VolumeDependencyTests-1245577734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0058871a-fb81-46de-b8fb-113891d7114f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:43:42 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-9316504f-1184-4dac-a379-a922afaae9d6 tempest-VolumeDependencyTests-1245577734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0058871a-fb81-46de-b8fb-113891d7114f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1aad3d1f-6a61-4b52-a9a0-ddf7ca5fbe87', 'volume_name': 'volume-1aad3d1f-6a61-4b52-a9a0-ddf7ca5fbe87', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:43:42 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-9316504f-1184-4dac-a379-a922afaae9d6 tempest-VolumeDependencyTests-1245577734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0e027c0-82ea-4ee8-98a7-1e0bbfdc4c34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:43:42 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-9316504f-1184-4dac-a379-a922afaae9d6 tempest-VolumeDependencyTests-1245577734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0e027c0-82ea-4ee8-98a7-1e0bbfdc4c34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:43:42 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-9316504f-1184-4dac-a379-a922afaae9d6 tempest-VolumeDependencyTests-1245577734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd5a3d69-017a-48e1-b63d-e20bd95631a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:43:42 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-9316504f-1184-4dac-a379-a922afaae9d6 tempest-VolumeDependencyTests-1245577734 None] Volume 1aad3d1f-6a61-4b52-a9a0-ddf7ca5fbe87: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1aad3d1f-6a61-4b52-a9a0-ddf7ca5fbe87', 'volume_size': 1} Jun 29 03:43:42 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-9316504f-1184-4dac-a379-a922afaae9d6 tempest-VolumeDependencyTests-1245577734 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:43:42 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-455d82a1-e7db-4354-9d96-d24b999ebb2f tempest-CreateVolumesFromImageTest-210232301 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:43:42 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-455d82a1-e7db-4354-9d96-d24b999ebb2f tempest-CreateVolumesFromImageTest-210232301 None] Flow 'volume_create_manager' (ea8ce755-fa64-4c6b-a5fe-39f75ff926e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:43:42 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-455d82a1-e7db-4354-9d96-d24b999ebb2f tempest-CreateVolumesFromImageTest-210232301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b1e1f7c-d146-4f0f-9922-82d64aa3a0f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:43:42 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-455d82a1-e7db-4354-9d96-d24b999ebb2f tempest-CreateVolumesFromImageTest-210232301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b1e1f7c-d146-4f0f-9922-82d64aa3a0f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:43:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1499601946',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b0cbe04-a06e-4301-a382-1ba1aab29f33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8cec79e1c9d24d3caa87712d26347595',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:43:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:43:42Z,use_quota=True,user_id='b0582c0d0f3344dbb005a5150f676904',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:43:42 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-455d82a1-e7db-4354-9d96-d24b999ebb2f tempest-CreateVolumesFromImageTest-210232301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe9b9b7d-67dc-444b-ac27-05de63297f18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:43:42 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-455d82a1-e7db-4354-9d96-d24b999ebb2f tempest-CreateVolumesFromImageTest-210232301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe9b9b7d-67dc-444b-ac27-05de63297f18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:43:42 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-455d82a1-e7db-4354-9d96-d24b999ebb2f tempest-CreateVolumesFromImageTest-210232301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31642bb7-dd3a-4bb0-8e15-8eb0749315e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:43:42 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-455d82a1-e7db-4354-9d96-d24b999ebb2f tempest-CreateVolumesFromImageTest-210232301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31642bb7-dd3a-4bb0-8e15-8eb0749315e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b0cbe04-a06e-4301-a382-1ba1aab29f33', 'volume_name': 'volume-6b0cbe04-a06e-4301-a382-1ba1aab29f33', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:43:42 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-455d82a1-e7db-4354-9d96-d24b999ebb2f tempest-CreateVolumesFromImageTest-210232301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c6c7d83-5947-4198-9aae-225cbf419dce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:43:42 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-455d82a1-e7db-4354-9d96-d24b999ebb2f tempest-CreateVolumesFromImageTest-210232301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c6c7d83-5947-4198-9aae-225cbf419dce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:43:42 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-455d82a1-e7db-4354-9d96-d24b999ebb2f tempest-CreateVolumesFromImageTest-210232301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1293337c-3b21-41e8-957c-90851d106381) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:43:42 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-455d82a1-e7db-4354-9d96-d24b999ebb2f tempest-CreateVolumesFromImageTest-210232301 None] Volume 6b0cbe04-a06e-4301-a382-1ba1aab29f33: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b0cbe04-a06e-4301-a382-1ba1aab29f33', 'volume_size': 1} Jun 29 03:43:42 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-455d82a1-e7db-4354-9d96-d24b999ebb2f tempest-CreateVolumesFromImageTest-210232301 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:43:42 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ae08230e-7726-4e81-aa9c-fec08abd5e72 tempest-CreateVolumesFromImageTest-210232301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-532e0e13-477b-4cdf-9cf0-c776136c6001 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:43:42 devstack sudo[114321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-532e0e13-477b-4cdf-9cf0-c776136c6001 Jun 29 03:43:42 devstack sudo[114321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:43:42 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-03b44d8e-c351-479e-84a5-d12a82cc5567 tempest-CreateVolumesFromImageTest-210232301 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:43:42 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-03b44d8e-c351-479e-84a5-d12a82cc5567 tempest-CreateVolumesFromImageTest-210232301 None] Flow 'volume_create_manager' (17072503-9d6e-41f3-9aa2-648f3208b1fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:43:42 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-03b44d8e-c351-479e-84a5-d12a82cc5567 tempest-CreateVolumesFromImageTest-210232301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1126660f-8e19-48bb-a0f7-9570ca8ef26b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:43:42 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-03b44d8e-c351-479e-84a5-d12a82cc5567 tempest-CreateVolumesFromImageTest-210232301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1126660f-8e19-48bb-a0f7-9570ca8ef26b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:43:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1342279050',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bf3324b-6ad0-4df3-ae96-88135f793679,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8cec79e1c9d24d3caa87712d26347595',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:43:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:43:42Z,use_quota=True,user_id='b0582c0d0f3344dbb005a5150f676904',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:43:42 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-03b44d8e-c351-479e-84a5-d12a82cc5567 tempest-CreateVolumesFromImageTest-210232301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d69b111-5d54-4ac3-a642-03b91b7a140b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:43:42 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-03b44d8e-c351-479e-84a5-d12a82cc5567 tempest-CreateVolumesFromImageTest-210232301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d69b111-5d54-4ac3-a642-03b91b7a140b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:43:42 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-03b44d8e-c351-479e-84a5-d12a82cc5567 tempest-CreateVolumesFromImageTest-210232301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70a4c669-8666-450f-8a6a-669c352d0df6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:43:42 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-03b44d8e-c351-479e-84a5-d12a82cc5567 tempest-CreateVolumesFromImageTest-210232301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70a4c669-8666-450f-8a6a-669c352d0df6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2bf3324b-6ad0-4df3-ae96-88135f793679', 'volume_name': 'volume-2bf3324b-6ad0-4df3-ae96-88135f793679', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:43:42 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-03b44d8e-c351-479e-84a5-d12a82cc5567 tempest-CreateVolumesFromImageTest-210232301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7421ab5-f52d-4cb2-9731-6ab81b312599) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:43:42 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-03b44d8e-c351-479e-84a5-d12a82cc5567 tempest-CreateVolumesFromImageTest-210232301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7421ab5-f52d-4cb2-9731-6ab81b312599) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:43:42 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-03b44d8e-c351-479e-84a5-d12a82cc5567 tempest-CreateVolumesFromImageTest-210232301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43f533b0-efeb-4eba-9f8f-802e9dd6ef1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:43:42 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-03b44d8e-c351-479e-84a5-d12a82cc5567 tempest-CreateVolumesFromImageTest-210232301 None] Volume 2bf3324b-6ad0-4df3-ae96-88135f793679: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2bf3324b-6ad0-4df3-ae96-88135f793679', 'volume_size': 1} Jun 29 03:43:42 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-03b44d8e-c351-479e-84a5-d12a82cc5567 tempest-CreateVolumesFromImageTest-210232301 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:43:42 devstack sudo[114321]: pam_unix(sudo:session): session closed for user root Jun 29 03:43:42 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ae08230e-7726-4e81-aa9c-fec08abd5e72 tempest-CreateVolumesFromImageTest-210232301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-532e0e13-477b-4cdf-9cf0-c776136c6001" returned: 0 in 0.658s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:43:42 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-ae08230e-7726-4e81-aa9c-fec08abd5e72 tempest-CreateVolumesFromImageTest-210232301 None] <== create_volume: return (2237ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:43:42 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-ae08230e-7726-4e81-aa9c-fec08abd5e72 tempest-CreateVolumesFromImageTest-210232301 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.241s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:43:42 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-4b4f1998-5e18-40a3-acab-0e13ed72733c tempest-CreateVolumesFromSnapshotTest-1093373581 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.492s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:43:42 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-4b4f1998-5e18-40a3-acab-0e13ed72733c tempest-CreateVolumesFromSnapshotTest-1093373581 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:43:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1152520074',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9148723b-25c2-4581-884c-91a072699cbd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64bb520d993e427c9c4490b050e40a72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:43:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:43:41Z,use_quota=True,user_id='998a078d10ae4063a2f3b87f6f1d255d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:43:42 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-4b4f1998-5e18-40a3-acab-0e13ed72733c tempest-CreateVolumesFromSnapshotTest-1093373581 None] Creating volume 9148723b-25c2-4581-884c-91a072699cbd {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:43:42 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-4b4f1998-5e18-40a3-acab-0e13ed72733c tempest-CreateVolumesFromSnapshotTest-1093373581 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:43:42 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-4b4f1998-5e18-40a3-acab-0e13ed72733c tempest-CreateVolumesFromSnapshotTest-1093373581 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:43:42 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-4b4f1998-5e18-40a3-acab-0e13ed72733c tempest-CreateVolumesFromSnapshotTest-1093373581 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:43:42 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-4b4f1998-5e18-40a3-acab-0e13ed72733c tempest-CreateVolumesFromSnapshotTest-1093373581 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:43:42 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-4b4f1998-5e18-40a3-acab-0e13ed72733c tempest-CreateVolumesFromSnapshotTest-1093373581 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:43:42 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-4b4f1998-5e18-40a3-acab-0e13ed72733c tempest-CreateVolumesFromSnapshotTest-1093373581 None] Selected osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:43:42 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-4b4f1998-5e18-40a3-acab-0e13ed72733c tempest-CreateVolumesFromSnapshotTest-1093373581 None] casted to osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f Jun 29 03:43:42 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-4b4f1998-5e18-40a3-acab-0e13ed72733c tempest-CreateVolumesFromSnapshotTest-1093373581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9148723b-25c2-4581-884c-91a072699cbd 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:43:43 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-ae08230e-7726-4e81-aa9c-fec08abd5e72 tempest-CreateVolumesFromImageTest-210232301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cbc71ce-8bbc-44c4-b32e-ffbf6a2741a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-532e0e13-477b-4cdf-9cf0-c776136c6001', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:43:43 devstack sudo[114324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9148723b-25c2-4581-884c-91a072699cbd 1073741824 Jun 29 03:43:43 devstack sudo[114324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:43:43 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-ae08230e-7726-4e81-aa9c-fec08abd5e72 tempest-CreateVolumesFromImageTest-210232301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f516df00-2f76-47ba-b830-50ddc5d6681d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:43:43 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-ae08230e-7726-4e81-aa9c-fec08abd5e72 tempest-CreateVolumesFromImageTest-210232301 None] Volume volume-532e0e13-477b-4cdf-9cf0-c776136c6001 (532e0e13-477b-4cdf-9cf0-c776136c6001): created successfully Jun 29 03:43:43 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-ae08230e-7726-4e81-aa9c-fec08abd5e72 tempest-CreateVolumesFromImageTest-210232301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f516df00-2f76-47ba-b830-50ddc5d6681d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:43:43 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-ae08230e-7726-4e81-aa9c-fec08abd5e72 tempest-CreateVolumesFromImageTest-210232301 None] Flow 'volume_create_manager' (23faf2b2-d79b-4ca5-9f04-6cc732963b48) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:43:43 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-ae08230e-7726-4e81-aa9c-fec08abd5e72 tempest-CreateVolumesFromImageTest-210232301 None] Created volume successfully. Jun 29 03:43:43 devstack sudo[114324]: pam_unix(sudo:session): session closed for user root Jun 29 03:43:43 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-4b4f1998-5e18-40a3-acab-0e13ed72733c tempest-CreateVolumesFromSnapshotTest-1093373581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9148723b-25c2-4581-884c-91a072699cbd 1073741824" returned: 0 in 0.844s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:43:43 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-4b4f1998-5e18-40a3-acab-0e13ed72733c tempest-CreateVolumesFromSnapshotTest-1093373581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9148723b-25c2-4581-884c-91a072699cbd {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:43:43 devstack sudo[114331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9148723b-25c2-4581-884c-91a072699cbd Jun 29 03:43:43 devstack sudo[114331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:43:44 devstack sudo[114331]: pam_unix(sudo:session): session closed for user root Jun 29 03:43:44 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-4b4f1998-5e18-40a3-acab-0e13ed72733c tempest-CreateVolumesFromSnapshotTest-1093373581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9148723b-25c2-4581-884c-91a072699cbd" returned: 0 in 0.689s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:43:44 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-4b4f1998-5e18-40a3-acab-0e13ed72733c tempest-CreateVolumesFromSnapshotTest-1093373581 None] <== create_volume: return (1576ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:43:44 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-4b4f1998-5e18-40a3-acab-0e13ed72733c tempest-CreateVolumesFromSnapshotTest-1093373581 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.581s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:43:44 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-584945bf-f0a2-4d26-99c6-ea8f18836013 tempest-CreateVolumesFromImageTest-210232301 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.778s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:43:44 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-584945bf-f0a2-4d26-99c6-ea8f18836013 tempest-CreateVolumesFromImageTest-210232301 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:43:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1877350340',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f10d343-140c-4c83-97b8-1f5dc5253f5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8cec79e1c9d24d3caa87712d26347595',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:43:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:43:41Z,use_quota=True,user_id='b0582c0d0f3344dbb005a5150f676904',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:43:44 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-584945bf-f0a2-4d26-99c6-ea8f18836013 tempest-CreateVolumesFromImageTest-210232301 None] Creating volume 4f10d343-140c-4c83-97b8-1f5dc5253f5b {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:43:44 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-584945bf-f0a2-4d26-99c6-ea8f18836013 tempest-CreateVolumesFromImageTest-210232301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:43:44 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-584945bf-f0a2-4d26-99c6-ea8f18836013 tempest-CreateVolumesFromImageTest-210232301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:43:44 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-584945bf-f0a2-4d26-99c6-ea8f18836013 tempest-CreateVolumesFromImageTest-210232301 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:43:44 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-584945bf-f0a2-4d26-99c6-ea8f18836013 tempest-CreateVolumesFromImageTest-210232301 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:43:44 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-584945bf-f0a2-4d26-99c6-ea8f18836013 tempest-CreateVolumesFromImageTest-210232301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:43:44 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-584945bf-f0a2-4d26-99c6-ea8f18836013 tempest-CreateVolumesFromImageTest-210232301 None] Selected osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:43:44 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-584945bf-f0a2-4d26-99c6-ea8f18836013 tempest-CreateVolumesFromImageTest-210232301 None] casted to osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f Jun 29 03:43:44 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-584945bf-f0a2-4d26-99c6-ea8f18836013 tempest-CreateVolumesFromImageTest-210232301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-4f10d343-140c-4c83-97b8-1f5dc5253f5b 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:43:44 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-4b4f1998-5e18-40a3-acab-0e13ed72733c tempest-CreateVolumesFromSnapshotTest-1093373581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eec6494b-a444-474c-93ba-18954d5e9d71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9148723b-25c2-4581-884c-91a072699cbd', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:43:44 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-4b4f1998-5e18-40a3-acab-0e13ed72733c tempest-CreateVolumesFromSnapshotTest-1093373581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1d3c5a5-5295-447b-b114-e155e888abb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:43:44 devstack sudo[114334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-4f10d343-140c-4c83-97b8-1f5dc5253f5b 1073741824 Jun 29 03:43:44 devstack sudo[114334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:43:44 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-4b4f1998-5e18-40a3-acab-0e13ed72733c tempest-CreateVolumesFromSnapshotTest-1093373581 None] Volume volume-9148723b-25c2-4581-884c-91a072699cbd (9148723b-25c2-4581-884c-91a072699cbd): created successfully Jun 29 03:43:44 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-4b4f1998-5e18-40a3-acab-0e13ed72733c tempest-CreateVolumesFromSnapshotTest-1093373581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1d3c5a5-5295-447b-b114-e155e888abb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:43:44 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-4b4f1998-5e18-40a3-acab-0e13ed72733c tempest-CreateVolumesFromSnapshotTest-1093373581 None] Flow 'volume_create_manager' (3e55fb3d-b003-4be5-bab5-9176e5de1204) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:43:44 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-4b4f1998-5e18-40a3-acab-0e13ed72733c tempest-CreateVolumesFromSnapshotTest-1093373581 None] Created volume successfully. Jun 29 03:43:44 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-571e83fe-f9c6-4f3b-a3ae-e6d63a14676f tempest-VolumeAndVolumeTypeFromImageTest-1239773066 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:43:44 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-571e83fe-f9c6-4f3b-a3ae-e6d63a14676f tempest-VolumeAndVolumeTypeFromImageTest-1239773066 None] Flow 'volume_create_manager' (408ecfd0-4093-4f49-bfef-46a3268b35aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:43:44 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-571e83fe-f9c6-4f3b-a3ae-e6d63a14676f tempest-VolumeAndVolumeTypeFromImageTest-1239773066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0503f55c-eac3-4c6c-9a5a-10c4dca9aa9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:43:44 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-571e83fe-f9c6-4f3b-a3ae-e6d63a14676f tempest-VolumeAndVolumeTypeFromImageTest-1239773066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0503f55c-eac3-4c6c-9a5a-10c4dca9aa9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:43:45Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d6029b1-adf8-49f9-8496-6b6e46e22860,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7f4f5e848ac4ad0859368c43a3a366d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:43:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:43:45Z,use_quota=True,user_id='a06c2ff69d7b448282d5355a8b55099c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92d38901-0cc3-4c2a-a72c-48b68b7357ba),volume_type_id=92d38901-0cc3-4c2a-a72c-48b68b7357ba)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:43:44 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-571e83fe-f9c6-4f3b-a3ae-e6d63a14676f tempest-VolumeAndVolumeTypeFromImageTest-1239773066 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a4a4703-1ed9-4e7c-923a-7f32b7ab0a09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:43:44 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-571e83fe-f9c6-4f3b-a3ae-e6d63a14676f tempest-VolumeAndVolumeTypeFromImageTest-1239773066 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a4a4703-1ed9-4e7c-923a-7f32b7ab0a09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:43:44 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-571e83fe-f9c6-4f3b-a3ae-e6d63a14676f tempest-VolumeAndVolumeTypeFromImageTest-1239773066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96ef8a6f-b44b-4668-9adb-9a0174ceaa12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:43:44 devstack cinder-volume[93468]: DEBUG cinder.image.glance [None req-571e83fe-f9c6-4f3b-a3ae-e6d63a14676f tempest-VolumeAndVolumeTypeFromImageTest-1239773066 None] Creating Keystone auth plugin from conf {{(pid=93468) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 29 03:43:45 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-571e83fe-f9c6-4f3b-a3ae-e6d63a14676f tempest-VolumeAndVolumeTypeFromImageTest-1239773066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96ef8a6f-b44b-4668-9adb-9a0174ceaa12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '0d6029b1-adf8-49f9-8496-6b6e46e22860', 'volume_name': 'volume-0d6029b1-adf8-49f9-8496-6b6e46e22860', 'volume_size': 1, 'image_id': '5f3d629d-98ff-4a80-a67c-8e04b9cae3a6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5f3d629d-98ff-4a80-a67c-8e04b9cae3a6', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '2d0e7fc569fc5d0fdfc434c386e1ef7f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd7f4f5e848ac4ad0859368c43a3a366d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '10d6c0f74272fca6d423728fc70597fafda7110ac08775c6c4bc2fe3e46879ed8a1a7690d5d3e866f69f9d5c5a95154382d4ce26f972f7de3cb405aac7692931', 'id': '5f3d629d-98ff-4a80-a67c-8e04b9cae3a6', 'created_at': datetime.datetime(2026, 6, 29, 1, 43, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 29, 1, 43, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5f3d629d-98ff-4a80-a67c-8e04b9cae3a6/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:43:45 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-571e83fe-f9c6-4f3b-a3ae-e6d63a14676f tempest-VolumeAndVolumeTypeFromImageTest-1239773066 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6100dc50-dacf-406b-85a4-aa667c5d2fa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:43:45 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-571e83fe-f9c6-4f3b-a3ae-e6d63a14676f tempest-VolumeAndVolumeTypeFromImageTest-1239773066 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6100dc50-dacf-406b-85a4-aa667c5d2fa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:43:45 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-571e83fe-f9c6-4f3b-a3ae-e6d63a14676f tempest-VolumeAndVolumeTypeFromImageTest-1239773066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5a808cc-7a2c-4612-a5b8-9706e593cf62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:43:45 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-571e83fe-f9c6-4f3b-a3ae-e6d63a14676f tempest-VolumeAndVolumeTypeFromImageTest-1239773066 None] Volume 0d6029b1-adf8-49f9-8496-6b6e46e22860: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-0d6029b1-adf8-49f9-8496-6b6e46e22860', 'volume_size': 1, 'image_id': '5f3d629d-98ff-4a80-a67c-8e04b9cae3a6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5f3d629d-98ff-4a80-a67c-8e04b9cae3a6', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '2d0e7fc569fc5d0fdfc434c386e1ef7f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd7f4f5e848ac4ad0859368c43a3a366d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '10d6c0f74272fca6d423728fc70597fafda7110ac08775c6c4bc2fe3e46879ed8a1a7690d5d3e866f69f9d5c5a95154382d4ce26f972f7de3cb405aac7692931', 'id': '5f3d629d-98ff-4a80-a67c-8e04b9cae3a6', 'created_at': datetime.datetime(2026, 6, 29, 1, 43, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 29, 1, 43, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5f3d629d-98ff-4a80-a67c-8e04b9cae3a6/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jun 29 03:43:45 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-571e83fe-f9c6-4f3b-a3ae-e6d63a14676f tempest-VolumeAndVolumeTypeFromImageTest-1239773066 None] Trying to clone 0d6029b1-adf8-49f9-8496-6b6e46e22860 from image 5f3d629d-98ff-4a80-a67c-8e04b9cae3a6 at location (None, [{'url': 'file:///opt/stack/data/glance/images/5f3d629d-98ff-4a80-a67c-8e04b9cae3a6', 'metadata': {}}]). {{(pid=93468) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 29 03:43:45 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-e2f4a2e3-93ca-4d20-8d6b-a048c31b629e tempest-CreateVolumesFromSnapshotTest-1093373581 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:43:45 devstack cinder-volume[93468]: DEBUG cinder.image.image_utils [None req-571e83fe-f9c6-4f3b-a3ae-e6d63a14676f tempest-VolumeAndVolumeTypeFromImageTest-1239773066 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_5f3d629d-98ff-4a80-a67c-8e04b9cae3a6_6hpb96_0devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=93468) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 29 03:43:45 devstack cinder-volume[93468]: INFO cinder.image.image_utils [None req-571e83fe-f9c6-4f3b-a3ae-e6d63a14676f tempest-VolumeAndVolumeTypeFromImageTest-1239773066 None] Image download 0.00 MB at 0.00 MB/s Jun 29 03:43:45 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f06b4cf-2090-4c35-91d6-776b999ac855]: (4, 'raw') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:43:45 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-571e83fe-f9c6-4f3b-a3ae-e6d63a14676f tempest-VolumeAndVolumeTypeFromImageTest-1239773066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5f3d629d-98ff-4a80-a67c-8e04b9cae3a6_6hpb96_0devstack@QuobyteHD {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:43:45 devstack sudo[114340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5f3d629d-98ff-4a80-a67c-8e04b9cae3a6_6hpb96_0devstack@QuobyteHD Jun 29 03:43:45 devstack sudo[114340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:43:45 devstack sudo[114334]: pam_unix(sudo:session): session closed for user root Jun 29 03:43:45 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-584945bf-f0a2-4d26-99c6-ea8f18836013 tempest-CreateVolumesFromImageTest-210232301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-4f10d343-140c-4c83-97b8-1f5dc5253f5b 1073741824" returned: 0 in 0.964s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:43:45 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-584945bf-f0a2-4d26-99c6-ea8f18836013 tempest-CreateVolumesFromImageTest-210232301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-4f10d343-140c-4c83-97b8-1f5dc5253f5b {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:43:45 devstack sudo[114342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-4f10d343-140c-4c83-97b8-1f5dc5253f5b Jun 29 03:43:45 devstack sudo[114342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:43:46 devstack sudo[114340]: pam_unix(sudo:session): session closed for user root Jun 29 03:43:46 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-571e83fe-f9c6-4f3b-a3ae-e6d63a14676f tempest-VolumeAndVolumeTypeFromImageTest-1239773066 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5f3d629d-98ff-4a80-a67c-8e04b9cae3a6_6hpb96_0devstack@QuobyteHD" returned: 0 in 0.726s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:43:46 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-571e83fe-f9c6-4f3b-a3ae-e6d63a14676f tempest-VolumeAndVolumeTypeFromImageTest-1239773066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5f3d629d-98ff-4a80-a67c-8e04b9cae3a6_6hpb96_0devstack@QuobyteHD {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:43:46 devstack sudo[114347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5f3d629d-98ff-4a80-a67c-8e04b9cae3a6_6hpb96_0devstack@QuobyteHD Jun 29 03:43:46 devstack sudo[114347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:43:46 devstack sudo[114342]: pam_unix(sudo:session): session closed for user root Jun 29 03:43:46 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-584945bf-f0a2-4d26-99c6-ea8f18836013 tempest-CreateVolumesFromImageTest-210232301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-4f10d343-140c-4c83-97b8-1f5dc5253f5b" returned: 0 in 0.673s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:43:46 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-584945bf-f0a2-4d26-99c6-ea8f18836013 tempest-CreateVolumesFromImageTest-210232301 None] <== create_volume: return (1683ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:43:46 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-584945bf-f0a2-4d26-99c6-ea8f18836013 tempest-CreateVolumesFromImageTest-210232301 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.685s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:43:46 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-46add7be-802e-4c58-9d07-5b7e6d11e5fe tempest-CreateVolumesFromImageTest-210232301 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.333s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:43:46 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-46add7be-802e-4c58-9d07-5b7e6d11e5fe tempest-CreateVolumesFromImageTest-210232301 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:43:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-903314355',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2bd84b5-5052-4ee0-8dae-1979f0fabf16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8cec79e1c9d24d3caa87712d26347595',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:43:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:43:42Z,use_quota=True,user_id='b0582c0d0f3344dbb005a5150f676904',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:43:46 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-46add7be-802e-4c58-9d07-5b7e6d11e5fe tempest-CreateVolumesFromImageTest-210232301 None] Creating volume f2bd84b5-5052-4ee0-8dae-1979f0fabf16 {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:43:46 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-46add7be-802e-4c58-9d07-5b7e6d11e5fe tempest-CreateVolumesFromImageTest-210232301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:43:46 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-46add7be-802e-4c58-9d07-5b7e6d11e5fe tempest-CreateVolumesFromImageTest-210232301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:43:46 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-46add7be-802e-4c58-9d07-5b7e6d11e5fe tempest-CreateVolumesFromImageTest-210232301 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:43:46 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-46add7be-802e-4c58-9d07-5b7e6d11e5fe tempest-CreateVolumesFromImageTest-210232301 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:43:46 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-46add7be-802e-4c58-9d07-5b7e6d11e5fe tempest-CreateVolumesFromImageTest-210232301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:43:46 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-46add7be-802e-4c58-9d07-5b7e6d11e5fe tempest-CreateVolumesFromImageTest-210232301 None] Selected osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:43:46 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-46add7be-802e-4c58-9d07-5b7e6d11e5fe tempest-CreateVolumesFromImageTest-210232301 None] casted to osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f Jun 29 03:43:46 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-46add7be-802e-4c58-9d07-5b7e6d11e5fe tempest-CreateVolumesFromImageTest-210232301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-f2bd84b5-5052-4ee0-8dae-1979f0fabf16 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:43:46 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-584945bf-f0a2-4d26-99c6-ea8f18836013 tempest-CreateVolumesFromImageTest-210232301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4670a1d9-303c-4a38-9272-19f78baa61b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f10d343-140c-4c83-97b8-1f5dc5253f5b', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:43:46 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-584945bf-f0a2-4d26-99c6-ea8f18836013 tempest-CreateVolumesFromImageTest-210232301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (144bfa00-2876-48bf-b535-f23fb1eb50a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:43:46 devstack sudo[114349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-f2bd84b5-5052-4ee0-8dae-1979f0fabf16 1073741824 Jun 29 03:43:46 devstack sudo[114349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:43:46 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-584945bf-f0a2-4d26-99c6-ea8f18836013 tempest-CreateVolumesFromImageTest-210232301 None] Volume volume-4f10d343-140c-4c83-97b8-1f5dc5253f5b (4f10d343-140c-4c83-97b8-1f5dc5253f5b): created successfully Jun 29 03:43:46 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-584945bf-f0a2-4d26-99c6-ea8f18836013 tempest-CreateVolumesFromImageTest-210232301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (144bfa00-2876-48bf-b535-f23fb1eb50a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:43:46 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-584945bf-f0a2-4d26-99c6-ea8f18836013 tempest-CreateVolumesFromImageTest-210232301 None] Flow 'volume_create_manager' (9bff091f-da26-47d0-a99f-27d47137774a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:43:46 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-584945bf-f0a2-4d26-99c6-ea8f18836013 tempest-CreateVolumesFromImageTest-210232301 None] Created volume successfully. Jun 29 03:43:46 devstack sudo[114347]: pam_unix(sudo:session): session closed for user root Jun 29 03:43:46 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-571e83fe-f9c6-4f3b-a3ae-e6d63a14676f tempest-VolumeAndVolumeTypeFromImageTest-1239773066 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5f3d629d-98ff-4a80-a67c-8e04b9cae3a6_6hpb96_0devstack@QuobyteHD" returned: 1 in 0.781s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:43:46 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-571e83fe-f9c6-4f3b-a3ae-e6d63a14676f tempest-VolumeAndVolumeTypeFromImageTest-1239773066 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5f3d629d-98ff-4a80-a67c-8e04b9cae3a6_6hpb96_0devstack@QuobyteHD' failed. Not Retrying. {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 29 03:43:46 devstack cinder-volume[93468]: DEBUG cinder.image.image_utils [None req-571e83fe-f9c6-4f3b-a3ae-e6d63a14676f tempest-VolumeAndVolumeTypeFromImageTest-1239773066 None] Temporary image 5f3d629d-98ff-4a80-a67c-8e04b9cae3a6 is fetched for user a06c2ff69d7b448282d5355a8b55099c. {{(pid=93468) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 29 03:43:46 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[45c109a4-4c53-48e9-8dd1-96d9c2068be6]: (4, 'raw') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:43:46 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-571e83fe-f9c6-4f3b-a3ae-e6d63a14676f tempest-VolumeAndVolumeTypeFromImageTest-1239773066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5f3d629d-98ff-4a80-a67c-8e04b9cae3a6_6hpb96_0devstack@QuobyteHD {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:43:47 devstack sudo[114358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5f3d629d-98ff-4a80-a67c-8e04b9cae3a6_6hpb96_0devstack@QuobyteHD Jun 29 03:43:47 devstack sudo[114358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:43:47 devstack sudo[114349]: pam_unix(sudo:session): session closed for user root Jun 29 03:43:47 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-46add7be-802e-4c58-9d07-5b7e6d11e5fe tempest-CreateVolumesFromImageTest-210232301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-f2bd84b5-5052-4ee0-8dae-1979f0fabf16 1073741824" returned: 0 in 0.855s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:43:47 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-46add7be-802e-4c58-9d07-5b7e6d11e5fe tempest-CreateVolumesFromImageTest-210232301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-f2bd84b5-5052-4ee0-8dae-1979f0fabf16 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:43:47 devstack sudo[114360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-f2bd84b5-5052-4ee0-8dae-1979f0fabf16 Jun 29 03:43:47 devstack sudo[114360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:43:47 devstack sudo[114358]: pam_unix(sudo:session): session closed for user root Jun 29 03:43:47 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-571e83fe-f9c6-4f3b-a3ae-e6d63a14676f tempest-VolumeAndVolumeTypeFromImageTest-1239773066 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5f3d629d-98ff-4a80-a67c-8e04b9cae3a6_6hpb96_0devstack@QuobyteHD" returned: 0 in 0.717s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:43:47 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-571e83fe-f9c6-4f3b-a3ae-e6d63a14676f tempest-VolumeAndVolumeTypeFromImageTest-1239773066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5f3d629d-98ff-4a80-a67c-8e04b9cae3a6_6hpb96_0devstack@QuobyteHD {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:43:47 devstack sudo[114364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5f3d629d-98ff-4a80-a67c-8e04b9cae3a6_6hpb96_0devstack@QuobyteHD Jun 29 03:43:47 devstack sudo[114364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:43:47 devstack sudo[114360]: pam_unix(sudo:session): session closed for user root Jun 29 03:43:47 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-46add7be-802e-4c58-9d07-5b7e6d11e5fe tempest-CreateVolumesFromImageTest-210232301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-f2bd84b5-5052-4ee0-8dae-1979f0fabf16" returned: 0 in 0.672s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:43:47 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-46add7be-802e-4c58-9d07-5b7e6d11e5fe tempest-CreateVolumesFromImageTest-210232301 None] <== create_volume: return (1574ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:43:47 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-46add7be-802e-4c58-9d07-5b7e6d11e5fe tempest-CreateVolumesFromImageTest-210232301 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.578s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:43:47 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-9316504f-1184-4dac-a379-a922afaae9d6 tempest-VolumeDependencyTests-1245577734 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.658s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:43:47 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-9316504f-1184-4dac-a379-a922afaae9d6 tempest-VolumeDependencyTests-1245577734 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:43:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2094034403',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1aad3d1f-6a61-4b52-a9a0-ddf7ca5fbe87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5508a57794ce42feae62d6afae7f9f1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:43:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:43:42Z,use_quota=True,user_id='e879ab76007945178088d532c2c38294',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:43:47 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-9316504f-1184-4dac-a379-a922afaae9d6 tempest-VolumeDependencyTests-1245577734 None] Creating volume 1aad3d1f-6a61-4b52-a9a0-ddf7ca5fbe87 {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:43:47 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-9316504f-1184-4dac-a379-a922afaae9d6 tempest-VolumeDependencyTests-1245577734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:43:47 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-9316504f-1184-4dac-a379-a922afaae9d6 tempest-VolumeDependencyTests-1245577734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:43:47 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-9316504f-1184-4dac-a379-a922afaae9d6 tempest-VolumeDependencyTests-1245577734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:43:47 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-9316504f-1184-4dac-a379-a922afaae9d6 tempest-VolumeDependencyTests-1245577734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:43:47 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-9316504f-1184-4dac-a379-a922afaae9d6 tempest-VolumeDependencyTests-1245577734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:43:47 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-9316504f-1184-4dac-a379-a922afaae9d6 tempest-VolumeDependencyTests-1245577734 None] Selected osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:43:47 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-9316504f-1184-4dac-a379-a922afaae9d6 tempest-VolumeDependencyTests-1245577734 None] casted to osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f Jun 29 03:43:47 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-9316504f-1184-4dac-a379-a922afaae9d6 tempest-VolumeDependencyTests-1245577734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-1aad3d1f-6a61-4b52-a9a0-ddf7ca5fbe87 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:43:47 devstack sudo[114367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-1aad3d1f-6a61-4b52-a9a0-ddf7ca5fbe87 1073741824 Jun 29 03:43:47 devstack sudo[114367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:43:47 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-46add7be-802e-4c58-9d07-5b7e6d11e5fe tempest-CreateVolumesFromImageTest-210232301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9883bbb1-f47d-403d-b850-a1c272dc614c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f2bd84b5-5052-4ee0-8dae-1979f0fabf16', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:43:47 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-46add7be-802e-4c58-9d07-5b7e6d11e5fe tempest-CreateVolumesFromImageTest-210232301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9221903-7c00-4e18-b14e-a9df4727b826) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:43:47 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-46add7be-802e-4c58-9d07-5b7e6d11e5fe tempest-CreateVolumesFromImageTest-210232301 None] Volume volume-f2bd84b5-5052-4ee0-8dae-1979f0fabf16 (f2bd84b5-5052-4ee0-8dae-1979f0fabf16): created successfully Jun 29 03:43:47 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-46add7be-802e-4c58-9d07-5b7e6d11e5fe tempest-CreateVolumesFromImageTest-210232301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9221903-7c00-4e18-b14e-a9df4727b826) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:43:47 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-46add7be-802e-4c58-9d07-5b7e6d11e5fe tempest-CreateVolumesFromImageTest-210232301 None] Flow 'volume_create_manager' (6fbe437a-a793-40f8-856a-8974f21b1a4b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:43:47 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-46add7be-802e-4c58-9d07-5b7e6d11e5fe tempest-CreateVolumesFromImageTest-210232301 None] Created volume successfully. Jun 29 03:43:48 devstack sudo[114364]: pam_unix(sudo:session): session closed for user root Jun 29 03:43:48 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-571e83fe-f9c6-4f3b-a3ae-e6d63a14676f tempest-VolumeAndVolumeTypeFromImageTest-1239773066 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5f3d629d-98ff-4a80-a67c-8e04b9cae3a6_6hpb96_0devstack@QuobyteHD" returned: 1 in 0.749s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:43:48 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-571e83fe-f9c6-4f3b-a3ae-e6d63a14676f tempest-VolumeAndVolumeTypeFromImageTest-1239773066 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5f3d629d-98ff-4a80-a67c-8e04b9cae3a6_6hpb96_0devstack@QuobyteHD' failed. Not Retrying. {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 29 03:43:48 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-571e83fe-f9c6-4f3b-a3ae-e6d63a14676f tempest-VolumeAndVolumeTypeFromImageTest-1239773066 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:43:48 devstack sudo[114367]: pam_unix(sudo:session): session closed for user root Jun 29 03:43:48 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-9316504f-1184-4dac-a379-a922afaae9d6 tempest-VolumeDependencyTests-1245577734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-1aad3d1f-6a61-4b52-a9a0-ddf7ca5fbe87 1073741824" returned: 0 in 0.874s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:43:48 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-9316504f-1184-4dac-a379-a922afaae9d6 tempest-VolumeDependencyTests-1245577734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-1aad3d1f-6a61-4b52-a9a0-ddf7ca5fbe87 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:43:48 devstack sudo[114412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-1aad3d1f-6a61-4b52-a9a0-ddf7ca5fbe87 Jun 29 03:43:48 devstack sudo[114412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:43:49 devstack sudo[114412]: pam_unix(sudo:session): session closed for user root Jun 29 03:43:49 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-9316504f-1184-4dac-a379-a922afaae9d6 tempest-VolumeDependencyTests-1245577734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-1aad3d1f-6a61-4b52-a9a0-ddf7ca5fbe87" returned: 0 in 0.644s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:43:49 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-9316504f-1184-4dac-a379-a922afaae9d6 tempest-VolumeDependencyTests-1245577734 None] <== create_volume: return (1567ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:43:49 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-9316504f-1184-4dac-a379-a922afaae9d6 tempest-VolumeDependencyTests-1245577734 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.570s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:43:49 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-455d82a1-e7db-4354-9d96-d24b999ebb2f tempest-CreateVolumesFromImageTest-210232301 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.103s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:43:49 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-455d82a1-e7db-4354-9d96-d24b999ebb2f tempest-CreateVolumesFromImageTest-210232301 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:43:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1499601946',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b0cbe04-a06e-4301-a382-1ba1aab29f33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8cec79e1c9d24d3caa87712d26347595',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:43:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:43:42Z,use_quota=True,user_id='b0582c0d0f3344dbb005a5150f676904',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:43:49 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-455d82a1-e7db-4354-9d96-d24b999ebb2f tempest-CreateVolumesFromImageTest-210232301 None] Creating volume 6b0cbe04-a06e-4301-a382-1ba1aab29f33 {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:43:49 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-455d82a1-e7db-4354-9d96-d24b999ebb2f tempest-CreateVolumesFromImageTest-210232301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:43:49 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-455d82a1-e7db-4354-9d96-d24b999ebb2f tempest-CreateVolumesFromImageTest-210232301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:43:49 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-455d82a1-e7db-4354-9d96-d24b999ebb2f tempest-CreateVolumesFromImageTest-210232301 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:43:49 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-455d82a1-e7db-4354-9d96-d24b999ebb2f tempest-CreateVolumesFromImageTest-210232301 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:43:49 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-455d82a1-e7db-4354-9d96-d24b999ebb2f tempest-CreateVolumesFromImageTest-210232301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:43:49 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-455d82a1-e7db-4354-9d96-d24b999ebb2f tempest-CreateVolumesFromImageTest-210232301 None] Selected osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:43:49 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-455d82a1-e7db-4354-9d96-d24b999ebb2f tempest-CreateVolumesFromImageTest-210232301 None] casted to osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f Jun 29 03:43:49 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-455d82a1-e7db-4354-9d96-d24b999ebb2f tempest-CreateVolumesFromImageTest-210232301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-6b0cbe04-a06e-4301-a382-1ba1aab29f33 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:43:49 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-9316504f-1184-4dac-a379-a922afaae9d6 tempest-VolumeDependencyTests-1245577734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd5a3d69-017a-48e1-b63d-e20bd95631a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1aad3d1f-6a61-4b52-a9a0-ddf7ca5fbe87', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:43:49 devstack sudo[114415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-6b0cbe04-a06e-4301-a382-1ba1aab29f33 1073741824 Jun 29 03:43:49 devstack sudo[114415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:43:49 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-9316504f-1184-4dac-a379-a922afaae9d6 tempest-VolumeDependencyTests-1245577734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3f1aae2-25f0-4495-bff5-2b71495a1faa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:43:49 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-9316504f-1184-4dac-a379-a922afaae9d6 tempest-VolumeDependencyTests-1245577734 None] Volume volume-1aad3d1f-6a61-4b52-a9a0-ddf7ca5fbe87 (1aad3d1f-6a61-4b52-a9a0-ddf7ca5fbe87): created successfully Jun 29 03:43:49 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-9316504f-1184-4dac-a379-a922afaae9d6 tempest-VolumeDependencyTests-1245577734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3f1aae2-25f0-4495-bff5-2b71495a1faa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:43:49 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-9316504f-1184-4dac-a379-a922afaae9d6 tempest-VolumeDependencyTests-1245577734 None] Flow 'volume_create_manager' (bd0eb05e-66eb-4f42-8942-035a8183d1d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:43:49 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-9316504f-1184-4dac-a379-a922afaae9d6 tempest-VolumeDependencyTests-1245577734 None] Created volume successfully. Jun 29 03:43:49 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-d1dfce0a-e901-484f-bca3-6b13c712f0fb tempest-VolumeDependencyTests-1245577734 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:43:50 devstack sudo[114415]: pam_unix(sudo:session): session closed for user root Jun 29 03:43:50 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-455d82a1-e7db-4354-9d96-d24b999ebb2f tempest-CreateVolumesFromImageTest-210232301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-6b0cbe04-a06e-4301-a382-1ba1aab29f33 1073741824" returned: 0 in 0.848s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:43:50 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-455d82a1-e7db-4354-9d96-d24b999ebb2f tempest-CreateVolumesFromImageTest-210232301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-6b0cbe04-a06e-4301-a382-1ba1aab29f33 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:43:50 devstack sudo[114421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-6b0cbe04-a06e-4301-a382-1ba1aab29f33 Jun 29 03:43:50 devstack sudo[114421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:43:50 devstack sudo[114421]: pam_unix(sudo:session): session closed for user root Jun 29 03:43:50 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-455d82a1-e7db-4354-9d96-d24b999ebb2f tempest-CreateVolumesFromImageTest-210232301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-6b0cbe04-a06e-4301-a382-1ba1aab29f33" returned: 0 in 0.642s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:43:50 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-455d82a1-e7db-4354-9d96-d24b999ebb2f tempest-CreateVolumesFromImageTest-210232301 None] <== create_volume: return (1527ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:43:50 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-455d82a1-e7db-4354-9d96-d24b999ebb2f tempest-CreateVolumesFromImageTest-210232301 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.531s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:43:50 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-03b44d8e-c351-479e-84a5-d12a82cc5567 tempest-CreateVolumesFromImageTest-210232301 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.463s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:43:50 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-03b44d8e-c351-479e-84a5-d12a82cc5567 tempest-CreateVolumesFromImageTest-210232301 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:43:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1342279050',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bf3324b-6ad0-4df3-ae96-88135f793679,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8cec79e1c9d24d3caa87712d26347595',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:43:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:43:42Z,use_quota=True,user_id='b0582c0d0f3344dbb005a5150f676904',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:43:50 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-03b44d8e-c351-479e-84a5-d12a82cc5567 tempest-CreateVolumesFromImageTest-210232301 None] Creating volume 2bf3324b-6ad0-4df3-ae96-88135f793679 {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:43:50 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-03b44d8e-c351-479e-84a5-d12a82cc5567 tempest-CreateVolumesFromImageTest-210232301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:43:50 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-03b44d8e-c351-479e-84a5-d12a82cc5567 tempest-CreateVolumesFromImageTest-210232301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:43:50 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-03b44d8e-c351-479e-84a5-d12a82cc5567 tempest-CreateVolumesFromImageTest-210232301 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:43:50 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-03b44d8e-c351-479e-84a5-d12a82cc5567 tempest-CreateVolumesFromImageTest-210232301 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:43:50 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-03b44d8e-c351-479e-84a5-d12a82cc5567 tempest-CreateVolumesFromImageTest-210232301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:43:50 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-03b44d8e-c351-479e-84a5-d12a82cc5567 tempest-CreateVolumesFromImageTest-210232301 None] Selected osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:43:50 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-03b44d8e-c351-479e-84a5-d12a82cc5567 tempest-CreateVolumesFromImageTest-210232301 None] casted to osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f Jun 29 03:43:50 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-03b44d8e-c351-479e-84a5-d12a82cc5567 tempest-CreateVolumesFromImageTest-210232301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-2bf3324b-6ad0-4df3-ae96-88135f793679 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:43:50 devstack sudo[114424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-2bf3324b-6ad0-4df3-ae96-88135f793679 1073741824 Jun 29 03:43:50 devstack sudo[114424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:43:50 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-455d82a1-e7db-4354-9d96-d24b999ebb2f tempest-CreateVolumesFromImageTest-210232301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1293337c-3b21-41e8-957c-90851d106381) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b0cbe04-a06e-4301-a382-1ba1aab29f33', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:43:50 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-455d82a1-e7db-4354-9d96-d24b999ebb2f tempest-CreateVolumesFromImageTest-210232301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a833fc5c-0f2d-45f3-b2b7-02b5f4ca9ac8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:43:51 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-455d82a1-e7db-4354-9d96-d24b999ebb2f tempest-CreateVolumesFromImageTest-210232301 None] Volume volume-6b0cbe04-a06e-4301-a382-1ba1aab29f33 (6b0cbe04-a06e-4301-a382-1ba1aab29f33): created successfully Jun 29 03:43:51 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-455d82a1-e7db-4354-9d96-d24b999ebb2f tempest-CreateVolumesFromImageTest-210232301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a833fc5c-0f2d-45f3-b2b7-02b5f4ca9ac8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:43:51 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-455d82a1-e7db-4354-9d96-d24b999ebb2f tempest-CreateVolumesFromImageTest-210232301 None] Flow 'volume_create_manager' (ea8ce755-fa64-4c6b-a5fe-39f75ff926e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:43:51 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-455d82a1-e7db-4354-9d96-d24b999ebb2f tempest-CreateVolumesFromImageTest-210232301 None] Created volume successfully. Jun 29 03:43:51 devstack sudo[114424]: pam_unix(sudo:session): session closed for user root Jun 29 03:43:51 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-03b44d8e-c351-479e-84a5-d12a82cc5567 tempest-CreateVolumesFromImageTest-210232301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-2bf3324b-6ad0-4df3-ae96-88135f793679 1073741824" returned: 0 in 0.787s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:43:51 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-03b44d8e-c351-479e-84a5-d12a82cc5567 tempest-CreateVolumesFromImageTest-210232301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-2bf3324b-6ad0-4df3-ae96-88135f793679 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:43:51 devstack sudo[114430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-2bf3324b-6ad0-4df3-ae96-88135f793679 Jun 29 03:43:51 devstack sudo[114430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:43:52 devstack sudo[114430]: pam_unix(sudo:session): session closed for user root Jun 29 03:43:52 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-03b44d8e-c351-479e-84a5-d12a82cc5567 tempest-CreateVolumesFromImageTest-210232301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-2bf3324b-6ad0-4df3-ae96-88135f793679" returned: 0 in 0.630s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:43:52 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-03b44d8e-c351-479e-84a5-d12a82cc5567 tempest-CreateVolumesFromImageTest-210232301 None] <== create_volume: return (1471ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:43:52 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-03b44d8e-c351-479e-84a5-d12a82cc5567 tempest-CreateVolumesFromImageTest-210232301 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.474s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:43:52 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-e2f4a2e3-93ca-4d20-8d6b-a048c31b629e tempest-CreateVolumesFromSnapshotTest-1093373581 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.162s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:43:52 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-03b44d8e-c351-479e-84a5-d12a82cc5567 tempest-CreateVolumesFromImageTest-210232301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43f533b0-efeb-4eba-9f8f-802e9dd6ef1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2bf3324b-6ad0-4df3-ae96-88135f793679', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:43:52 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-03b44d8e-c351-479e-84a5-d12a82cc5567 tempest-CreateVolumesFromImageTest-210232301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec4a0b54-804d-4a9f-a485-605cc255624a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:43:52 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-e2f4a2e3-93ca-4d20-8d6b-a048c31b629e tempest-CreateVolumesFromSnapshotTest-1093373581 None] Creating offline snapshot 5c33f15e-4654-4c11-b949-f3a282e07dc1 of volume 9148723b-25c2-4581-884c-91a072699cbd {{(pid=93468) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 29 03:43:52 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-03b44d8e-c351-479e-84a5-d12a82cc5567 tempest-CreateVolumesFromImageTest-210232301 None] Volume volume-2bf3324b-6ad0-4df3-ae96-88135f793679 (2bf3324b-6ad0-4df3-ae96-88135f793679): created successfully Jun 29 03:43:52 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-03b44d8e-c351-479e-84a5-d12a82cc5567 tempest-CreateVolumesFromImageTest-210232301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec4a0b54-804d-4a9f-a485-605cc255624a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:43:52 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-03b44d8e-c351-479e-84a5-d12a82cc5567 tempest-CreateVolumesFromImageTest-210232301 None] Flow 'volume_create_manager' (17072503-9d6e-41f3-9aa2-648f3208b1fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:43:52 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ad49d1b-e94a-41ef-a2bf-c9136f976349]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:43:52 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-e2f4a2e3-93ca-4d20-8d6b-a048c31b629e tempest-CreateVolumesFromSnapshotTest-1093373581 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9148723b-25c2-4581-884c-91a072699cbd {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:43:52 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-03b44d8e-c351-479e-84a5-d12a82cc5567 tempest-CreateVolumesFromImageTest-210232301 None] Created volume successfully. Jun 29 03:43:52 devstack sudo[114434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9148723b-25c2-4581-884c-91a072699cbd Jun 29 03:43:52 devstack sudo[114434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:43:53 devstack sudo[114434]: pam_unix(sudo:session): session closed for user root Jun 29 03:43:53 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-e2f4a2e3-93ca-4d20-8d6b-a048c31b629e tempest-CreateVolumesFromSnapshotTest-1093373581 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9148723b-25c2-4581-884c-91a072699cbd" returned: 0 in 0.731s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:43:53 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-e2f4a2e3-93ca-4d20-8d6b-a048c31b629e tempest-CreateVolumesFromSnapshotTest-1093373581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9148723b-25c2-4581-884c-91a072699cbd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9148723b-25c2-4581-884c-91a072699cbd.5c33f15e-4654-4c11-b949-f3a282e07dc1 1G {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:43:53 devstack sudo[114439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9148723b-25c2-4581-884c-91a072699cbd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9148723b-25c2-4581-884c-91a072699cbd.5c33f15e-4654-4c11-b949-f3a282e07dc1 1G Jun 29 03:43:53 devstack sudo[114439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:43:53 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-b46eb53d-6e8d-4c9d-8f22-c99f78c4b4a7 tempest-CreateVolumesFromImageTest-210232301 None] Acquiring lock "cinder-2bf3324b-6ad0-4df3-ae96-88135f793679-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:43:53 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-b46eb53d-6e8d-4c9d-8f22-c99f78c4b4a7 tempest-CreateVolumesFromImageTest-210232301 None] Lock "cinder-2bf3324b-6ad0-4df3-ae96-88135f793679-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:43:53 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-b46eb53d-6e8d-4c9d-8f22-c99f78c4b4a7 tempest-CreateVolumesFromImageTest-210232301 None] Acquiring lock "cinder-quobyte-2bf3324b-6ad0-4df3-ae96-88135f793679" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:43:53 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-b46eb53d-6e8d-4c9d-8f22-c99f78c4b4a7 tempest-CreateVolumesFromImageTest-210232301 None] Lock "cinder-quobyte-2bf3324b-6ad0-4df3-ae96-88135f793679" acquired by "delete_volume" :: waited 0.015s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:43:53 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a15a069-e6fc-4088-bafb-e66d6790e3a9]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:43:53 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b46eb53d-6e8d-4c9d-8f22-c99f78c4b4a7 tempest-CreateVolumesFromImageTest-210232301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-2bf3324b-6ad0-4df3-ae96-88135f793679 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:43:53 devstack sudo[114441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-2bf3324b-6ad0-4df3-ae96-88135f793679 Jun 29 03:43:53 devstack sudo[114441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:43:54 devstack sudo[114439]: pam_unix(sudo:session): session closed for user root Jun 29 03:43:54 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-e2f4a2e3-93ca-4d20-8d6b-a048c31b629e tempest-CreateVolumesFromSnapshotTest-1093373581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9148723b-25c2-4581-884c-91a072699cbd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9148723b-25c2-4581-884c-91a072699cbd.5c33f15e-4654-4c11-b949-f3a282e07dc1 1G" returned: 0 in 0.831s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:43:54 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-e2f4a2e3-93ca-4d20-8d6b-a048c31b629e tempest-CreateVolumesFromSnapshotTest-1093373581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9148723b-25c2-4581-884c-91a072699cbd -F qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9148723b-25c2-4581-884c-91a072699cbd.5c33f15e-4654-4c11-b949-f3a282e07dc1 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:43:54 devstack sudo[114449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9148723b-25c2-4581-884c-91a072699cbd -F qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9148723b-25c2-4581-884c-91a072699cbd.5c33f15e-4654-4c11-b949-f3a282e07dc1 Jun 29 03:43:54 devstack sudo[114449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:43:54 devstack sudo[114441]: pam_unix(sudo:session): session closed for user root Jun 29 03:43:54 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b46eb53d-6e8d-4c9d-8f22-c99f78c4b4a7 tempest-CreateVolumesFromImageTest-210232301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-2bf3324b-6ad0-4df3-ae96-88135f793679" returned: 0 in 0.780s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:43:54 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b46eb53d-6e8d-4c9d-8f22-c99f78c4b4a7 tempest-CreateVolumesFromImageTest-210232301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-2bf3324b-6ad0-4df3-ae96-88135f793679 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:43:54 devstack sudo[114452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-2bf3324b-6ad0-4df3-ae96-88135f793679 Jun 29 03:43:54 devstack sudo[114452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:43:54 devstack sudo[114449]: pam_unix(sudo:session): session closed for user root Jun 29 03:43:54 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-e2f4a2e3-93ca-4d20-8d6b-a048c31b629e tempest-CreateVolumesFromSnapshotTest-1093373581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9148723b-25c2-4581-884c-91a072699cbd -F qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9148723b-25c2-4581-884c-91a072699cbd.5c33f15e-4654-4c11-b949-f3a282e07dc1" returned: 0 in 0.692s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:43:54 devstack cinder-volume[93468]: WARNING cinder.volume.drivers.remotefs [None req-e2f4a2e3-93ca-4d20-8d6b-a048c31b629e tempest-CreateVolumesFromSnapshotTest-1093373581 None] /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9148723b-25c2-4581-884c-91a072699cbd.5c33f15e-4654-4c11-b949-f3a282e07dc1 is being set with open permissions: ugo+rw Jun 29 03:43:54 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-e2f4a2e3-93ca-4d20-8d6b-a048c31b629e tempest-CreateVolumesFromSnapshotTest-1093373581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9148723b-25c2-4581-884c-91a072699cbd.5c33f15e-4654-4c11-b949-f3a282e07dc1 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:43:54 devstack sudo[114458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9148723b-25c2-4581-884c-91a072699cbd.5c33f15e-4654-4c11-b949-f3a282e07dc1 Jun 29 03:43:54 devstack sudo[114458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:43:54 devstack sudo[114452]: pam_unix(sudo:session): session closed for user root Jun 29 03:43:54 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b46eb53d-6e8d-4c9d-8f22-c99f78c4b4a7 tempest-CreateVolumesFromImageTest-210232301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-2bf3324b-6ad0-4df3-ae96-88135f793679" returned: 0 in 0.650s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:43:54 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-b46eb53d-6e8d-4c9d-8f22-c99f78c4b4a7 tempest-CreateVolumesFromImageTest-210232301 None] Lock "cinder-quobyte-2bf3324b-6ad0-4df3-ae96-88135f793679" released by "delete_volume" :: held 1.471s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:43:54 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-b46eb53d-6e8d-4c9d-8f22-c99f78c4b4a7 tempest-CreateVolumesFromImageTest-210232301 None] Created reservations ['76947db5-d45d-4c52-b240-d02456ccfa37', 'baeb06d3-3c53-41af-8176-a9524073b4fe', '210ec7fb-1066-41f4-a989-fd02985e5170', '350a827f-acb8-4adf-aded-395332d2db4d'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:43:54 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-b46eb53d-6e8d-4c9d-8f22-c99f78c4b4a7 tempest-CreateVolumesFromImageTest-210232301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:43:54 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-b46eb53d-6e8d-4c9d-8f22-c99f78c4b4a7 tempest-CreateVolumesFromImageTest-210232301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:43:54 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-b46eb53d-6e8d-4c9d-8f22-c99f78c4b4a7 tempest-CreateVolumesFromImageTest-210232301 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:43:54 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-b46eb53d-6e8d-4c9d-8f22-c99f78c4b4a7 tempest-CreateVolumesFromImageTest-210232301 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:43:54 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-b46eb53d-6e8d-4c9d-8f22-c99f78c4b4a7 tempest-CreateVolumesFromImageTest-210232301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:43:54 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b46eb53d-6e8d-4c9d-8f22-c99f78c4b4a7 tempest-CreateVolumesFromImageTest-210232301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:43:54 devstack sudo[114460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf Jun 29 03:43:54 devstack sudo[114460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:43:55 devstack sudo[114458]: pam_unix(sudo:session): session closed for user root Jun 29 03:43:55 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-e2f4a2e3-93ca-4d20-8d6b-a048c31b629e tempest-CreateVolumesFromSnapshotTest-1093373581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9148723b-25c2-4581-884c-91a072699cbd.5c33f15e-4654-4c11-b949-f3a282e07dc1" returned: 0 in 0.625s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:43:55 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-e2f4a2e3-93ca-4d20-8d6b-a048c31b629e tempest-CreateVolumesFromSnapshotTest-1093373581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9148723b-25c2-4581-884c-91a072699cbd.info {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:43:55 devstack sudo[114463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9148723b-25c2-4581-884c-91a072699cbd.info Jun 29 03:43:55 devstack sudo[114463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:43:55 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-de63d965-122e-4015-917a-7f3b90ed18ee tempest-CreateVolumesFromImageTest-210232301 None] Acquiring lock "cinder-6b0cbe04-a06e-4301-a382-1ba1aab29f33-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:43:55 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-de63d965-122e-4015-917a-7f3b90ed18ee tempest-CreateVolumesFromImageTest-210232301 None] Lock "cinder-6b0cbe04-a06e-4301-a382-1ba1aab29f33-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:43:55 devstack sudo[114460]: pam_unix(sudo:session): session closed for user root Jun 29 03:43:55 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b46eb53d-6e8d-4c9d-8f22-c99f78c4b4a7 tempest-CreateVolumesFromImageTest-210232301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf" returned: 0 in 0.632s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:43:55 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-b46eb53d-6e8d-4c9d-8f22-c99f78c4b4a7 tempest-CreateVolumesFromImageTest-210232301 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:43:55 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-b46eb53d-6e8d-4c9d-8f22-c99f78c4b4a7 tempest-CreateVolumesFromImageTest-210232301 None] Deleted volume successfully. Jun 29 03:43:55 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-de63d965-122e-4015-917a-7f3b90ed18ee tempest-CreateVolumesFromImageTest-210232301 None] Acquiring lock "cinder-quobyte-6b0cbe04-a06e-4301-a382-1ba1aab29f33" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:43:55 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-b46eb53d-6e8d-4c9d-8f22-c99f78c4b4a7 tempest-CreateVolumesFromImageTest-210232301 None] Lock "cinder-2bf3324b-6ad0-4df3-ae96-88135f793679-delete_volume" released by "delete_volume" :: held 2.322s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:43:55 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-de63d965-122e-4015-917a-7f3b90ed18ee tempest-CreateVolumesFromImageTest-210232301 None] Lock "cinder-quobyte-6b0cbe04-a06e-4301-a382-1ba1aab29f33" acquired by "delete_volume" :: waited 0.021s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:43:55 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c14ad2c-516b-42f0-9191-f9a26a875131]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:43:55 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-de63d965-122e-4015-917a-7f3b90ed18ee tempest-CreateVolumesFromImageTest-210232301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-6b0cbe04-a06e-4301-a382-1ba1aab29f33 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:43:55 devstack sudo[114466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-6b0cbe04-a06e-4301-a382-1ba1aab29f33 Jun 29 03:43:55 devstack sudo[114466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:43:56 devstack sudo[114463]: pam_unix(sudo:session): session closed for user root Jun 29 03:43:56 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-e2f4a2e3-93ca-4d20-8d6b-a048c31b629e tempest-CreateVolumesFromSnapshotTest-1093373581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9148723b-25c2-4581-884c-91a072699cbd.info" returned: 0 in 0.645s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:43:56 devstack cinder-volume[93468]: WARNING cinder.volume.drivers.remotefs [None req-e2f4a2e3-93ca-4d20-8d6b-a048c31b629e tempest-CreateVolumesFromSnapshotTest-1093373581 None] /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9148723b-25c2-4581-884c-91a072699cbd.info is being set with open permissions: ugo+rw Jun 29 03:43:56 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-e2f4a2e3-93ca-4d20-8d6b-a048c31b629e tempest-CreateVolumesFromSnapshotTest-1093373581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9148723b-25c2-4581-884c-91a072699cbd.info {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:43:56 devstack sudo[114469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9148723b-25c2-4581-884c-91a072699cbd.info Jun 29 03:43:56 devstack sudo[114469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:43:56 devstack sudo[114466]: pam_unix(sudo:session): session closed for user root Jun 29 03:43:56 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-de63d965-122e-4015-917a-7f3b90ed18ee tempest-CreateVolumesFromImageTest-210232301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-6b0cbe04-a06e-4301-a382-1ba1aab29f33" returned: 0 in 0.748s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:43:56 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-de63d965-122e-4015-917a-7f3b90ed18ee tempest-CreateVolumesFromImageTest-210232301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-6b0cbe04-a06e-4301-a382-1ba1aab29f33 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:43:56 devstack sudo[114474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-6b0cbe04-a06e-4301-a382-1ba1aab29f33 Jun 29 03:43:56 devstack sudo[114474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:43:56 devstack sudo[114469]: pam_unix(sudo:session): session closed for user root Jun 29 03:43:56 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-e2f4a2e3-93ca-4d20-8d6b-a048c31b629e tempest-CreateVolumesFromSnapshotTest-1093373581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9148723b-25c2-4581-884c-91a072699cbd.info" returned: 0 in 0.619s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:43:56 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-e2f4a2e3-93ca-4d20-8d6b-a048c31b629e tempest-CreateVolumesFromSnapshotTest-1093373581 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.280s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:43:56 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-571e83fe-f9c6-4f3b-a3ae-e6d63a14676f tempest-VolumeAndVolumeTypeFromImageTest-1239773066 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.271s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:43:56 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-571e83fe-f9c6-4f3b-a3ae-e6d63a14676f tempest-VolumeAndVolumeTypeFromImageTest-1239773066 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:43:45Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d6029b1-adf8-49f9-8496-6b6e46e22860,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7f4f5e848ac4ad0859368c43a3a366d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:43:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:43:45Z,use_quota=True,user_id='a06c2ff69d7b448282d5355a8b55099c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92d38901-0cc3-4c2a-a72c-48b68b7357ba),volume_type_id=92d38901-0cc3-4c2a-a72c-48b68b7357ba)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:43:56 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-571e83fe-f9c6-4f3b-a3ae-e6d63a14676f tempest-VolumeAndVolumeTypeFromImageTest-1239773066 None] Creating volume 0d6029b1-adf8-49f9-8496-6b6e46e22860 {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:43:56 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-571e83fe-f9c6-4f3b-a3ae-e6d63a14676f tempest-VolumeAndVolumeTypeFromImageTest-1239773066 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:43:56 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-571e83fe-f9c6-4f3b-a3ae-e6d63a14676f tempest-VolumeAndVolumeTypeFromImageTest-1239773066 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:43:56 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-571e83fe-f9c6-4f3b-a3ae-e6d63a14676f tempest-VolumeAndVolumeTypeFromImageTest-1239773066 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:43:56 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-571e83fe-f9c6-4f3b-a3ae-e6d63a14676f tempest-VolumeAndVolumeTypeFromImageTest-1239773066 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:43:56 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-571e83fe-f9c6-4f3b-a3ae-e6d63a14676f tempest-VolumeAndVolumeTypeFromImageTest-1239773066 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:43:56 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-571e83fe-f9c6-4f3b-a3ae-e6d63a14676f tempest-VolumeAndVolumeTypeFromImageTest-1239773066 None] Selected osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:43:56 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-571e83fe-f9c6-4f3b-a3ae-e6d63a14676f tempest-VolumeAndVolumeTypeFromImageTest-1239773066 None] casted to osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f Jun 29 03:43:56 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-571e83fe-f9c6-4f3b-a3ae-e6d63a14676f tempest-VolumeAndVolumeTypeFromImageTest-1239773066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-0d6029b1-adf8-49f9-8496-6b6e46e22860 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:43:56 devstack sudo[114477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-0d6029b1-adf8-49f9-8496-6b6e46e22860 1073741824 Jun 29 03:43:56 devstack sudo[114477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:43:56 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-e2f4a2e3-93ca-4d20-8d6b-a048c31b629e tempest-CreateVolumesFromSnapshotTest-1093373581 None] Create snapshot completed successfully Jun 29 03:43:57 devstack sudo[114474]: pam_unix(sudo:session): session closed for user root Jun 29 03:43:57 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-de63d965-122e-4015-917a-7f3b90ed18ee tempest-CreateVolumesFromImageTest-210232301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-6b0cbe04-a06e-4301-a382-1ba1aab29f33" returned: 0 in 0.654s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:43:57 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-de63d965-122e-4015-917a-7f3b90ed18ee tempest-CreateVolumesFromImageTest-210232301 None] Lock "cinder-quobyte-6b0cbe04-a06e-4301-a382-1ba1aab29f33" released by "delete_volume" :: held 1.448s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:43:57 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-de63d965-122e-4015-917a-7f3b90ed18ee tempest-CreateVolumesFromImageTest-210232301 None] Created reservations ['475bf311-72a0-4f57-97e9-12c9dd916ee0', '6b84eace-440e-46c9-9215-658396014f13', 'b5544cc6-0aee-4feb-a485-856abea19861', 'aa21dd9f-f289-4c75-883b-125b7ab466cb'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:43:57 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-de63d965-122e-4015-917a-7f3b90ed18ee tempest-CreateVolumesFromImageTest-210232301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:43:57 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-de63d965-122e-4015-917a-7f3b90ed18ee tempest-CreateVolumesFromImageTest-210232301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:43:57 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-de63d965-122e-4015-917a-7f3b90ed18ee tempest-CreateVolumesFromImageTest-210232301 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:43:57 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-de63d965-122e-4015-917a-7f3b90ed18ee tempest-CreateVolumesFromImageTest-210232301 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:43:57 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-de63d965-122e-4015-917a-7f3b90ed18ee tempest-CreateVolumesFromImageTest-210232301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:43:57 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-de63d965-122e-4015-917a-7f3b90ed18ee tempest-CreateVolumesFromImageTest-210232301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:43:57 devstack sudo[114480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf Jun 29 03:43:57 devstack sudo[114480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:43:57 devstack sudo[114477]: pam_unix(sudo:session): session closed for user root Jun 29 03:43:57 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-571e83fe-f9c6-4f3b-a3ae-e6d63a14676f tempest-VolumeAndVolumeTypeFromImageTest-1239773066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-0d6029b1-adf8-49f9-8496-6b6e46e22860 1073741824" returned: 0 in 0.798s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:43:57 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-571e83fe-f9c6-4f3b-a3ae-e6d63a14676f tempest-VolumeAndVolumeTypeFromImageTest-1239773066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-0d6029b1-adf8-49f9-8496-6b6e46e22860 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:43:57 devstack sudo[114485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-0d6029b1-adf8-49f9-8496-6b6e46e22860 Jun 29 03:43:57 devstack sudo[114485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:43:57 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-3c649e68-769f-4a3c-9a22-e1496673105b tempest-CreateVolumesFromImageTest-210232301 None] Acquiring lock "cinder-f2bd84b5-5052-4ee0-8dae-1979f0fabf16-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:43:57 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-3c649e68-769f-4a3c-9a22-e1496673105b tempest-CreateVolumesFromImageTest-210232301 None] Lock "cinder-f2bd84b5-5052-4ee0-8dae-1979f0fabf16-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:43:57 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-3c649e68-769f-4a3c-9a22-e1496673105b tempest-CreateVolumesFromImageTest-210232301 None] Acquiring lock "cinder-quobyte-f2bd84b5-5052-4ee0-8dae-1979f0fabf16" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:43:57 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-3c649e68-769f-4a3c-9a22-e1496673105b tempest-CreateVolumesFromImageTest-210232301 None] Lock "cinder-quobyte-f2bd84b5-5052-4ee0-8dae-1979f0fabf16" acquired by "delete_volume" :: waited 0.023s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:43:57 devstack sudo[114480]: pam_unix(sudo:session): session closed for user root Jun 29 03:43:57 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-de63d965-122e-4015-917a-7f3b90ed18ee tempest-CreateVolumesFromImageTest-210232301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf" returned: 0 in 0.736s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:43:57 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-de63d965-122e-4015-917a-7f3b90ed18ee tempest-CreateVolumesFromImageTest-210232301 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:43:57 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-de63d965-122e-4015-917a-7f3b90ed18ee tempest-CreateVolumesFromImageTest-210232301 None] Deleted volume successfully. Jun 29 03:43:57 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[9322459e-896d-4e97-b9b7-a64c24e2ee51]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:43:57 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-3c649e68-769f-4a3c-9a22-e1496673105b tempest-CreateVolumesFromImageTest-210232301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-f2bd84b5-5052-4ee0-8dae-1979f0fabf16 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:43:58 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-de63d965-122e-4015-917a-7f3b90ed18ee tempest-CreateVolumesFromImageTest-210232301 None] Lock "cinder-6b0cbe04-a06e-4301-a382-1ba1aab29f33-delete_volume" released by "delete_volume" :: held 2.430s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:43:58 devstack sudo[114488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-f2bd84b5-5052-4ee0-8dae-1979f0fabf16 Jun 29 03:43:58 devstack sudo[114488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:43:58 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d52c676-d311-4f9b-b573-a894614e0e78 tempest-CreateVolumesFromSnapshotTest-1093373581 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:43:58 devstack sudo[114485]: pam_unix(sudo:session): session closed for user root Jun 29 03:43:58 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-5d52c676-d311-4f9b-b573-a894614e0e78 tempest-CreateVolumesFromSnapshotTest-1093373581 None] Flow 'volume_create_manager' (13e0af09-b74a-4214-ad10-41c74f024d3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:43:58 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-5d52c676-d311-4f9b-b573-a894614e0e78 tempest-CreateVolumesFromSnapshotTest-1093373581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb2e7609-0696-4336-a764-16e1bd436513) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:43:58 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-571e83fe-f9c6-4f3b-a3ae-e6d63a14676f tempest-VolumeAndVolumeTypeFromImageTest-1239773066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-0d6029b1-adf8-49f9-8496-6b6e46e22860" returned: 0 in 0.795s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:43:58 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-571e83fe-f9c6-4f3b-a3ae-e6d63a14676f tempest-VolumeAndVolumeTypeFromImageTest-1239773066 None] <== create_volume: return (1645ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:43:58 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-571e83fe-f9c6-4f3b-a3ae-e6d63a14676f tempest-VolumeAndVolumeTypeFromImageTest-1239773066 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.649s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:43:58 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-d1dfce0a-e901-484f-bca3-6b13c712f0fb tempest-VolumeDependencyTests-1245577734 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.418s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:43:58 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-5d52c676-d311-4f9b-b573-a894614e0e78 tempest-CreateVolumesFromSnapshotTest-1093373581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb2e7609-0696-4336-a764-16e1bd436513) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:43:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-862985773',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78d66f48-6e6e-4baf-ba19-2d449c369bcc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64bb520d993e427c9c4490b050e40a72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:43:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:43:58Z,use_quota=True,user_id='998a078d10ae4063a2f3b87f6f1d255d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:43:58 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-5d52c676-d311-4f9b-b573-a894614e0e78 tempest-CreateVolumesFromSnapshotTest-1093373581 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (024e18bb-6736-4a32-806d-435c383fa730) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:43:58 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-5d52c676-d311-4f9b-b573-a894614e0e78 tempest-CreateVolumesFromSnapshotTest-1093373581 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (024e18bb-6736-4a32-806d-435c383fa730) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:43:58 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-5d52c676-d311-4f9b-b573-a894614e0e78 tempest-CreateVolumesFromSnapshotTest-1093373581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f963af9-a806-436f-9372-e97d82dd010f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:43:58 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-5d52c676-d311-4f9b-b573-a894614e0e78 tempest-CreateVolumesFromSnapshotTest-1093373581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f963af9-a806-436f-9372-e97d82dd010f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '78d66f48-6e6e-4baf-ba19-2d449c369bcc', 'volume_name': 'volume-78d66f48-6e6e-4baf-ba19-2d449c369bcc', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:43:58 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-5d52c676-d311-4f9b-b573-a894614e0e78 tempest-CreateVolumesFromSnapshotTest-1093373581 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66288659-798c-482e-b33c-cdc608e40a8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:43:58 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-5d52c676-d311-4f9b-b573-a894614e0e78 tempest-CreateVolumesFromSnapshotTest-1093373581 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66288659-798c-482e-b33c-cdc608e40a8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:43:58 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-5d52c676-d311-4f9b-b573-a894614e0e78 tempest-CreateVolumesFromSnapshotTest-1093373581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a52cd827-bf71-4095-ab03-ade9950d57c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:43:58 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-5d52c676-d311-4f9b-b573-a894614e0e78 tempest-CreateVolumesFromSnapshotTest-1093373581 None] Volume 78d66f48-6e6e-4baf-ba19-2d449c369bcc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-78d66f48-6e6e-4baf-ba19-2d449c369bcc', 'volume_size': 1} Jun 29 03:43:58 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-5d52c676-d311-4f9b-b573-a894614e0e78 tempest-CreateVolumesFromSnapshotTest-1093373581 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:43:58 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-d1dfce0a-e901-484f-bca3-6b13c712f0fb tempest-VolumeDependencyTests-1245577734 None] Creating offline snapshot 29cc1948-65a7-40e9-940e-6ec7933c4757 of volume 1aad3d1f-6a61-4b52-a9a0-ddf7ca5fbe87 {{(pid=93468) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 29 03:43:58 devstack cinder-volume[93468]: DEBUG cinder.volume.volume_utils [None req-571e83fe-f9c6-4f3b-a3ae-e6d63a14676f tempest-VolumeAndVolumeTypeFromImageTest-1239773066 None] Attempting download of 5f3d629d-98ff-4a80-a67c-8e04b9cae3a6 ((None, [{'url': 'file:///opt/stack/data/glance/images/5f3d629d-98ff-4a80-a67c-8e04b9cae3a6', 'metadata': {}}])) to volume 0d6029b1-adf8-49f9-8496-6b6e46e22860. {{(pid=93468) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 29 03:43:58 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7cae2f9-3f12-48dd-816f-58832c230b53]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:43:58 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d1dfce0a-e901-484f-bca3-6b13c712f0fb tempest-VolumeDependencyTests-1245577734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-1aad3d1f-6a61-4b52-a9a0-ddf7ca5fbe87 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:43:58 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[9191c225-9b12-4938-8a9a-6d620c320075]: (4, 'raw') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:43:58 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-571e83fe-f9c6-4f3b-a3ae-e6d63a14676f tempest-VolumeAndVolumeTypeFromImageTest-1239773066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5f3d629d-98ff-4a80-a67c-8e04b9cae3a6_74k2xajj {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:43:58 devstack sudo[114491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-1aad3d1f-6a61-4b52-a9a0-ddf7ca5fbe87 Jun 29 03:43:58 devstack sudo[114491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:43:58 devstack sudo[114492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5f3d629d-98ff-4a80-a67c-8e04b9cae3a6_74k2xajj Jun 29 03:43:58 devstack sudo[114492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:43:58 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-6326cc53-68f1-4110-a2ac-1a2838bd6a25 tempest-CreateVolumesFromSnapshotTest-1093373581 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:43:58 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-6326cc53-68f1-4110-a2ac-1a2838bd6a25 tempest-CreateVolumesFromSnapshotTest-1093373581 None] Flow 'volume_create_manager' (73044fba-bf77-4fbc-a03d-9f0e9e45837e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:43:58 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-6326cc53-68f1-4110-a2ac-1a2838bd6a25 tempest-CreateVolumesFromSnapshotTest-1093373581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84c85e06-25f5-40b7-8d2c-b03fc31422c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:43:58 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-6326cc53-68f1-4110-a2ac-1a2838bd6a25 tempest-CreateVolumesFromSnapshotTest-1093373581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84c85e06-25f5-40b7-8d2c-b03fc31422c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:43:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1136844475',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d719f89f-317b-493f-8498-9984506f0903,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64bb520d993e427c9c4490b050e40a72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:43:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:43:59Z,use_quota=True,user_id='998a078d10ae4063a2f3b87f6f1d255d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:43:59 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-6326cc53-68f1-4110-a2ac-1a2838bd6a25 tempest-CreateVolumesFromSnapshotTest-1093373581 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9854987a-caea-4433-a322-6dd37695ab41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:43:59 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-6326cc53-68f1-4110-a2ac-1a2838bd6a25 tempest-CreateVolumesFromSnapshotTest-1093373581 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9854987a-caea-4433-a322-6dd37695ab41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:43:59 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-6326cc53-68f1-4110-a2ac-1a2838bd6a25 tempest-CreateVolumesFromSnapshotTest-1093373581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5bae18b-e4c3-4e82-a781-dd97df25cda8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:43:59 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-6326cc53-68f1-4110-a2ac-1a2838bd6a25 tempest-CreateVolumesFromSnapshotTest-1093373581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5bae18b-e4c3-4e82-a781-dd97df25cda8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd719f89f-317b-493f-8498-9984506f0903', 'volume_name': 'volume-d719f89f-317b-493f-8498-9984506f0903', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:43:59 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-6326cc53-68f1-4110-a2ac-1a2838bd6a25 tempest-CreateVolumesFromSnapshotTest-1093373581 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29690844-b039-42a8-b83d-37bb83dfb9f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:43:59 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-6326cc53-68f1-4110-a2ac-1a2838bd6a25 tempest-CreateVolumesFromSnapshotTest-1093373581 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29690844-b039-42a8-b83d-37bb83dfb9f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:43:59 devstack sudo[114488]: pam_unix(sudo:session): session closed for user root Jun 29 03:43:59 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-6326cc53-68f1-4110-a2ac-1a2838bd6a25 tempest-CreateVolumesFromSnapshotTest-1093373581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55341a09-26ca-4144-93ff-e4372e1d72fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:43:59 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-6326cc53-68f1-4110-a2ac-1a2838bd6a25 tempest-CreateVolumesFromSnapshotTest-1093373581 None] Volume d719f89f-317b-493f-8498-9984506f0903: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d719f89f-317b-493f-8498-9984506f0903', 'volume_size': 1} Jun 29 03:43:59 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-6326cc53-68f1-4110-a2ac-1a2838bd6a25 tempest-CreateVolumesFromSnapshotTest-1093373581 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:43:59 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-3c649e68-769f-4a3c-9a22-e1496673105b tempest-CreateVolumesFromImageTest-210232301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-f2bd84b5-5052-4ee0-8dae-1979f0fabf16" returned: 0 in 1.085s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:43:59 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-3c649e68-769f-4a3c-9a22-e1496673105b tempest-CreateVolumesFromImageTest-210232301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-f2bd84b5-5052-4ee0-8dae-1979f0fabf16 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:43:59 devstack sudo[114498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-f2bd84b5-5052-4ee0-8dae-1979f0fabf16 Jun 29 03:43:59 devstack sudo[114498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:43:59 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-731678fd-da1c-4a76-a820-e63a0ffda495 tempest-CreateVolumesFromSnapshotTest-1093373581 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:43:59 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-731678fd-da1c-4a76-a820-e63a0ffda495 tempest-CreateVolumesFromSnapshotTest-1093373581 None] Flow 'volume_create_manager' (1cca91ed-4695-4243-9bd0-be47970c1277) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:43:59 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-731678fd-da1c-4a76-a820-e63a0ffda495 tempest-CreateVolumesFromSnapshotTest-1093373581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55e026e6-10ab-4206-9788-a62cf63ba405) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:43:59 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-731678fd-da1c-4a76-a820-e63a0ffda495 tempest-CreateVolumesFromSnapshotTest-1093373581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55e026e6-10ab-4206-9788-a62cf63ba405) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:43:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1661559410',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49966b9a-3398-4ae6-8747-519f7e8d490f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64bb520d993e427c9c4490b050e40a72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:43:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:43:59Z,use_quota=True,user_id='998a078d10ae4063a2f3b87f6f1d255d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:43:59 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-731678fd-da1c-4a76-a820-e63a0ffda495 tempest-CreateVolumesFromSnapshotTest-1093373581 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9af06eb-6587-4c64-a5c2-ab0306070887) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:43:59 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-731678fd-da1c-4a76-a820-e63a0ffda495 tempest-CreateVolumesFromSnapshotTest-1093373581 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9af06eb-6587-4c64-a5c2-ab0306070887) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:43:59 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-731678fd-da1c-4a76-a820-e63a0ffda495 tempest-CreateVolumesFromSnapshotTest-1093373581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed51d017-7b9f-469b-9b18-716190b12c46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:43:59 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-731678fd-da1c-4a76-a820-e63a0ffda495 tempest-CreateVolumesFromSnapshotTest-1093373581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed51d017-7b9f-469b-9b18-716190b12c46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '49966b9a-3398-4ae6-8747-519f7e8d490f', 'volume_name': 'volume-49966b9a-3398-4ae6-8747-519f7e8d490f', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:43:59 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-731678fd-da1c-4a76-a820-e63a0ffda495 tempest-CreateVolumesFromSnapshotTest-1093373581 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eee26253-388d-4eec-8400-71ba08bab58a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:43:59 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-731678fd-da1c-4a76-a820-e63a0ffda495 tempest-CreateVolumesFromSnapshotTest-1093373581 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eee26253-388d-4eec-8400-71ba08bab58a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:43:59 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-731678fd-da1c-4a76-a820-e63a0ffda495 tempest-CreateVolumesFromSnapshotTest-1093373581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64b24954-8dd5-4072-9c39-60071bc037ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:43:59 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-731678fd-da1c-4a76-a820-e63a0ffda495 tempest-CreateVolumesFromSnapshotTest-1093373581 None] Volume 49966b9a-3398-4ae6-8747-519f7e8d490f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-49966b9a-3398-4ae6-8747-519f7e8d490f', 'volume_size': 1} Jun 29 03:43:59 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-731678fd-da1c-4a76-a820-e63a0ffda495 tempest-CreateVolumesFromSnapshotTest-1093373581 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:43:59 devstack sudo[114492]: pam_unix(sudo:session): session closed for user root Jun 29 03:43:59 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-571e83fe-f9c6-4f3b-a3ae-e6d63a14676f tempest-VolumeAndVolumeTypeFromImageTest-1239773066 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5f3d629d-98ff-4a80-a67c-8e04b9cae3a6_74k2xajj" returned: 0 in 1.057s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:43:59 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-571e83fe-f9c6-4f3b-a3ae-e6d63a14676f tempest-VolumeAndVolumeTypeFromImageTest-1239773066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5f3d629d-98ff-4a80-a67c-8e04b9cae3a6_74k2xajj {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:43:59 devstack sudo[114504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5f3d629d-98ff-4a80-a67c-8e04b9cae3a6_74k2xajj Jun 29 03:43:59 devstack sudo[114504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:43:59 devstack sudo[114491]: pam_unix(sudo:session): session closed for user root Jun 29 03:43:59 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d1dfce0a-e901-484f-bca3-6b13c712f0fb tempest-VolumeDependencyTests-1245577734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-1aad3d1f-6a61-4b52-a9a0-ddf7ca5fbe87" returned: 0 in 1.371s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:43:59 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d1dfce0a-e901-484f-bca3-6b13c712f0fb tempest-VolumeDependencyTests-1245577734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-1aad3d1f-6a61-4b52-a9a0-ddf7ca5fbe87,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-1aad3d1f-6a61-4b52-a9a0-ddf7ca5fbe87.29cc1948-65a7-40e9-940e-6ec7933c4757 1G {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:43:59 devstack sudo[114508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-1aad3d1f-6a61-4b52-a9a0-ddf7ca5fbe87,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-1aad3d1f-6a61-4b52-a9a0-ddf7ca5fbe87.29cc1948-65a7-40e9-940e-6ec7933c4757 1G Jun 29 03:43:59 devstack sudo[114508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:43:59 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc47568d-fff0-4521-a35c-d726866a79dc tempest-CreateVolumesFromSnapshotTest-1093373581 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:43:59 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-dc47568d-fff0-4521-a35c-d726866a79dc tempest-CreateVolumesFromSnapshotTest-1093373581 None] Flow 'volume_create_manager' (0edfbe9f-c86b-4710-bf4c-a90bded49c66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:43:59 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-dc47568d-fff0-4521-a35c-d726866a79dc tempest-CreateVolumesFromSnapshotTest-1093373581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b32e4720-59ba-41df-aa51-a97a4f7dedf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:44:00 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-dc47568d-fff0-4521-a35c-d726866a79dc tempest-CreateVolumesFromSnapshotTest-1093373581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b32e4720-59ba-41df-aa51-a97a4f7dedf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:43:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1896695185',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99030091-ab42-4966-8f17-f06c73417ab3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64bb520d993e427c9c4490b050e40a72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:44:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:44:00Z,use_quota=True,user_id='998a078d10ae4063a2f3b87f6f1d255d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:44:00 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-dc47568d-fff0-4521-a35c-d726866a79dc tempest-CreateVolumesFromSnapshotTest-1093373581 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7de4dff-16ba-48bd-8b9c-9af7e0981ddc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:44:00 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-dc47568d-fff0-4521-a35c-d726866a79dc tempest-CreateVolumesFromSnapshotTest-1093373581 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7de4dff-16ba-48bd-8b9c-9af7e0981ddc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:44:00 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-dc47568d-fff0-4521-a35c-d726866a79dc tempest-CreateVolumesFromSnapshotTest-1093373581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb098d76-3935-4db9-84e8-1f0f8a13dfec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:44:00 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-dc47568d-fff0-4521-a35c-d726866a79dc tempest-CreateVolumesFromSnapshotTest-1093373581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb098d76-3935-4db9-84e8-1f0f8a13dfec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '99030091-ab42-4966-8f17-f06c73417ab3', 'volume_name': 'volume-99030091-ab42-4966-8f17-f06c73417ab3', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:44:00 devstack sudo[114498]: pam_unix(sudo:session): session closed for user root Jun 29 03:44:00 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-dc47568d-fff0-4521-a35c-d726866a79dc tempest-CreateVolumesFromSnapshotTest-1093373581 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a89cd05-93ff-4c8d-b8bd-b59e4ee7a1c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:44:00 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-dc47568d-fff0-4521-a35c-d726866a79dc tempest-CreateVolumesFromSnapshotTest-1093373581 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a89cd05-93ff-4c8d-b8bd-b59e4ee7a1c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:44:00 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-dc47568d-fff0-4521-a35c-d726866a79dc tempest-CreateVolumesFromSnapshotTest-1093373581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fc8f77d-956e-4aba-a59d-ba8885e80e24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:44:00 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-dc47568d-fff0-4521-a35c-d726866a79dc tempest-CreateVolumesFromSnapshotTest-1093373581 None] Volume 99030091-ab42-4966-8f17-f06c73417ab3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-99030091-ab42-4966-8f17-f06c73417ab3', 'volume_size': 1} Jun 29 03:44:00 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-dc47568d-fff0-4521-a35c-d726866a79dc tempest-CreateVolumesFromSnapshotTest-1093373581 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:44:00 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-3c649e68-769f-4a3c-9a22-e1496673105b tempest-CreateVolumesFromImageTest-210232301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-f2bd84b5-5052-4ee0-8dae-1979f0fabf16" returned: 0 in 1.009s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:44:00 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-3c649e68-769f-4a3c-9a22-e1496673105b tempest-CreateVolumesFromImageTest-210232301 None] Lock "cinder-quobyte-f2bd84b5-5052-4ee0-8dae-1979f0fabf16" released by "delete_volume" :: held 2.169s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:44:00 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-3c649e68-769f-4a3c-9a22-e1496673105b tempest-CreateVolumesFromImageTest-210232301 None] Created reservations ['5d718937-a82c-452f-8cf8-737e2db940ab', '57ef468a-0ae4-49f9-8d49-b620a19a1681', 'ab5df983-da50-4842-9909-2884b56e5fb9', 'e829a1e7-8629-4b3d-8f9e-631c566d2de5'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:44:00 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-3c649e68-769f-4a3c-9a22-e1496673105b tempest-CreateVolumesFromImageTest-210232301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:44:00 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-3c649e68-769f-4a3c-9a22-e1496673105b tempest-CreateVolumesFromImageTest-210232301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:44:00 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-3c649e68-769f-4a3c-9a22-e1496673105b tempest-CreateVolumesFromImageTest-210232301 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:44:00 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-3c649e68-769f-4a3c-9a22-e1496673105b tempest-CreateVolumesFromImageTest-210232301 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:44:00 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-3c649e68-769f-4a3c-9a22-e1496673105b tempest-CreateVolumesFromImageTest-210232301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:44:00 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-3c649e68-769f-4a3c-9a22-e1496673105b tempest-CreateVolumesFromImageTest-210232301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:44:00 devstack sudo[114511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf Jun 29 03:44:00 devstack sudo[114511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:44:00 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-0bcfee45-7f91-40a5-8407-83343afc5fe5 tempest-CreateVolumesFromSnapshotTest-1093373581 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:44:00 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-0bcfee45-7f91-40a5-8407-83343afc5fe5 tempest-CreateVolumesFromSnapshotTest-1093373581 None] Flow 'volume_create_manager' (c18b0c99-35e6-4c90-8dd3-9dc4345ef25a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:44:00 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-0bcfee45-7f91-40a5-8407-83343afc5fe5 tempest-CreateVolumesFromSnapshotTest-1093373581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (722cf1a1-474f-429c-bf3a-4eb7ad1790e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:44:00 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-0bcfee45-7f91-40a5-8407-83343afc5fe5 tempest-CreateVolumesFromSnapshotTest-1093373581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (722cf1a1-474f-429c-bf3a-4eb7ad1790e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:44:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1724616446',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=437a9fc9-c23f-43b3-9ec7-addc166874eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64bb520d993e427c9c4490b050e40a72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:44:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:44:00Z,use_quota=True,user_id='998a078d10ae4063a2f3b87f6f1d255d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:44:00 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-0bcfee45-7f91-40a5-8407-83343afc5fe5 tempest-CreateVolumesFromSnapshotTest-1093373581 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3e357d3-b0cb-4eb4-9c71-b37044d47750) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:44:00 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-0bcfee45-7f91-40a5-8407-83343afc5fe5 tempest-CreateVolumesFromSnapshotTest-1093373581 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3e357d3-b0cb-4eb4-9c71-b37044d47750) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:44:00 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-0bcfee45-7f91-40a5-8407-83343afc5fe5 tempest-CreateVolumesFromSnapshotTest-1093373581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c84fa41-e754-419e-a1d5-62d73b8f1236) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:44:00 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-0bcfee45-7f91-40a5-8407-83343afc5fe5 tempest-CreateVolumesFromSnapshotTest-1093373581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c84fa41-e754-419e-a1d5-62d73b8f1236) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '437a9fc9-c23f-43b3-9ec7-addc166874eb', 'volume_name': 'volume-437a9fc9-c23f-43b3-9ec7-addc166874eb', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:44:00 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-0bcfee45-7f91-40a5-8407-83343afc5fe5 tempest-CreateVolumesFromSnapshotTest-1093373581 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e77ed81a-4e7b-459d-864b-9c31cf08c4d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:44:00 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-0bcfee45-7f91-40a5-8407-83343afc5fe5 tempest-CreateVolumesFromSnapshotTest-1093373581 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e77ed81a-4e7b-459d-864b-9c31cf08c4d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:44:00 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-0bcfee45-7f91-40a5-8407-83343afc5fe5 tempest-CreateVolumesFromSnapshotTest-1093373581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f497fe16-bbe6-4aad-a44e-efdd6a9c8735) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:44:00 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-0bcfee45-7f91-40a5-8407-83343afc5fe5 tempest-CreateVolumesFromSnapshotTest-1093373581 None] Volume 437a9fc9-c23f-43b3-9ec7-addc166874eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-437a9fc9-c23f-43b3-9ec7-addc166874eb', 'volume_size': 1} Jun 29 03:44:00 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-0bcfee45-7f91-40a5-8407-83343afc5fe5 tempest-CreateVolumesFromSnapshotTest-1093373581 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:44:00 devstack sudo[114504]: pam_unix(sudo:session): session closed for user root Jun 29 03:44:00 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-571e83fe-f9c6-4f3b-a3ae-e6d63a14676f tempest-VolumeAndVolumeTypeFromImageTest-1239773066 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5f3d629d-98ff-4a80-a67c-8e04b9cae3a6_74k2xajj" returned: 1 in 0.939s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:44:00 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-571e83fe-f9c6-4f3b-a3ae-e6d63a14676f tempest-VolumeAndVolumeTypeFromImageTest-1239773066 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5f3d629d-98ff-4a80-a67c-8e04b9cae3a6_74k2xajj' failed. Not Retrying. {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 29 03:44:00 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[87b9cef7-a45a-4024-8c76-ef9922a83cb5]: (4, 'raw') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:44:00 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-571e83fe-f9c6-4f3b-a3ae-e6d63a14676f tempest-VolumeAndVolumeTypeFromImageTest-1239773066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5f3d629d-98ff-4a80-a67c-8e04b9cae3a6_6hpb96_0devstack@QuobyteHD {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:44:00 devstack sudo[114515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5f3d629d-98ff-4a80-a67c-8e04b9cae3a6_6hpb96_0devstack@QuobyteHD Jun 29 03:44:00 devstack sudo[114515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:44:00 devstack sudo[114508]: pam_unix(sudo:session): session closed for user root Jun 29 03:44:00 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d1dfce0a-e901-484f-bca3-6b13c712f0fb tempest-VolumeDependencyTests-1245577734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-1aad3d1f-6a61-4b52-a9a0-ddf7ca5fbe87,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-1aad3d1f-6a61-4b52-a9a0-ddf7ca5fbe87.29cc1948-65a7-40e9-940e-6ec7933c4757 1G" returned: 0 in 1.058s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:44:00 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d1dfce0a-e901-484f-bca3-6b13c712f0fb tempest-VolumeDependencyTests-1245577734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1aad3d1f-6a61-4b52-a9a0-ddf7ca5fbe87 -F qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-1aad3d1f-6a61-4b52-a9a0-ddf7ca5fbe87.29cc1948-65a7-40e9-940e-6ec7933c4757 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:44:00 devstack sudo[114521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1aad3d1f-6a61-4b52-a9a0-ddf7ca5fbe87 -F qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-1aad3d1f-6a61-4b52-a9a0-ddf7ca5fbe87.29cc1948-65a7-40e9-940e-6ec7933c4757 Jun 29 03:44:00 devstack sudo[114521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:44:01 devstack sudo[114511]: pam_unix(sudo:session): session closed for user root Jun 29 03:44:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-3c649e68-769f-4a3c-9a22-e1496673105b tempest-CreateVolumesFromImageTest-210232301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf" returned: 0 in 0.716s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:44:01 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-3c649e68-769f-4a3c-9a22-e1496673105b tempest-CreateVolumesFromImageTest-210232301 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:44:01 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-3c649e68-769f-4a3c-9a22-e1496673105b tempest-CreateVolumesFromImageTest-210232301 None] Deleted volume successfully. Jun 29 03:44:01 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-3c649e68-769f-4a3c-9a22-e1496673105b tempest-CreateVolumesFromImageTest-210232301 None] Lock "cinder-f2bd84b5-5052-4ee0-8dae-1979f0fabf16-delete_volume" released by "delete_volume" :: held 3.233s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:44:01 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-69fc4e4e-1a75-4adb-a49c-3dfacfebe06f tempest-CreateVolumesFromImageTest-210232301 None] Acquiring lock "cinder-4f10d343-140c-4c83-97b8-1f5dc5253f5b-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:44:01 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-69fc4e4e-1a75-4adb-a49c-3dfacfebe06f tempest-CreateVolumesFromImageTest-210232301 None] Lock "cinder-4f10d343-140c-4c83-97b8-1f5dc5253f5b-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:44:01 devstack sudo[114515]: pam_unix(sudo:session): session closed for user root Jun 29 03:44:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-571e83fe-f9c6-4f3b-a3ae-e6d63a14676f tempest-VolumeAndVolumeTypeFromImageTest-1239773066 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5f3d629d-98ff-4a80-a67c-8e04b9cae3a6_6hpb96_0devstack@QuobyteHD" returned: 0 in 0.779s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:44:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-571e83fe-f9c6-4f3b-a3ae-e6d63a14676f tempest-VolumeAndVolumeTypeFromImageTest-1239773066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5f3d629d-98ff-4a80-a67c-8e04b9cae3a6_6hpb96_0devstack@QuobyteHD {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:44:01 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-69fc4e4e-1a75-4adb-a49c-3dfacfebe06f tempest-CreateVolumesFromImageTest-210232301 None] Acquiring lock "cinder-quobyte-4f10d343-140c-4c83-97b8-1f5dc5253f5b" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:44:01 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-69fc4e4e-1a75-4adb-a49c-3dfacfebe06f tempest-CreateVolumesFromImageTest-210232301 None] Lock "cinder-quobyte-4f10d343-140c-4c83-97b8-1f5dc5253f5b" acquired by "delete_volume" :: waited 0.023s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:44:01 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[38e0d44c-8b1f-484f-9592-306cc2c414c1]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:44:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-69fc4e4e-1a75-4adb-a49c-3dfacfebe06f tempest-CreateVolumesFromImageTest-210232301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-4f10d343-140c-4c83-97b8-1f5dc5253f5b {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:44:01 devstack sudo[114526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5f3d629d-98ff-4a80-a67c-8e04b9cae3a6_6hpb96_0devstack@QuobyteHD Jun 29 03:44:01 devstack sudo[114526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:44:01 devstack sudo[114527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-4f10d343-140c-4c83-97b8-1f5dc5253f5b Jun 29 03:44:01 devstack sudo[114527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:44:01 devstack sudo[114521]: pam_unix(sudo:session): session closed for user root Jun 29 03:44:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d1dfce0a-e901-484f-bca3-6b13c712f0fb tempest-VolumeDependencyTests-1245577734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1aad3d1f-6a61-4b52-a9a0-ddf7ca5fbe87 -F qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-1aad3d1f-6a61-4b52-a9a0-ddf7ca5fbe87.29cc1948-65a7-40e9-940e-6ec7933c4757" returned: 0 in 0.749s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:44:01 devstack cinder-volume[93468]: WARNING cinder.volume.drivers.remotefs [None req-d1dfce0a-e901-484f-bca3-6b13c712f0fb tempest-VolumeDependencyTests-1245577734 None] /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-1aad3d1f-6a61-4b52-a9a0-ddf7ca5fbe87.29cc1948-65a7-40e9-940e-6ec7933c4757 is being set with open permissions: ugo+rw Jun 29 03:44:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d1dfce0a-e901-484f-bca3-6b13c712f0fb tempest-VolumeDependencyTests-1245577734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-1aad3d1f-6a61-4b52-a9a0-ddf7ca5fbe87.29cc1948-65a7-40e9-940e-6ec7933c4757 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:44:01 devstack sudo[114533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-1aad3d1f-6a61-4b52-a9a0-ddf7ca5fbe87.29cc1948-65a7-40e9-940e-6ec7933c4757 Jun 29 03:44:01 devstack sudo[114533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:44:02 devstack sudo[114526]: pam_unix(sudo:session): session closed for user root Jun 29 03:44:02 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-571e83fe-f9c6-4f3b-a3ae-e6d63a14676f tempest-VolumeAndVolumeTypeFromImageTest-1239773066 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5f3d629d-98ff-4a80-a67c-8e04b9cae3a6_6hpb96_0devstack@QuobyteHD" returned: 1 in 0.796s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:44:02 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-571e83fe-f9c6-4f3b-a3ae-e6d63a14676f tempest-VolumeAndVolumeTypeFromImageTest-1239773066 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5f3d629d-98ff-4a80-a67c-8e04b9cae3a6_6hpb96_0devstack@QuobyteHD' failed. Not Retrying. {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 29 03:44:02 devstack cinder-volume[93468]: DEBUG cinder.image.image_utils [None req-571e83fe-f9c6-4f3b-a3ae-e6d63a14676f tempest-VolumeAndVolumeTypeFromImageTest-1239773066 None] 5f3d629d-98ff-4a80-a67c-8e04b9cae3a6 was raw, converting to raw {{(pid=93468) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 29 03:44:02 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-571e83fe-f9c6-4f3b-a3ae-e6d63a14676f tempest-VolumeAndVolumeTypeFromImageTest-1239773066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_5f3d629d-98ff-4a80-a67c-8e04b9cae3a6_6hpb96_0devstack@QuobyteHD /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-0d6029b1-adf8-49f9-8496-6b6e46e22860 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:44:02 devstack sudo[114527]: pam_unix(sudo:session): session closed for user root Jun 29 03:44:02 devstack sudo[114542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_5f3d629d-98ff-4a80-a67c-8e04b9cae3a6_6hpb96_0devstack@QuobyteHD /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-0d6029b1-adf8-49f9-8496-6b6e46e22860 Jun 29 03:44:02 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-69fc4e4e-1a75-4adb-a49c-3dfacfebe06f tempest-CreateVolumesFromImageTest-210232301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-4f10d343-140c-4c83-97b8-1f5dc5253f5b" returned: 0 in 0.758s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:44:02 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-69fc4e4e-1a75-4adb-a49c-3dfacfebe06f tempest-CreateVolumesFromImageTest-210232301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-4f10d343-140c-4c83-97b8-1f5dc5253f5b {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:44:02 devstack sudo[114542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:44:02 devstack sudo[114544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-4f10d343-140c-4c83-97b8-1f5dc5253f5b Jun 29 03:44:02 devstack sudo[114544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:44:02 devstack sudo[114533]: pam_unix(sudo:session): session closed for user root Jun 29 03:44:02 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d1dfce0a-e901-484f-bca3-6b13c712f0fb tempest-VolumeDependencyTests-1245577734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-1aad3d1f-6a61-4b52-a9a0-ddf7ca5fbe87.29cc1948-65a7-40e9-940e-6ec7933c4757" returned: 0 in 0.678s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:44:02 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d1dfce0a-e901-484f-bca3-6b13c712f0fb tempest-VolumeDependencyTests-1245577734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-1aad3d1f-6a61-4b52-a9a0-ddf7ca5fbe87.info {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:44:02 devstack sudo[114547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-1aad3d1f-6a61-4b52-a9a0-ddf7ca5fbe87.info Jun 29 03:44:02 devstack sudo[114547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:44:02 devstack sudo[114544]: pam_unix(sudo:session): session closed for user root Jun 29 03:44:02 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-69fc4e4e-1a75-4adb-a49c-3dfacfebe06f tempest-CreateVolumesFromImageTest-210232301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-4f10d343-140c-4c83-97b8-1f5dc5253f5b" returned: 0 in 0.684s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:44:02 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-69fc4e4e-1a75-4adb-a49c-3dfacfebe06f tempest-CreateVolumesFromImageTest-210232301 None] Lock "cinder-quobyte-4f10d343-140c-4c83-97b8-1f5dc5253f5b" released by "delete_volume" :: held 1.483s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:44:02 devstack sudo[114542]: pam_unix(sudo:session): session closed for user root Jun 29 03:44:02 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-571e83fe-f9c6-4f3b-a3ae-e6d63a14676f tempest-VolumeAndVolumeTypeFromImageTest-1239773066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_5f3d629d-98ff-4a80-a67c-8e04b9cae3a6_6hpb96_0devstack@QuobyteHD /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-0d6029b1-adf8-49f9-8496-6b6e46e22860" returned: 0 in 0.781s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:44:02 devstack cinder-volume[93468]: DEBUG cinder.image.image_utils [None req-571e83fe-f9c6-4f3b-a3ae-e6d63a14676f tempest-VolumeAndVolumeTypeFromImageTest-1239773066 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_5f3d629d-98ff-4a80-a67c-8e04b9cae3a6_6hpb96_0devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-0d6029b1-adf8-49f9-8496-6b6e46e22860 {{(pid=93468) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 29 03:44:02 devstack cinder-volume[93468]: INFO cinder.image.image_utils [None req-571e83fe-f9c6-4f3b-a3ae-e6d63a14676f tempest-VolumeAndVolumeTypeFromImageTest-1239773066 None] Converted 0.00 MB image at 0.00 MB/s Jun 29 03:44:02 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-571e83fe-f9c6-4f3b-a3ae-e6d63a14676f tempest-VolumeAndVolumeTypeFromImageTest-1239773066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-0d6029b1-adf8-49f9-8496-6b6e46e22860 1G {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:44:02 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-69fc4e4e-1a75-4adb-a49c-3dfacfebe06f tempest-CreateVolumesFromImageTest-210232301 None] Created reservations ['8f661260-88cf-41ff-806b-230cbde4d4bf', '883aa2ae-caa1-4a22-943b-11a785366ece', '991f3c9f-f3bd-4b88-a47b-898c5588b350', 'bef28dc9-2c2b-4c15-b77b-c551e2da6f54'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:44:02 devstack sudo[114553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-0d6029b1-adf8-49f9-8496-6b6e46e22860 1G Jun 29 03:44:02 devstack sudo[114553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:44:03 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-69fc4e4e-1a75-4adb-a49c-3dfacfebe06f tempest-CreateVolumesFromImageTest-210232301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:44:03 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-69fc4e4e-1a75-4adb-a49c-3dfacfebe06f tempest-CreateVolumesFromImageTest-210232301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:44:03 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-69fc4e4e-1a75-4adb-a49c-3dfacfebe06f tempest-CreateVolumesFromImageTest-210232301 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:44:03 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-69fc4e4e-1a75-4adb-a49c-3dfacfebe06f tempest-CreateVolumesFromImageTest-210232301 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:44:03 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-69fc4e4e-1a75-4adb-a49c-3dfacfebe06f tempest-CreateVolumesFromImageTest-210232301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:44:03 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-69fc4e4e-1a75-4adb-a49c-3dfacfebe06f tempest-CreateVolumesFromImageTest-210232301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:44:03 devstack sudo[114556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf Jun 29 03:44:03 devstack sudo[114556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:44:03 devstack sudo[114547]: pam_unix(sudo:session): session closed for user root Jun 29 03:44:03 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d1dfce0a-e901-484f-bca3-6b13c712f0fb tempest-VolumeDependencyTests-1245577734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-1aad3d1f-6a61-4b52-a9a0-ddf7ca5fbe87.info" returned: 0 in 0.685s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:44:03 devstack cinder-volume[93468]: WARNING cinder.volume.drivers.remotefs [None req-d1dfce0a-e901-484f-bca3-6b13c712f0fb tempest-VolumeDependencyTests-1245577734 None] /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-1aad3d1f-6a61-4b52-a9a0-ddf7ca5fbe87.info is being set with open permissions: ugo+rw Jun 29 03:44:03 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d1dfce0a-e901-484f-bca3-6b13c712f0fb tempest-VolumeDependencyTests-1245577734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-1aad3d1f-6a61-4b52-a9a0-ddf7ca5fbe87.info {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:44:03 devstack sudo[114558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-1aad3d1f-6a61-4b52-a9a0-ddf7ca5fbe87.info Jun 29 03:44:03 devstack sudo[114558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:44:03 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-7c2e3ce2-a4a8-4521-9a7a-c07ef88e3171 tempest-CreateVolumesFromImageTest-210232301 None] Acquiring lock "cinder-532e0e13-477b-4cdf-9cf0-c776136c6001-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:44:03 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-7c2e3ce2-a4a8-4521-9a7a-c07ef88e3171 tempest-CreateVolumesFromImageTest-210232301 None] Lock "cinder-532e0e13-477b-4cdf-9cf0-c776136c6001-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:44:03 devstack sudo[114553]: pam_unix(sudo:session): session closed for user root Jun 29 03:44:03 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-571e83fe-f9c6-4f3b-a3ae-e6d63a14676f tempest-VolumeAndVolumeTypeFromImageTest-1239773066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-0d6029b1-adf8-49f9-8496-6b6e46e22860 1G" returned: 0 in 0.764s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:44:03 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-7c2e3ce2-a4a8-4521-9a7a-c07ef88e3171 tempest-CreateVolumesFromImageTest-210232301 None] Acquiring lock "cinder-quobyte-532e0e13-477b-4cdf-9cf0-c776136c6001" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:44:03 devstack sudo[114556]: pam_unix(sudo:session): session closed for user root Jun 29 03:44:03 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-7c2e3ce2-a4a8-4521-9a7a-c07ef88e3171 tempest-CreateVolumesFromImageTest-210232301 None] Lock "cinder-quobyte-532e0e13-477b-4cdf-9cf0-c776136c6001" acquired by "delete_volume" :: waited 0.028s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:44:03 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b7db0a6-ca48-4928-904c-66b650ff0ab2]: (4, 'raw') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:44:03 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-571e83fe-f9c6-4f3b-a3ae-e6d63a14676f tempest-VolumeAndVolumeTypeFromImageTest-1239773066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-0d6029b1-adf8-49f9-8496-6b6e46e22860 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:44:03 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-69fc4e4e-1a75-4adb-a49c-3dfacfebe06f tempest-CreateVolumesFromImageTest-210232301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf" returned: 0 in 0.734s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:44:03 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-69fc4e4e-1a75-4adb-a49c-3dfacfebe06f tempest-CreateVolumesFromImageTest-210232301 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:44:03 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c3c22b1-ff4a-4b09-8dad-7d38d936a5aa]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:44:03 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-7c2e3ce2-a4a8-4521-9a7a-c07ef88e3171 tempest-CreateVolumesFromImageTest-210232301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-532e0e13-477b-4cdf-9cf0-c776136c6001 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:44:03 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-69fc4e4e-1a75-4adb-a49c-3dfacfebe06f tempest-CreateVolumesFromImageTest-210232301 None] Deleted volume successfully. Jun 29 03:44:03 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-69fc4e4e-1a75-4adb-a49c-3dfacfebe06f tempest-CreateVolumesFromImageTest-210232301 None] Lock "cinder-4f10d343-140c-4c83-97b8-1f5dc5253f5b-delete_volume" released by "delete_volume" :: held 2.519s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:44:03 devstack sudo[114558]: pam_unix(sudo:session): session closed for user root Jun 29 03:44:03 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d1dfce0a-e901-484f-bca3-6b13c712f0fb tempest-VolumeDependencyTests-1245577734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-1aad3d1f-6a61-4b52-a9a0-ddf7ca5fbe87.info" returned: 0 in 0.763s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:44:03 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-d1dfce0a-e901-484f-bca3-6b13c712f0fb tempest-VolumeDependencyTests-1245577734 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.488s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:44:03 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-5d52c676-d311-4f9b-b573-a894614e0e78 tempest-CreateVolumesFromSnapshotTest-1093373581 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.430s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:44:03 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-5d52c676-d311-4f9b-b573-a894614e0e78 tempest-CreateVolumesFromSnapshotTest-1093373581 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:43:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-862985773',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78d66f48-6e6e-4baf-ba19-2d449c369bcc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64bb520d993e427c9c4490b050e40a72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:43:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:43:58Z,use_quota=True,user_id='998a078d10ae4063a2f3b87f6f1d255d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:44:03 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-5d52c676-d311-4f9b-b573-a894614e0e78 tempest-CreateVolumesFromSnapshotTest-1093373581 None] Creating volume 78d66f48-6e6e-4baf-ba19-2d449c369bcc {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:44:03 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-5d52c676-d311-4f9b-b573-a894614e0e78 tempest-CreateVolumesFromSnapshotTest-1093373581 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:44:03 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-5d52c676-d311-4f9b-b573-a894614e0e78 tempest-CreateVolumesFromSnapshotTest-1093373581 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:44:03 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-5d52c676-d311-4f9b-b573-a894614e0e78 tempest-CreateVolumesFromSnapshotTest-1093373581 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:44:03 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-5d52c676-d311-4f9b-b573-a894614e0e78 tempest-CreateVolumesFromSnapshotTest-1093373581 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:44:03 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-5d52c676-d311-4f9b-b573-a894614e0e78 tempest-CreateVolumesFromSnapshotTest-1093373581 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:44:03 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-5d52c676-d311-4f9b-b573-a894614e0e78 tempest-CreateVolumesFromSnapshotTest-1093373581 None] Selected osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:44:03 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-5d52c676-d311-4f9b-b573-a894614e0e78 tempest-CreateVolumesFromSnapshotTest-1093373581 None] casted to osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f Jun 29 03:44:03 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-5d52c676-d311-4f9b-b573-a894614e0e78 tempest-CreateVolumesFromSnapshotTest-1093373581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-78d66f48-6e6e-4baf-ba19-2d449c369bcc 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:44:03 devstack sudo[114565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-0d6029b1-adf8-49f9-8496-6b6e46e22860 Jun 29 03:44:03 devstack sudo[114565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:44:03 devstack sudo[114567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-78d66f48-6e6e-4baf-ba19-2d449c369bcc 1073741824 Jun 29 03:44:03 devstack sudo[114567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:44:03 devstack sudo[114566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-532e0e13-477b-4cdf-9cf0-c776136c6001 Jun 29 03:44:03 devstack sudo[114566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:44:03 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-d1dfce0a-e901-484f-bca3-6b13c712f0fb tempest-VolumeDependencyTests-1245577734 None] Create snapshot completed successfully Jun 29 03:44:04 devstack sudo[114565]: pam_unix(sudo:session): session closed for user root Jun 29 03:44:04 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-571e83fe-f9c6-4f3b-a3ae-e6d63a14676f tempest-VolumeAndVolumeTypeFromImageTest-1239773066 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-0d6029b1-adf8-49f9-8496-6b6e46e22860" returned: 0 in 0.876s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:44:04 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-571e83fe-f9c6-4f3b-a3ae-e6d63a14676f tempest-VolumeAndVolumeTypeFromImageTest-1239773066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-0d6029b1-adf8-49f9-8496-6b6e46e22860 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:44:04 devstack sudo[114566]: pam_unix(sudo:session): session closed for user root Jun 29 03:44:04 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-7c2e3ce2-a4a8-4521-9a7a-c07ef88e3171 tempest-CreateVolumesFromImageTest-210232301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-532e0e13-477b-4cdf-9cf0-c776136c6001" returned: 0 in 0.876s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:44:04 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-7c2e3ce2-a4a8-4521-9a7a-c07ef88e3171 tempest-CreateVolumesFromImageTest-210232301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-532e0e13-477b-4cdf-9cf0-c776136c6001 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:44:04 devstack sudo[114581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-532e0e13-477b-4cdf-9cf0-c776136c6001 Jun 29 03:44:04 devstack sudo[114581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:44:04 devstack sudo[114580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-0d6029b1-adf8-49f9-8496-6b6e46e22860 Jun 29 03:44:04 devstack sudo[114580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:44:04 devstack sudo[114567]: pam_unix(sudo:session): session closed for user root Jun 29 03:44:04 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-5d52c676-d311-4f9b-b573-a894614e0e78 tempest-CreateVolumesFromSnapshotTest-1093373581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-78d66f48-6e6e-4baf-ba19-2d449c369bcc 1073741824" returned: 0 in 0.977s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:44:04 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-5d52c676-d311-4f9b-b573-a894614e0e78 tempest-CreateVolumesFromSnapshotTest-1093373581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-78d66f48-6e6e-4baf-ba19-2d449c369bcc {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:44:04 devstack sudo[114584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-78d66f48-6e6e-4baf-ba19-2d449c369bcc Jun 29 03:44:04 devstack sudo[114584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:44:05 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1c99802-7649-46d8-8f65-8b391e75245c tempest-VolumeDependencyTests-1245577734 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:44:05 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-a1c99802-7649-46d8-8f65-8b391e75245c tempest-VolumeDependencyTests-1245577734 None] Flow 'volume_create_manager' (14b3fb7d-cc53-40e8-a8e9-3a9008918804) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:44:05 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-a1c99802-7649-46d8-8f65-8b391e75245c tempest-VolumeDependencyTests-1245577734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92fc0169-9808-4d40-b009-c78554b1e006) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:44:05 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-a1c99802-7649-46d8-8f65-8b391e75245c tempest-VolumeDependencyTests-1245577734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92fc0169-9808-4d40-b009-c78554b1e006) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:44:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1954880821',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6084173-ec5a-4172-8d3d-379f109afe8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5508a57794ce42feae62d6afae7f9f1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:44:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=29cc1948-65a7-40e9-940e-6ec7933c4757,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:44:05Z,use_quota=True,user_id='e879ab76007945178088d532c2c38294',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:44:05 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-a1c99802-7649-46d8-8f65-8b391e75245c tempest-VolumeDependencyTests-1245577734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a1ef6c1-63ee-4a40-a951-786855dc3dab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:44:05 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-a1c99802-7649-46d8-8f65-8b391e75245c tempest-VolumeDependencyTests-1245577734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a1ef6c1-63ee-4a40-a951-786855dc3dab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:44:05 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-a1c99802-7649-46d8-8f65-8b391e75245c tempest-VolumeDependencyTests-1245577734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2ae0c17-7421-4382-8cbb-114dfc85707c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:44:05 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-a1c99802-7649-46d8-8f65-8b391e75245c tempest-VolumeDependencyTests-1245577734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2ae0c17-7421-4382-8cbb-114dfc85707c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'f6084173-ec5a-4172-8d3d-379f109afe8a', 'volume_name': 'volume-f6084173-ec5a-4172-8d3d-379f109afe8a', 'volume_size': 1, 'snapshot_id': '29cc1948-65a7-40e9-940e-6ec7933c4757'}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:44:05 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-a1c99802-7649-46d8-8f65-8b391e75245c tempest-VolumeDependencyTests-1245577734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc3026c9-3aa6-46c0-9436-9a37e8be4fda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:44:05 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-a1c99802-7649-46d8-8f65-8b391e75245c tempest-VolumeDependencyTests-1245577734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc3026c9-3aa6-46c0-9436-9a37e8be4fda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:44:05 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-a1c99802-7649-46d8-8f65-8b391e75245c tempest-VolumeDependencyTests-1245577734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07941ea6-cf25-4f02-bba5-c120ef3d71d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:44:05 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-a1c99802-7649-46d8-8f65-8b391e75245c tempest-VolumeDependencyTests-1245577734 None] Volume f6084173-ec5a-4172-8d3d-379f109afe8a: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-f6084173-ec5a-4172-8d3d-379f109afe8a', 'volume_size': 1, 'snapshot_id': '29cc1948-65a7-40e9-940e-6ec7933c4757'} Jun 29 03:44:05 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-a1c99802-7649-46d8-8f65-8b391e75245c tempest-VolumeDependencyTests-1245577734 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:44:05 devstack sudo[114581]: pam_unix(sudo:session): session closed for user root Jun 29 03:44:05 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-7c2e3ce2-a4a8-4521-9a7a-c07ef88e3171 tempest-CreateVolumesFromImageTest-210232301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-532e0e13-477b-4cdf-9cf0-c776136c6001" returned: 0 in 0.803s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:44:05 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-7c2e3ce2-a4a8-4521-9a7a-c07ef88e3171 tempest-CreateVolumesFromImageTest-210232301 None] Lock "cinder-quobyte-532e0e13-477b-4cdf-9cf0-c776136c6001" released by "delete_volume" :: held 1.730s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:44:05 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-7c2e3ce2-a4a8-4521-9a7a-c07ef88e3171 tempest-CreateVolumesFromImageTest-210232301 None] Created reservations ['fd848402-6fce-486e-b247-cfa7a8ff5c06', '1c73acce-4993-4ccd-87f8-b9f2b9da162c', 'cf41d3d1-cbc9-4bc0-9959-3032fef253e4', '02c58839-98d2-4bbb-8529-5beb5a4e0cc8'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:44:05 devstack sudo[114580]: pam_unix(sudo:session): session closed for user root Jun 29 03:44:05 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-571e83fe-f9c6-4f3b-a3ae-e6d63a14676f tempest-VolumeAndVolumeTypeFromImageTest-1239773066 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-0d6029b1-adf8-49f9-8496-6b6e46e22860" returned: 1 in 0.947s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:44:05 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-571e83fe-f9c6-4f3b-a3ae-e6d63a14676f tempest-VolumeAndVolumeTypeFromImageTest-1239773066 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-0d6029b1-adf8-49f9-8496-6b6e46e22860' failed. Not Retrying. {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 29 03:44:05 devstack cinder-volume[93468]: DEBUG cinder.volume.volume_utils [None req-571e83fe-f9c6-4f3b-a3ae-e6d63a14676f tempest-VolumeAndVolumeTypeFromImageTest-1239773066 None] Downloaded image 5f3d629d-98ff-4a80-a67c-8e04b9cae3a6 ((None, [{'url': 'file:///opt/stack/data/glance/images/5f3d629d-98ff-4a80-a67c-8e04b9cae3a6', 'metadata': {}}])) to volume 0d6029b1-adf8-49f9-8496-6b6e46e22860 successfully. {{(pid=93468) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 29 03:44:05 devstack cinder-volume[93468]: DEBUG cinder.image.image_utils [None req-571e83fe-f9c6-4f3b-a3ae-e6d63a14676f tempest-VolumeAndVolumeTypeFromImageTest-1239773066 None] Temporary image 5f3d629d-98ff-4a80-a67c-8e04b9cae3a6 for user a06c2ff69d7b448282d5355a8b55099c is deleted. {{(pid=93468) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 29 03:44:05 devstack cinder-volume[93468]: DEBUG cinder.volume.volume_utils [None req-571e83fe-f9c6-4f3b-a3ae-e6d63a14676f tempest-VolumeAndVolumeTypeFromImageTest-1239773066 None] Marking volume 0d6029b1-adf8-49f9-8496-6b6e46e22860 as bootable. {{(pid=93468) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 29 03:44:05 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-7c2e3ce2-a4a8-4521-9a7a-c07ef88e3171 tempest-CreateVolumesFromImageTest-210232301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:44:05 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-7c2e3ce2-a4a8-4521-9a7a-c07ef88e3171 tempest-CreateVolumesFromImageTest-210232301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:44:05 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-7c2e3ce2-a4a8-4521-9a7a-c07ef88e3171 tempest-CreateVolumesFromImageTest-210232301 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:44:05 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-7c2e3ce2-a4a8-4521-9a7a-c07ef88e3171 tempest-CreateVolumesFromImageTest-210232301 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:44:05 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-7c2e3ce2-a4a8-4521-9a7a-c07ef88e3171 tempest-CreateVolumesFromImageTest-210232301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:44:05 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-7c2e3ce2-a4a8-4521-9a7a-c07ef88e3171 tempest-CreateVolumesFromImageTest-210232301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:44:05 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-571e83fe-f9c6-4f3b-a3ae-e6d63a14676f tempest-VolumeAndVolumeTypeFromImageTest-1239773066 None] Copying metadata from image 5f3d629d-98ff-4a80-a67c-8e04b9cae3a6 to 0d6029b1-adf8-49f9-8496-6b6e46e22860. {{(pid=93468) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 29 03:44:05 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-571e83fe-f9c6-4f3b-a3ae-e6d63a14676f tempest-VolumeAndVolumeTypeFromImageTest-1239773066 None] Creating volume glance metadata for volume 0d6029b1-adf8-49f9-8496-6b6e46e22860 backed by image 5f3d629d-98ff-4a80-a67c-8e04b9cae3a6 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '5f3d629d-98ff-4a80-a67c-8e04b9cae3a6', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '2d0e7fc569fc5d0fdfc434c386e1ef7f', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=93468) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 29 03:44:05 devstack sudo[114584]: pam_unix(sudo:session): session closed for user root Jun 29 03:44:05 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-5d52c676-d311-4f9b-b573-a894614e0e78 tempest-CreateVolumesFromSnapshotTest-1093373581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-78d66f48-6e6e-4baf-ba19-2d449c369bcc" returned: 0 in 0.736s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:44:05 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-5d52c676-d311-4f9b-b573-a894614e0e78 tempest-CreateVolumesFromSnapshotTest-1093373581 None] <== create_volume: return (1758ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:44:05 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-5d52c676-d311-4f9b-b573-a894614e0e78 tempest-CreateVolumesFromSnapshotTest-1093373581 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.761s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:44:05 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-6326cc53-68f1-4110-a2ac-1a2838bd6a25 tempest-CreateVolumesFromSnapshotTest-1093373581 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.570s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:44:05 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-6326cc53-68f1-4110-a2ac-1a2838bd6a25 tempest-CreateVolumesFromSnapshotTest-1093373581 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:43:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1136844475',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d719f89f-317b-493f-8498-9984506f0903,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64bb520d993e427c9c4490b050e40a72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:43:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:43:59Z,use_quota=True,user_id='998a078d10ae4063a2f3b87f6f1d255d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:44:05 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-6326cc53-68f1-4110-a2ac-1a2838bd6a25 tempest-CreateVolumesFromSnapshotTest-1093373581 None] Creating volume d719f89f-317b-493f-8498-9984506f0903 {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:44:05 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-6326cc53-68f1-4110-a2ac-1a2838bd6a25 tempest-CreateVolumesFromSnapshotTest-1093373581 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:44:05 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-6326cc53-68f1-4110-a2ac-1a2838bd6a25 tempest-CreateVolumesFromSnapshotTest-1093373581 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:44:05 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-6326cc53-68f1-4110-a2ac-1a2838bd6a25 tempest-CreateVolumesFromSnapshotTest-1093373581 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:44:05 devstack sudo[114591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf Jun 29 03:44:05 devstack sudo[114591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:44:05 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-6326cc53-68f1-4110-a2ac-1a2838bd6a25 tempest-CreateVolumesFromSnapshotTest-1093373581 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:44:05 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-6326cc53-68f1-4110-a2ac-1a2838bd6a25 tempest-CreateVolumesFromSnapshotTest-1093373581 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:44:05 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-6326cc53-68f1-4110-a2ac-1a2838bd6a25 tempest-CreateVolumesFromSnapshotTest-1093373581 None] Selected osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:44:05 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-6326cc53-68f1-4110-a2ac-1a2838bd6a25 tempest-CreateVolumesFromSnapshotTest-1093373581 None] casted to osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f Jun 29 03:44:05 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-6326cc53-68f1-4110-a2ac-1a2838bd6a25 tempest-CreateVolumesFromSnapshotTest-1093373581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-d719f89f-317b-493f-8498-9984506f0903 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:44:05 devstack sudo[114593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-d719f89f-317b-493f-8498-9984506f0903 1073741824 Jun 29 03:44:05 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-5d52c676-d311-4f9b-b573-a894614e0e78 tempest-CreateVolumesFromSnapshotTest-1093373581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a52cd827-bf71-4095-ab03-ade9950d57c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-78d66f48-6e6e-4baf-ba19-2d449c369bcc', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:44:05 devstack sudo[114593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:44:05 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-5d52c676-d311-4f9b-b573-a894614e0e78 tempest-CreateVolumesFromSnapshotTest-1093373581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ffa0f54-0a11-47c5-b8ba-f4bec3b13d67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:44:05 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-5d52c676-d311-4f9b-b573-a894614e0e78 tempest-CreateVolumesFromSnapshotTest-1093373581 None] Volume volume-78d66f48-6e6e-4baf-ba19-2d449c369bcc (78d66f48-6e6e-4baf-ba19-2d449c369bcc): created successfully Jun 29 03:44:05 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-5d52c676-d311-4f9b-b573-a894614e0e78 tempest-CreateVolumesFromSnapshotTest-1093373581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ffa0f54-0a11-47c5-b8ba-f4bec3b13d67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:44:05 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-5d52c676-d311-4f9b-b573-a894614e0e78 tempest-CreateVolumesFromSnapshotTest-1093373581 None] Flow 'volume_create_manager' (13e0af09-b74a-4214-ad10-41c74f024d3b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:44:05 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-5d52c676-d311-4f9b-b573-a894614e0e78 tempest-CreateVolumesFromSnapshotTest-1093373581 None] Created volume successfully. Jun 29 03:44:05 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-571e83fe-f9c6-4f3b-a3ae-e6d63a14676f tempest-VolumeAndVolumeTypeFromImageTest-1239773066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5a808cc-7a2c-4612-a5b8-9706e593cf62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d6029b1-adf8-49f9-8496-6b6e46e22860', 'volume_size': 1, 'image_id': '5f3d629d-98ff-4a80-a67c-8e04b9cae3a6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5f3d629d-98ff-4a80-a67c-8e04b9cae3a6', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '2d0e7fc569fc5d0fdfc434c386e1ef7f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd7f4f5e848ac4ad0859368c43a3a366d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '10d6c0f74272fca6d423728fc70597fafda7110ac08775c6c4bc2fe3e46879ed8a1a7690d5d3e866f69f9d5c5a95154382d4ce26f972f7de3cb405aac7692931', 'id': '5f3d629d-98ff-4a80-a67c-8e04b9cae3a6', 'created_at': datetime.datetime(2026, 6, 29, 1, 43, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 29, 1, 43, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5f3d629d-98ff-4a80-a67c-8e04b9cae3a6/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:44:05 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-571e83fe-f9c6-4f3b-a3ae-e6d63a14676f tempest-VolumeAndVolumeTypeFromImageTest-1239773066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c67d2e43-35e8-477e-926e-7c152eb3e977) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:44:05 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-571e83fe-f9c6-4f3b-a3ae-e6d63a14676f tempest-VolumeAndVolumeTypeFromImageTest-1239773066 None] Volume volume-0d6029b1-adf8-49f9-8496-6b6e46e22860 (0d6029b1-adf8-49f9-8496-6b6e46e22860): created successfully Jun 29 03:44:05 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-571e83fe-f9c6-4f3b-a3ae-e6d63a14676f tempest-VolumeAndVolumeTypeFromImageTest-1239773066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c67d2e43-35e8-477e-926e-7c152eb3e977) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:44:05 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-571e83fe-f9c6-4f3b-a3ae-e6d63a14676f tempest-VolumeAndVolumeTypeFromImageTest-1239773066 None] Flow 'volume_create_manager' (408ecfd0-4093-4f49-bfef-46a3268b35aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:44:05 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-571e83fe-f9c6-4f3b-a3ae-e6d63a14676f tempest-VolumeAndVolumeTypeFromImageTest-1239773066 None] Created volume successfully. Jun 29 03:44:06 devstack sudo[114591]: pam_unix(sudo:session): session closed for user root Jun 29 03:44:06 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-7c2e3ce2-a4a8-4521-9a7a-c07ef88e3171 tempest-CreateVolumesFromImageTest-210232301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf" returned: 0 in 0.673s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:44:06 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-7c2e3ce2-a4a8-4521-9a7a-c07ef88e3171 tempest-CreateVolumesFromImageTest-210232301 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:44:06 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-7c2e3ce2-a4a8-4521-9a7a-c07ef88e3171 tempest-CreateVolumesFromImageTest-210232301 None] Deleted volume successfully. Jun 29 03:44:06 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-b505b15a-48ac-4094-9ca2-193888228a92 tempest-VolumeAndVolumeTypeFromImageTest-1239773066 None] Acquiring lock "cinder-0d6029b1-adf8-49f9-8496-6b6e46e22860-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:44:06 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-b505b15a-48ac-4094-9ca2-193888228a92 tempest-VolumeAndVolumeTypeFromImageTest-1239773066 None] Lock "cinder-0d6029b1-adf8-49f9-8496-6b6e46e22860-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:44:06 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-7c2e3ce2-a4a8-4521-9a7a-c07ef88e3171 tempest-CreateVolumesFromImageTest-210232301 None] Lock "cinder-532e0e13-477b-4cdf-9cf0-c776136c6001-delete_volume" released by "delete_volume" :: held 2.727s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:44:06 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-b505b15a-48ac-4094-9ca2-193888228a92 tempest-VolumeAndVolumeTypeFromImageTest-1239773066 None] Acquiring lock "cinder-quobyte-0d6029b1-adf8-49f9-8496-6b6e46e22860" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:44:06 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-b505b15a-48ac-4094-9ca2-193888228a92 tempest-VolumeAndVolumeTypeFromImageTest-1239773066 None] Lock "cinder-quobyte-0d6029b1-adf8-49f9-8496-6b6e46e22860" acquired by "delete_volume" :: waited 0.035s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:44:06 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea93eee6-d321-483f-804c-2de079b81ae5]: (4, 'raw') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:44:06 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b505b15a-48ac-4094-9ca2-193888228a92 tempest-VolumeAndVolumeTypeFromImageTest-1239773066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-0d6029b1-adf8-49f9-8496-6b6e46e22860 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:44:06 devstack sudo[114600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-0d6029b1-adf8-49f9-8496-6b6e46e22860 Jun 29 03:44:06 devstack sudo[114600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:44:06 devstack sudo[114593]: pam_unix(sudo:session): session closed for user root Jun 29 03:44:06 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-6326cc53-68f1-4110-a2ac-1a2838bd6a25 tempest-CreateVolumesFromSnapshotTest-1093373581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-d719f89f-317b-493f-8498-9984506f0903 1073741824" returned: 0 in 1.047s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:44:06 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-6326cc53-68f1-4110-a2ac-1a2838bd6a25 tempest-CreateVolumesFromSnapshotTest-1093373581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-d719f89f-317b-493f-8498-9984506f0903 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:44:06 devstack sudo[114602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-d719f89f-317b-493f-8498-9984506f0903 Jun 29 03:44:06 devstack sudo[114602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:44:07 devstack sudo[114602]: pam_unix(sudo:session): session closed for user root Jun 29 03:44:07 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-6326cc53-68f1-4110-a2ac-1a2838bd6a25 tempest-CreateVolumesFromSnapshotTest-1093373581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-d719f89f-317b-493f-8498-9984506f0903" returned: 0 in 0.694s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:44:07 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-6326cc53-68f1-4110-a2ac-1a2838bd6a25 tempest-CreateVolumesFromSnapshotTest-1093373581 None] <== create_volume: return (1820ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:44:07 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-6326cc53-68f1-4110-a2ac-1a2838bd6a25 tempest-CreateVolumesFromSnapshotTest-1093373581 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.824s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:44:07 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-731678fd-da1c-4a76-a820-e63a0ffda495 tempest-CreateVolumesFromSnapshotTest-1093373581 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.981s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:44:07 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-731678fd-da1c-4a76-a820-e63a0ffda495 tempest-CreateVolumesFromSnapshotTest-1093373581 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:43:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1661559410',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49966b9a-3398-4ae6-8747-519f7e8d490f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64bb520d993e427c9c4490b050e40a72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:43:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:43:59Z,use_quota=True,user_id='998a078d10ae4063a2f3b87f6f1d255d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:44:07 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-731678fd-da1c-4a76-a820-e63a0ffda495 tempest-CreateVolumesFromSnapshotTest-1093373581 None] Creating volume 49966b9a-3398-4ae6-8747-519f7e8d490f {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:44:07 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-731678fd-da1c-4a76-a820-e63a0ffda495 tempest-CreateVolumesFromSnapshotTest-1093373581 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:44:07 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-731678fd-da1c-4a76-a820-e63a0ffda495 tempest-CreateVolumesFromSnapshotTest-1093373581 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:44:07 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-731678fd-da1c-4a76-a820-e63a0ffda495 tempest-CreateVolumesFromSnapshotTest-1093373581 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:44:07 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-731678fd-da1c-4a76-a820-e63a0ffda495 tempest-CreateVolumesFromSnapshotTest-1093373581 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:44:07 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-731678fd-da1c-4a76-a820-e63a0ffda495 tempest-CreateVolumesFromSnapshotTest-1093373581 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:44:07 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-731678fd-da1c-4a76-a820-e63a0ffda495 tempest-CreateVolumesFromSnapshotTest-1093373581 None] Selected osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:44:07 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-731678fd-da1c-4a76-a820-e63a0ffda495 tempest-CreateVolumesFromSnapshotTest-1093373581 None] casted to osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f Jun 29 03:44:07 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-731678fd-da1c-4a76-a820-e63a0ffda495 tempest-CreateVolumesFromSnapshotTest-1093373581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-49966b9a-3398-4ae6-8747-519f7e8d490f 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:44:07 devstack sudo[114608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-49966b9a-3398-4ae6-8747-519f7e8d490f 1073741824 Jun 29 03:44:07 devstack sudo[114608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:44:07 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-6326cc53-68f1-4110-a2ac-1a2838bd6a25 tempest-CreateVolumesFromSnapshotTest-1093373581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55341a09-26ca-4144-93ff-e4372e1d72fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d719f89f-317b-493f-8498-9984506f0903', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:44:07 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-6326cc53-68f1-4110-a2ac-1a2838bd6a25 tempest-CreateVolumesFromSnapshotTest-1093373581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c925a32-027b-4eb2-b5e6-897895937cdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:44:07 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-6326cc53-68f1-4110-a2ac-1a2838bd6a25 tempest-CreateVolumesFromSnapshotTest-1093373581 None] Volume volume-d719f89f-317b-493f-8498-9984506f0903 (d719f89f-317b-493f-8498-9984506f0903): created successfully Jun 29 03:44:07 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-6326cc53-68f1-4110-a2ac-1a2838bd6a25 tempest-CreateVolumesFromSnapshotTest-1093373581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c925a32-027b-4eb2-b5e6-897895937cdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:44:07 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-6326cc53-68f1-4110-a2ac-1a2838bd6a25 tempest-CreateVolumesFromSnapshotTest-1093373581 None] Flow 'volume_create_manager' (73044fba-bf77-4fbc-a03d-9f0e9e45837e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:44:07 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-6326cc53-68f1-4110-a2ac-1a2838bd6a25 tempest-CreateVolumesFromSnapshotTest-1093373581 None] Created volume successfully. Jun 29 03:44:07 devstack sudo[114600]: pam_unix(sudo:session): session closed for user root Jun 29 03:44:07 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b505b15a-48ac-4094-9ca2-193888228a92 tempest-VolumeAndVolumeTypeFromImageTest-1239773066 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-0d6029b1-adf8-49f9-8496-6b6e46e22860" returned: 0 in 1.110s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:44:07 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b505b15a-48ac-4094-9ca2-193888228a92 tempest-VolumeAndVolumeTypeFromImageTest-1239773066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-0d6029b1-adf8-49f9-8496-6b6e46e22860 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:44:07 devstack sudo[114610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-0d6029b1-adf8-49f9-8496-6b6e46e22860 Jun 29 03:44:07 devstack sudo[114610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:44:08 devstack sudo[114610]: pam_unix(sudo:session): session closed for user root Jun 29 03:44:08 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b505b15a-48ac-4094-9ca2-193888228a92 tempest-VolumeAndVolumeTypeFromImageTest-1239773066 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-0d6029b1-adf8-49f9-8496-6b6e46e22860" returned: 1 in 0.808s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:44:08 devstack sudo[114608]: pam_unix(sudo:session): session closed for user root Jun 29 03:44:08 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b505b15a-48ac-4094-9ca2-193888228a92 tempest-VolumeAndVolumeTypeFromImageTest-1239773066 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-0d6029b1-adf8-49f9-8496-6b6e46e22860' failed. Not Retrying. {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 29 03:44:08 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b505b15a-48ac-4094-9ca2-193888228a92 tempest-VolumeAndVolumeTypeFromImageTest-1239773066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-0d6029b1-adf8-49f9-8496-6b6e46e22860 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:44:08 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-731678fd-da1c-4a76-a820-e63a0ffda495 tempest-CreateVolumesFromSnapshotTest-1093373581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-49966b9a-3398-4ae6-8747-519f7e8d490f 1073741824" returned: 0 in 0.985s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:44:08 devstack sudo[114619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-0d6029b1-adf8-49f9-8496-6b6e46e22860 Jun 29 03:44:08 devstack sudo[114619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:44:08 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-731678fd-da1c-4a76-a820-e63a0ffda495 tempest-CreateVolumesFromSnapshotTest-1093373581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-49966b9a-3398-4ae6-8747-519f7e8d490f {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:44:08 devstack sudo[114621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-49966b9a-3398-4ae6-8747-519f7e8d490f Jun 29 03:44:08 devstack sudo[114621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:44:09 devstack sudo[114619]: pam_unix(sudo:session): session closed for user root Jun 29 03:44:09 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b505b15a-48ac-4094-9ca2-193888228a92 tempest-VolumeAndVolumeTypeFromImageTest-1239773066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-0d6029b1-adf8-49f9-8496-6b6e46e22860" returned: 0 in 0.739s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:44:09 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-b505b15a-48ac-4094-9ca2-193888228a92 tempest-VolumeAndVolumeTypeFromImageTest-1239773066 None] Lock "cinder-quobyte-0d6029b1-adf8-49f9-8496-6b6e46e22860" released by "delete_volume" :: held 2.738s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:44:09 devstack sudo[114621]: pam_unix(sudo:session): session closed for user root Jun 29 03:44:09 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-731678fd-da1c-4a76-a820-e63a0ffda495 tempest-CreateVolumesFromSnapshotTest-1093373581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-49966b9a-3398-4ae6-8747-519f7e8d490f" returned: 0 in 0.745s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:44:09 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-731678fd-da1c-4a76-a820-e63a0ffda495 tempest-CreateVolumesFromSnapshotTest-1093373581 None] <== create_volume: return (1806ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:44:09 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-731678fd-da1c-4a76-a820-e63a0ffda495 tempest-CreateVolumesFromSnapshotTest-1093373581 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.810s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:44:09 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-dc47568d-fff0-4521-a35c-d726866a79dc tempest-CreateVolumesFromSnapshotTest-1093373581 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.205s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:44:09 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-dc47568d-fff0-4521-a35c-d726866a79dc tempest-CreateVolumesFromSnapshotTest-1093373581 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:43:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1896695185',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99030091-ab42-4966-8f17-f06c73417ab3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64bb520d993e427c9c4490b050e40a72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:44:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:44:00Z,use_quota=True,user_id='998a078d10ae4063a2f3b87f6f1d255d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:44:09 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-dc47568d-fff0-4521-a35c-d726866a79dc tempest-CreateVolumesFromSnapshotTest-1093373581 None] Creating volume 99030091-ab42-4966-8f17-f06c73417ab3 {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:44:09 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-dc47568d-fff0-4521-a35c-d726866a79dc tempest-CreateVolumesFromSnapshotTest-1093373581 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:44:09 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-dc47568d-fff0-4521-a35c-d726866a79dc tempest-CreateVolumesFromSnapshotTest-1093373581 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:44:09 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-dc47568d-fff0-4521-a35c-d726866a79dc tempest-CreateVolumesFromSnapshotTest-1093373581 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:44:09 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-dc47568d-fff0-4521-a35c-d726866a79dc tempest-CreateVolumesFromSnapshotTest-1093373581 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:44:09 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-dc47568d-fff0-4521-a35c-d726866a79dc tempest-CreateVolumesFromSnapshotTest-1093373581 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:44:09 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-dc47568d-fff0-4521-a35c-d726866a79dc tempest-CreateVolumesFromSnapshotTest-1093373581 None] Selected osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:44:09 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-dc47568d-fff0-4521-a35c-d726866a79dc tempest-CreateVolumesFromSnapshotTest-1093373581 None] casted to osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f Jun 29 03:44:09 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-dc47568d-fff0-4521-a35c-d726866a79dc tempest-CreateVolumesFromSnapshotTest-1093373581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-99030091-ab42-4966-8f17-f06c73417ab3 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:44:09 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-731678fd-da1c-4a76-a820-e63a0ffda495 tempest-CreateVolumesFromSnapshotTest-1093373581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64b24954-8dd5-4072-9c39-60071bc037ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-49966b9a-3398-4ae6-8747-519f7e8d490f', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:44:09 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-731678fd-da1c-4a76-a820-e63a0ffda495 tempest-CreateVolumesFromSnapshotTest-1093373581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b89d5f3-e1a1-422f-ac04-cd40d6b100c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:44:09 devstack sudo[114625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-99030091-ab42-4966-8f17-f06c73417ab3 1073741824 Jun 29 03:44:09 devstack sudo[114625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:44:09 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-b505b15a-48ac-4094-9ca2-193888228a92 tempest-VolumeAndVolumeTypeFromImageTest-1239773066 None] Created reservations ['6c6229f2-77d4-4cf8-afd3-c75658034469', 'a2f066b7-1b97-4b3e-bfce-1c144c0298f2', 'b40c6367-aae7-4b43-9acf-6970a0da8381', '3bb2fc9c-1202-4690-82b5-ad386011bef2'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:44:09 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-731678fd-da1c-4a76-a820-e63a0ffda495 tempest-CreateVolumesFromSnapshotTest-1093373581 None] Volume volume-49966b9a-3398-4ae6-8747-519f7e8d490f (49966b9a-3398-4ae6-8747-519f7e8d490f): created successfully Jun 29 03:44:09 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-731678fd-da1c-4a76-a820-e63a0ffda495 tempest-CreateVolumesFromSnapshotTest-1093373581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b89d5f3-e1a1-422f-ac04-cd40d6b100c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:44:09 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-731678fd-da1c-4a76-a820-e63a0ffda495 tempest-CreateVolumesFromSnapshotTest-1093373581 None] Flow 'volume_create_manager' (1cca91ed-4695-4243-9bd0-be47970c1277) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:44:09 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-731678fd-da1c-4a76-a820-e63a0ffda495 tempest-CreateVolumesFromSnapshotTest-1093373581 None] Created volume successfully. Jun 29 03:44:09 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-b505b15a-48ac-4094-9ca2-193888228a92 tempest-VolumeAndVolumeTypeFromImageTest-1239773066 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:44:09 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-b505b15a-48ac-4094-9ca2-193888228a92 tempest-VolumeAndVolumeTypeFromImageTest-1239773066 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:44:09 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-b505b15a-48ac-4094-9ca2-193888228a92 tempest-VolumeAndVolumeTypeFromImageTest-1239773066 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:44:09 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-b505b15a-48ac-4094-9ca2-193888228a92 tempest-VolumeAndVolumeTypeFromImageTest-1239773066 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:44:09 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-b505b15a-48ac-4094-9ca2-193888228a92 tempest-VolumeAndVolumeTypeFromImageTest-1239773066 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:44:09 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b505b15a-48ac-4094-9ca2-193888228a92 tempest-VolumeAndVolumeTypeFromImageTest-1239773066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:44:09 devstack sudo[114627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf Jun 29 03:44:09 devstack sudo[114627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:44:10 devstack sudo[114627]: pam_unix(sudo:session): session closed for user root Jun 29 03:44:10 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b505b15a-48ac-4094-9ca2-193888228a92 tempest-VolumeAndVolumeTypeFromImageTest-1239773066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf" returned: 0 in 0.898s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:44:10 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-b505b15a-48ac-4094-9ca2-193888228a92 tempest-VolumeAndVolumeTypeFromImageTest-1239773066 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:44:10 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-b505b15a-48ac-4094-9ca2-193888228a92 tempest-VolumeAndVolumeTypeFromImageTest-1239773066 None] Deleted volume successfully. Jun 29 03:44:10 devstack sudo[114625]: pam_unix(sudo:session): session closed for user root Jun 29 03:44:10 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-dc47568d-fff0-4521-a35c-d726866a79dc tempest-CreateVolumesFromSnapshotTest-1093373581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-99030091-ab42-4966-8f17-f06c73417ab3 1073741824" returned: 0 in 1.100s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:44:10 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-b505b15a-48ac-4094-9ca2-193888228a92 tempest-VolumeAndVolumeTypeFromImageTest-1239773066 None] Lock "cinder-0d6029b1-adf8-49f9-8496-6b6e46e22860-delete_volume" released by "delete_volume" :: held 4.059s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:44:10 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-dc47568d-fff0-4521-a35c-d726866a79dc tempest-CreateVolumesFromSnapshotTest-1093373581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-99030091-ab42-4966-8f17-f06c73417ab3 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:44:10 devstack sudo[114634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-99030091-ab42-4966-8f17-f06c73417ab3 Jun 29 03:44:10 devstack sudo[114634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:44:11 devstack sudo[114634]: pam_unix(sudo:session): session closed for user root Jun 29 03:44:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-dc47568d-fff0-4521-a35c-d726866a79dc tempest-CreateVolumesFromSnapshotTest-1093373581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-99030091-ab42-4966-8f17-f06c73417ab3" returned: 0 in 0.690s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:44:11 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-dc47568d-fff0-4521-a35c-d726866a79dc tempest-CreateVolumesFromSnapshotTest-1093373581 None] <== create_volume: return (1866ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:44:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-dc47568d-fff0-4521-a35c-d726866a79dc tempest-CreateVolumesFromSnapshotTest-1093373581 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.870s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:44:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-0bcfee45-7f91-40a5-8407-83343afc5fe5 tempest-CreateVolumesFromSnapshotTest-1093373581 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.639s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:44:11 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-0bcfee45-7f91-40a5-8407-83343afc5fe5 tempest-CreateVolumesFromSnapshotTest-1093373581 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:44:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1724616446',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=437a9fc9-c23f-43b3-9ec7-addc166874eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64bb520d993e427c9c4490b050e40a72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:44:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:44:00Z,use_quota=True,user_id='998a078d10ae4063a2f3b87f6f1d255d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:44:11 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-0bcfee45-7f91-40a5-8407-83343afc5fe5 tempest-CreateVolumesFromSnapshotTest-1093373581 None] Creating volume 437a9fc9-c23f-43b3-9ec7-addc166874eb {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:44:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-0bcfee45-7f91-40a5-8407-83343afc5fe5 tempest-CreateVolumesFromSnapshotTest-1093373581 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:44:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-0bcfee45-7f91-40a5-8407-83343afc5fe5 tempest-CreateVolumesFromSnapshotTest-1093373581 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:44:11 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-0bcfee45-7f91-40a5-8407-83343afc5fe5 tempest-CreateVolumesFromSnapshotTest-1093373581 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:44:11 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-0bcfee45-7f91-40a5-8407-83343afc5fe5 tempest-CreateVolumesFromSnapshotTest-1093373581 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:44:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-0bcfee45-7f91-40a5-8407-83343afc5fe5 tempest-CreateVolumesFromSnapshotTest-1093373581 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:44:11 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-0bcfee45-7f91-40a5-8407-83343afc5fe5 tempest-CreateVolumesFromSnapshotTest-1093373581 None] Selected osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:44:11 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-0bcfee45-7f91-40a5-8407-83343afc5fe5 tempest-CreateVolumesFromSnapshotTest-1093373581 None] casted to osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f Jun 29 03:44:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-0bcfee45-7f91-40a5-8407-83343afc5fe5 tempest-CreateVolumesFromSnapshotTest-1093373581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-437a9fc9-c23f-43b3-9ec7-addc166874eb 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:44:11 devstack sudo[114637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-437a9fc9-c23f-43b3-9ec7-addc166874eb 1073741824 Jun 29 03:44:11 devstack sudo[114637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:44:11 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-dc47568d-fff0-4521-a35c-d726866a79dc tempest-CreateVolumesFromSnapshotTest-1093373581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fc8f77d-956e-4aba-a59d-ba8885e80e24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99030091-ab42-4966-8f17-f06c73417ab3', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:44:11 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-dc47568d-fff0-4521-a35c-d726866a79dc tempest-CreateVolumesFromSnapshotTest-1093373581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddf00f10-4643-4869-b480-6c68414e5fd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:44:11 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-dc47568d-fff0-4521-a35c-d726866a79dc tempest-CreateVolumesFromSnapshotTest-1093373581 None] Volume volume-99030091-ab42-4966-8f17-f06c73417ab3 (99030091-ab42-4966-8f17-f06c73417ab3): created successfully Jun 29 03:44:11 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-dc47568d-fff0-4521-a35c-d726866a79dc tempest-CreateVolumesFromSnapshotTest-1093373581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddf00f10-4643-4869-b480-6c68414e5fd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:44:11 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-dc47568d-fff0-4521-a35c-d726866a79dc tempest-CreateVolumesFromSnapshotTest-1093373581 None] Flow 'volume_create_manager' (0edfbe9f-c86b-4710-bf4c-a90bded49c66) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:44:11 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-dc47568d-fff0-4521-a35c-d726866a79dc tempest-CreateVolumesFromSnapshotTest-1093373581 None] Created volume successfully. Jun 29 03:44:11 devstack cinder-volume[93468]: DEBUG oslo_service.periodic_task [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93468) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 29 03:44:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:44:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:44:11 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:44:11 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:44:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:44:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:44:11 devstack sudo[114643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf Jun 29 03:44:11 devstack sudo[114643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:44:12 devstack sudo[114637]: pam_unix(sudo:session): session closed for user root Jun 29 03:44:12 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-0bcfee45-7f91-40a5-8407-83343afc5fe5 tempest-CreateVolumesFromSnapshotTest-1093373581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-437a9fc9-c23f-43b3-9ec7-addc166874eb 1073741824" returned: 0 in 1.052s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:44:12 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-0bcfee45-7f91-40a5-8407-83343afc5fe5 tempest-CreateVolumesFromSnapshotTest-1093373581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-437a9fc9-c23f-43b3-9ec7-addc166874eb {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:44:12 devstack sudo[114646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-437a9fc9-c23f-43b3-9ec7-addc166874eb Jun 29 03:44:12 devstack sudo[114646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:44:12 devstack sudo[114643]: pam_unix(sudo:session): session closed for user root Jun 29 03:44:12 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf" returned: 0 in 0.919s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:44:12 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:44:12 devstack cinder-volume[93468]: DEBUG oslo_service.periodic_task [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Running periodic task VolumeManager._thread_info {{(pid=93468) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 29 03:44:12 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] thread count: 28 {{(pid=93468) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 29 03:44:12 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] thread info: [<_MainThread(MainThread, started 132331377287296)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93468) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 29 03:44:13 devstack sudo[114646]: pam_unix(sudo:session): session closed for user root Jun 29 03:44:13 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-0bcfee45-7f91-40a5-8407-83343afc5fe5 tempest-CreateVolumesFromSnapshotTest-1093373581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-437a9fc9-c23f-43b3-9ec7-addc166874eb" returned: 0 in 0.832s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:44:13 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-0bcfee45-7f91-40a5-8407-83343afc5fe5 tempest-CreateVolumesFromSnapshotTest-1093373581 None] <== create_volume: return (1945ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:44:13 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-0bcfee45-7f91-40a5-8407-83343afc5fe5 tempest-CreateVolumesFromSnapshotTest-1093373581 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.951s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:44:13 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-a1c99802-7649-46d8-8f65-8b391e75245c tempest-VolumeDependencyTests-1245577734 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 7.709s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:44:13 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-a1c99802-7649-46d8-8f65-8b391e75245c tempest-VolumeDependencyTests-1245577734 None] Acquiring lock "cinder-quobyte-29cc1948-65a7-40e9-940e-6ec7933c4757-f6084173-ec5a-4172-8d3d-379f109afe8a" by "_create_volume_from_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:44:13 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-0bcfee45-7f91-40a5-8407-83343afc5fe5 tempest-CreateVolumesFromSnapshotTest-1093373581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f497fe16-bbe6-4aad-a44e-efdd6a9c8735) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-437a9fc9-c23f-43b3-9ec7-addc166874eb', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:44:13 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-0bcfee45-7f91-40a5-8407-83343afc5fe5 tempest-CreateVolumesFromSnapshotTest-1093373581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1acfaac3-5873-4380-accc-5c3ab4d11d31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:44:13 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-a1c99802-7649-46d8-8f65-8b391e75245c tempest-VolumeDependencyTests-1245577734 None] Lock "cinder-quobyte-29cc1948-65a7-40e9-940e-6ec7933c4757-f6084173-ec5a-4172-8d3d-379f109afe8a" acquired by "_create_volume_from_snapshot" :: waited 0.042s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:44:13 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-a1c99802-7649-46d8-8f65-8b391e75245c tempest-VolumeDependencyTests-1245577734 None] Creating volume f6084173-ec5a-4172-8d3d-379f109afe8a from snapshot 29cc1948-65a7-40e9-940e-6ec7933c4757 {{(pid=93468) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 29 03:44:13 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-a1c99802-7649-46d8-8f65-8b391e75245c tempest-VolumeDependencyTests-1245577734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:44:13 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-a1c99802-7649-46d8-8f65-8b391e75245c tempest-VolumeDependencyTests-1245577734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:44:13 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-a1c99802-7649-46d8-8f65-8b391e75245c tempest-VolumeDependencyTests-1245577734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:44:13 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-a1c99802-7649-46d8-8f65-8b391e75245c tempest-VolumeDependencyTests-1245577734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:44:13 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-a1c99802-7649-46d8-8f65-8b391e75245c tempest-VolumeDependencyTests-1245577734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:44:13 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-a1c99802-7649-46d8-8f65-8b391e75245c tempest-VolumeDependencyTests-1245577734 None] Selected osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:44:13 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-a1c99802-7649-46d8-8f65-8b391e75245c tempest-VolumeDependencyTests-1245577734 None] Acquiring lock "cinder-quobyte-f6084173-ec5a-4172-8d3d-379f109afe8a" by "_copy_volume_from_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:44:13 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-a1c99802-7649-46d8-8f65-8b391e75245c tempest-VolumeDependencyTests-1245577734 None] Lock "cinder-quobyte-f6084173-ec5a-4172-8d3d-379f109afe8a" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:44:13 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-a1c99802-7649-46d8-8f65-8b391e75245c tempest-VolumeDependencyTests-1245577734 None] snapshot: 29cc1948-65a7-40e9-940e-6ec7933c4757, volume: f6084173-ec5a-4172-8d3d-379f109afe8a, {{(pid=93468) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 29 03:44:13 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-0bcfee45-7f91-40a5-8407-83343afc5fe5 tempest-CreateVolumesFromSnapshotTest-1093373581 None] Volume volume-437a9fc9-c23f-43b3-9ec7-addc166874eb (437a9fc9-c23f-43b3-9ec7-addc166874eb): created successfully Jun 29 03:44:13 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-0bcfee45-7f91-40a5-8407-83343afc5fe5 tempest-CreateVolumesFromSnapshotTest-1093373581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1acfaac3-5873-4380-accc-5c3ab4d11d31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:44:13 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-0bcfee45-7f91-40a5-8407-83343afc5fe5 tempest-CreateVolumesFromSnapshotTest-1093373581 None] Flow 'volume_create_manager' (c18b0c99-35e6-4c90-8dd3-9dc4345ef25a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:44:13 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-a1c99802-7649-46d8-8f65-8b391e75245c tempest-VolumeDependencyTests-1245577734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:44:13 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-a1c99802-7649-46d8-8f65-8b391e75245c tempest-VolumeDependencyTests-1245577734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:44:13 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-a1c99802-7649-46d8-8f65-8b391e75245c tempest-VolumeDependencyTests-1245577734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:44:13 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-a1c99802-7649-46d8-8f65-8b391e75245c tempest-VolumeDependencyTests-1245577734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:44:13 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-a1c99802-7649-46d8-8f65-8b391e75245c tempest-VolumeDependencyTests-1245577734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:44:13 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-0bcfee45-7f91-40a5-8407-83343afc5fe5 tempest-CreateVolumesFromSnapshotTest-1093373581 None] Created volume successfully. Jun 29 03:44:13 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[028d42cd-a7c6-43b1-b2aa-d0353a6d78f2]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:44:13 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a1c99802-7649-46d8-8f65-8b391e75245c tempest-VolumeDependencyTests-1245577734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-1aad3d1f-6a61-4b52-a9a0-ddf7ca5fbe87.29cc1948-65a7-40e9-940e-6ec7933c4757 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:44:13 devstack sudo[114650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-1aad3d1f-6a61-4b52-a9a0-ddf7ca5fbe87.29cc1948-65a7-40e9-940e-6ec7933c4757 Jun 29 03:44:13 devstack sudo[114650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:44:13 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-2e958ad5-f33a-47b5-bae6-37483c3070d0 tempest-CreateVolumesFromSnapshotTest-1093373581 None] Acquiring lock "cinder-437a9fc9-c23f-43b3-9ec7-addc166874eb-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:44:13 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-2e958ad5-f33a-47b5-bae6-37483c3070d0 tempest-CreateVolumesFromSnapshotTest-1093373581 None] Lock "cinder-437a9fc9-c23f-43b3-9ec7-addc166874eb-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:44:13 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-2e958ad5-f33a-47b5-bae6-37483c3070d0 tempest-CreateVolumesFromSnapshotTest-1093373581 None] Acquiring lock "cinder-quobyte-437a9fc9-c23f-43b3-9ec7-addc166874eb" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:44:13 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-2e958ad5-f33a-47b5-bae6-37483c3070d0 tempest-CreateVolumesFromSnapshotTest-1093373581 None] Lock "cinder-quobyte-437a9fc9-c23f-43b3-9ec7-addc166874eb" acquired by "delete_volume" :: waited 0.020s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:44:13 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[17df4917-7123-45f0-8ef4-cd2f3cc66beb]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:44:13 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2e958ad5-f33a-47b5-bae6-37483c3070d0 tempest-CreateVolumesFromSnapshotTest-1093373581 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-437a9fc9-c23f-43b3-9ec7-addc166874eb {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:44:14 devstack sudo[114652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-437a9fc9-c23f-43b3-9ec7-addc166874eb Jun 29 03:44:14 devstack sudo[114652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:44:14 devstack sudo[114650]: pam_unix(sudo:session): session closed for user root Jun 29 03:44:14 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a1c99802-7649-46d8-8f65-8b391e75245c tempest-VolumeDependencyTests-1245577734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-1aad3d1f-6a61-4b52-a9a0-ddf7ca5fbe87.29cc1948-65a7-40e9-940e-6ec7933c4757" returned: 0 in 0.966s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:44:14 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-a1c99802-7649-46d8-8f65-8b391e75245c tempest-VolumeDependencyTests-1245577734 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1aad3d1f-6a61-4b52-a9a0-ddf7ca5fbe87(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93468) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 29 03:44:14 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-a1c99802-7649-46d8-8f65-8b391e75245c tempest-VolumeDependencyTests-1245577734 None] will copy from snapshot at /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-1aad3d1f-6a61-4b52-a9a0-ddf7ca5fbe87 {{(pid=93468) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 29 03:44:14 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-a1c99802-7649-46d8-8f65-8b391e75245c tempest-VolumeDependencyTests-1245577734 None] Creating direct copy from snapshot {{(pid=93468) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 29 03:44:14 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a83df89-050c-4e8b-b033-47cc86bc1ff6]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:44:14 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a1c99802-7649-46d8-8f65-8b391e75245c tempest-VolumeDependencyTests-1245577734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-1aad3d1f-6a61-4b52-a9a0-ddf7ca5fbe87 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:44:14 devstack sudo[114658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-1aad3d1f-6a61-4b52-a9a0-ddf7ca5fbe87 Jun 29 03:44:14 devstack sudo[114658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:44:14 devstack sudo[114652]: pam_unix(sudo:session): session closed for user root Jun 29 03:44:14 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2e958ad5-f33a-47b5-bae6-37483c3070d0 tempest-CreateVolumesFromSnapshotTest-1093373581 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-437a9fc9-c23f-43b3-9ec7-addc166874eb" returned: 0 in 1.106s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:44:14 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2e958ad5-f33a-47b5-bae6-37483c3070d0 tempest-CreateVolumesFromSnapshotTest-1093373581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-437a9fc9-c23f-43b3-9ec7-addc166874eb {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:44:15 devstack sudo[114663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-437a9fc9-c23f-43b3-9ec7-addc166874eb Jun 29 03:44:15 devstack sudo[114663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:44:15 devstack sudo[114658]: pam_unix(sudo:session): session closed for user root Jun 29 03:44:15 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a1c99802-7649-46d8-8f65-8b391e75245c tempest-VolumeDependencyTests-1245577734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-1aad3d1f-6a61-4b52-a9a0-ddf7ca5fbe87" returned: 0 in 1.103s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:44:15 devstack cinder-volume[93468]: DEBUG cinder.utils [None req-a1c99802-7649-46d8-8f65-8b391e75245c tempest-VolumeDependencyTests-1245577734 None] Path /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-f6084173-ec5a-4172-8d3d-379f109afe8a not found in is_blk_device check {{(pid=93468) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 29 03:44:15 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a1c99802-7649-46d8-8f65-8b391e75245c tempest-VolumeDependencyTests-1245577734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-1aad3d1f-6a61-4b52-a9a0-ddf7ca5fbe87 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-f6084173-ec5a-4172-8d3d-379f109afe8a {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:44:15 devstack sudo[114668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-1aad3d1f-6a61-4b52-a9a0-ddf7ca5fbe87 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-f6084173-ec5a-4172-8d3d-379f109afe8a Jun 29 03:44:15 devstack sudo[114668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:44:16 devstack sudo[114663]: pam_unix(sudo:session): session closed for user root Jun 29 03:44:16 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2e958ad5-f33a-47b5-bae6-37483c3070d0 tempest-CreateVolumesFromSnapshotTest-1093373581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-437a9fc9-c23f-43b3-9ec7-addc166874eb" returned: 0 in 1.032s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:44:16 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-2e958ad5-f33a-47b5-bae6-37483c3070d0 tempest-CreateVolumesFromSnapshotTest-1093373581 None] Lock "cinder-quobyte-437a9fc9-c23f-43b3-9ec7-addc166874eb" released by "delete_volume" :: held 2.186s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:44:16 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-2e958ad5-f33a-47b5-bae6-37483c3070d0 tempest-CreateVolumesFromSnapshotTest-1093373581 None] Created reservations ['ca9601d8-58eb-4eb1-8b82-6e890cc99754', 'c22e7f1e-fc85-453b-8d75-673bb4e9ded1', '61bc8278-5ca4-4591-9d90-967f0ceeeaca', '6d598c37-70d7-474f-ab46-8528da3ae5cf'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:44:16 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-2e958ad5-f33a-47b5-bae6-37483c3070d0 tempest-CreateVolumesFromSnapshotTest-1093373581 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:44:16 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-2e958ad5-f33a-47b5-bae6-37483c3070d0 tempest-CreateVolumesFromSnapshotTest-1093373581 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:44:16 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-2e958ad5-f33a-47b5-bae6-37483c3070d0 tempest-CreateVolumesFromSnapshotTest-1093373581 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:44:16 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-2e958ad5-f33a-47b5-bae6-37483c3070d0 tempest-CreateVolumesFromSnapshotTest-1093373581 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:44:16 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-2e958ad5-f33a-47b5-bae6-37483c3070d0 tempest-CreateVolumesFromSnapshotTest-1093373581 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:44:16 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2e958ad5-f33a-47b5-bae6-37483c3070d0 tempest-CreateVolumesFromSnapshotTest-1093373581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:44:16 devstack sudo[114674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf Jun 29 03:44:16 devstack sudo[114674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:44:17 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-d4ed22d0-9049-4731-b086-075293dfd40d tempest-CreateVolumesFromSnapshotTest-1093373581 None] Acquiring lock "cinder-99030091-ab42-4966-8f17-f06c73417ab3-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:44:17 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-d4ed22d0-9049-4731-b086-075293dfd40d tempest-CreateVolumesFromSnapshotTest-1093373581 None] Lock "cinder-99030091-ab42-4966-8f17-f06c73417ab3-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:44:17 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-d4ed22d0-9049-4731-b086-075293dfd40d tempest-CreateVolumesFromSnapshotTest-1093373581 None] Acquiring lock "cinder-quobyte-99030091-ab42-4966-8f17-f06c73417ab3" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:44:17 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-d4ed22d0-9049-4731-b086-075293dfd40d tempest-CreateVolumesFromSnapshotTest-1093373581 None] Lock "cinder-quobyte-99030091-ab42-4966-8f17-f06c73417ab3" acquired by "delete_volume" :: waited 0.045s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:44:17 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[57502d4d-5f7d-477b-9a0f-512063f53f11]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:44:17 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d4ed22d0-9049-4731-b086-075293dfd40d tempest-CreateVolumesFromSnapshotTest-1093373581 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-99030091-ab42-4966-8f17-f06c73417ab3 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:44:17 devstack sudo[114685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-99030091-ab42-4966-8f17-f06c73417ab3 Jun 29 03:44:17 devstack sudo[114685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:44:18 devstack sudo[114674]: pam_unix(sudo:session): session closed for user root Jun 29 03:44:18 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2e958ad5-f33a-47b5-bae6-37483c3070d0 tempest-CreateVolumesFromSnapshotTest-1093373581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf" returned: 0 in 2.436s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:44:18 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-2e958ad5-f33a-47b5-bae6-37483c3070d0 tempest-CreateVolumesFromSnapshotTest-1093373581 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:44:18 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-2e958ad5-f33a-47b5-bae6-37483c3070d0 tempest-CreateVolumesFromSnapshotTest-1093373581 None] Deleted volume successfully. Jun 29 03:44:18 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-2e958ad5-f33a-47b5-bae6-37483c3070d0 tempest-CreateVolumesFromSnapshotTest-1093373581 None] Lock "cinder-437a9fc9-c23f-43b3-9ec7-addc166874eb-delete_volume" released by "delete_volume" :: held 4.936s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:44:18 devstack sudo[114685]: pam_unix(sudo:session): session closed for user root Jun 29 03:44:18 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d4ed22d0-9049-4731-b086-075293dfd40d tempest-CreateVolumesFromSnapshotTest-1093373581 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-99030091-ab42-4966-8f17-f06c73417ab3" returned: 0 in 1.411s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:44:18 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d4ed22d0-9049-4731-b086-075293dfd40d tempest-CreateVolumesFromSnapshotTest-1093373581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-99030091-ab42-4966-8f17-f06c73417ab3 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:44:19 devstack sudo[114691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-99030091-ab42-4966-8f17-f06c73417ab3 Jun 29 03:44:19 devstack sudo[114691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:44:21 devstack sudo[114691]: pam_unix(sudo:session): session closed for user root Jun 29 03:44:21 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d4ed22d0-9049-4731-b086-075293dfd40d tempest-CreateVolumesFromSnapshotTest-1093373581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-99030091-ab42-4966-8f17-f06c73417ab3" returned: 0 in 2.470s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:44:21 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-d4ed22d0-9049-4731-b086-075293dfd40d tempest-CreateVolumesFromSnapshotTest-1093373581 None] Lock "cinder-quobyte-99030091-ab42-4966-8f17-f06c73417ab3" released by "delete_volume" :: held 3.993s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:44:21 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-d4ed22d0-9049-4731-b086-075293dfd40d tempest-CreateVolumesFromSnapshotTest-1093373581 None] Created reservations ['49980de8-add2-4a42-98c8-c2ff67e48954', '1349f74b-1069-4b6c-bfd1-cb9a153de2e2', '621c333a-dda8-480e-a9bb-6112e4161324', '2a36c3f1-79e2-4aa5-b7a0-f3f727082886'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:44:22 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-d4ed22d0-9049-4731-b086-075293dfd40d tempest-CreateVolumesFromSnapshotTest-1093373581 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:44:22 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-d4ed22d0-9049-4731-b086-075293dfd40d tempest-CreateVolumesFromSnapshotTest-1093373581 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:44:22 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-d4ed22d0-9049-4731-b086-075293dfd40d tempest-CreateVolumesFromSnapshotTest-1093373581 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:44:22 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-d4ed22d0-9049-4731-b086-075293dfd40d tempest-CreateVolumesFromSnapshotTest-1093373581 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:44:22 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-d4ed22d0-9049-4731-b086-075293dfd40d tempest-CreateVolumesFromSnapshotTest-1093373581 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:44:22 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d4ed22d0-9049-4731-b086-075293dfd40d tempest-CreateVolumesFromSnapshotTest-1093373581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:44:22 devstack sudo[114697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf Jun 29 03:44:22 devstack sudo[114697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:44:22 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-21f61b97-0af2-412c-8e5f-ea0a9564678f tempest-CreateVolumesFromSnapshotTest-1093373581 None] Acquiring lock "cinder-49966b9a-3398-4ae6-8747-519f7e8d490f-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:44:22 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-21f61b97-0af2-412c-8e5f-ea0a9564678f tempest-CreateVolumesFromSnapshotTest-1093373581 None] Lock "cinder-49966b9a-3398-4ae6-8747-519f7e8d490f-delete_volume" acquired by "delete_volume" :: waited 0.103s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:44:22 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-1794af17-87f0-4e0f-ac48-0f70d89ace91 tempest-VolumeImageDependencyTests-415092953 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:44:22 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-1794af17-87f0-4e0f-ac48-0f70d89ace91 tempest-VolumeImageDependencyTests-415092953 None] Flow 'volume_create_manager' (dcc0176b-ef51-45a5-97d2-57feeedc6527) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:44:22 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-1794af17-87f0-4e0f-ac48-0f70d89ace91 tempest-VolumeImageDependencyTests-415092953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4757e70-bb68-478a-9a82-5b7e181ce93b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:44:22 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-21f61b97-0af2-412c-8e5f-ea0a9564678f tempest-CreateVolumesFromSnapshotTest-1093373581 None] Acquiring lock "cinder-quobyte-49966b9a-3398-4ae6-8747-519f7e8d490f" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:44:22 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-1794af17-87f0-4e0f-ac48-0f70d89ace91 tempest-VolumeImageDependencyTests-415092953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4757e70-bb68-478a-9a82-5b7e181ce93b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:44:22Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99a2aa65-6bc4-454d-83d6-2751a5bf7d04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad83370ab78f4d0698a55dd1b02b5bcc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:44:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:44:23Z,use_quota=True,user_id='3b6469cb5ee149f4afab81d3c1217593',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:44:22 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-1794af17-87f0-4e0f-ac48-0f70d89ace91 tempest-VolumeImageDependencyTests-415092953 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cff886fe-702c-48c8-8ed5-952ca21818b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:44:22 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-1794af17-87f0-4e0f-ac48-0f70d89ace91 tempest-VolumeImageDependencyTests-415092953 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cff886fe-702c-48c8-8ed5-952ca21818b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:44:22 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-1794af17-87f0-4e0f-ac48-0f70d89ace91 tempest-VolumeImageDependencyTests-415092953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77d596f7-4298-41c6-be72-3bd0906acc3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:44:22 devstack cinder-volume[93468]: DEBUG cinder.image.glance [None req-1794af17-87f0-4e0f-ac48-0f70d89ace91 tempest-VolumeImageDependencyTests-415092953 None] Creating Keystone auth plugin from conf {{(pid=93468) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 29 03:44:22 devstack sudo[114668]: pam_unix(sudo:session): session closed for user root Jun 29 03:44:22 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-21f61b97-0af2-412c-8e5f-ea0a9564678f tempest-CreateVolumesFromSnapshotTest-1093373581 None] Lock "cinder-quobyte-49966b9a-3398-4ae6-8747-519f7e8d490f" acquired by "delete_volume" :: waited 0.074s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:44:22 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a1c99802-7649-46d8-8f65-8b391e75245c tempest-VolumeDependencyTests-1245577734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-1aad3d1f-6a61-4b52-a9a0-ddf7ca5fbe87 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-f6084173-ec5a-4172-8d3d-379f109afe8a" returned: 0 in 7.599s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:44:22 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cd77c88-b94c-46bd-aca7-16aeca74fc95]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:44:22 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a1c99802-7649-46d8-8f65-8b391e75245c tempest-VolumeDependencyTests-1245577734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-1aad3d1f-6a61-4b52-a9a0-ddf7ca5fbe87 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:44:23 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c37c8da-600d-4b61-8fc7-37c3831674d9]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:44:23 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-21f61b97-0af2-412c-8e5f-ea0a9564678f tempest-CreateVolumesFromSnapshotTest-1093373581 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-49966b9a-3398-4ae6-8747-519f7e8d490f {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:44:23 devstack sudo[114700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-1aad3d1f-6a61-4b52-a9a0-ddf7ca5fbe87 Jun 29 03:44:23 devstack sudo[114700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:44:23 devstack sudo[114701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-49966b9a-3398-4ae6-8747-519f7e8d490f Jun 29 03:44:23 devstack sudo[114701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:44:23 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-1794af17-87f0-4e0f-ac48-0f70d89ace91 tempest-VolumeImageDependencyTests-415092953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77d596f7-4298-41c6-be72-3bd0906acc3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '99a2aa65-6bc4-454d-83d6-2751a5bf7d04', 'volume_name': 'volume-99a2aa65-6bc4-454d-83d6-2751a5bf7d04', 'volume_size': 1, 'image_id': 'fa0d190d-d915-4772-ad50-268a7ef5854a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fa0d190d-d915-4772-ad50-268a7ef5854a', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '916054516817b4d66462fc52a94d2e6a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'ad83370ab78f4d0698a55dd1b02b5bcc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'aca68fba745cb71524b955ea622ec7233ae923fdc0e82db58a3c1ed165679f62f65f9c2b5dedd1599a147bdc167aa49f9bd62b5bcfecb82864a07ec8d4c9aed3', 'id': 'fa0d190d-d915-4772-ad50-268a7ef5854a', 'created_at': datetime.datetime(2026, 6, 29, 1, 44, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 29, 1, 44, 19, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fa0d190d-d915-4772-ad50-268a7ef5854a/file', 'properties': {}}, 'image_service': }' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:44:23 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-1794af17-87f0-4e0f-ac48-0f70d89ace91 tempest-VolumeImageDependencyTests-415092953 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25ca5141-ff18-4374-bed3-b84ce72df339) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:44:23 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-1794af17-87f0-4e0f-ac48-0f70d89ace91 tempest-VolumeImageDependencyTests-415092953 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25ca5141-ff18-4374-bed3-b84ce72df339) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:44:23 devstack sudo[114697]: pam_unix(sudo:session): session closed for user root Jun 29 03:44:23 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-1794af17-87f0-4e0f-ac48-0f70d89ace91 tempest-VolumeImageDependencyTests-415092953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3924eab6-9ebd-403c-825d-bfd1210a4288) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:44:23 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-1794af17-87f0-4e0f-ac48-0f70d89ace91 tempest-VolumeImageDependencyTests-415092953 None] Volume 99a2aa65-6bc4-454d-83d6-2751a5bf7d04: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-99a2aa65-6bc4-454d-83d6-2751a5bf7d04', 'volume_size': 1, 'image_id': 'fa0d190d-d915-4772-ad50-268a7ef5854a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fa0d190d-d915-4772-ad50-268a7ef5854a', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '916054516817b4d66462fc52a94d2e6a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'ad83370ab78f4d0698a55dd1b02b5bcc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'aca68fba745cb71524b955ea622ec7233ae923fdc0e82db58a3c1ed165679f62f65f9c2b5dedd1599a147bdc167aa49f9bd62b5bcfecb82864a07ec8d4c9aed3', 'id': 'fa0d190d-d915-4772-ad50-268a7ef5854a', 'created_at': datetime.datetime(2026, 6, 29, 1, 44, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 29, 1, 44, 19, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fa0d190d-d915-4772-ad50-268a7ef5854a/file', 'properties': {}}, 'image_service': } Jun 29 03:44:23 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-1794af17-87f0-4e0f-ac48-0f70d89ace91 tempest-VolumeImageDependencyTests-415092953 None] Trying to clone 99a2aa65-6bc4-454d-83d6-2751a5bf7d04 from image fa0d190d-d915-4772-ad50-268a7ef5854a at location (None, [{'url': 'file:///opt/stack/data/glance/images/fa0d190d-d915-4772-ad50-268a7ef5854a', 'metadata': {}}]). {{(pid=93468) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 29 03:44:23 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d4ed22d0-9049-4731-b086-075293dfd40d tempest-CreateVolumesFromSnapshotTest-1093373581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf" returned: 0 in 1.408s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:44:23 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-d4ed22d0-9049-4731-b086-075293dfd40d tempest-CreateVolumesFromSnapshotTest-1093373581 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:44:23 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-d4ed22d0-9049-4731-b086-075293dfd40d tempest-CreateVolumesFromSnapshotTest-1093373581 None] Deleted volume successfully. Jun 29 03:44:23 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-d4ed22d0-9049-4731-b086-075293dfd40d tempest-CreateVolumesFromSnapshotTest-1093373581 None] Lock "cinder-99030091-ab42-4966-8f17-f06c73417ab3-delete_volume" released by "delete_volume" :: held 6.088s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:44:23 devstack cinder-volume[93468]: DEBUG cinder.image.image_utils [None req-1794af17-87f0-4e0f-ac48-0f70d89ace91 tempest-VolumeImageDependencyTests-415092953 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_fa0d190d-d915-4772-ad50-268a7ef5854a__7_jmvbjdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=93468) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 29 03:44:23 devstack cinder-volume[93468]: INFO cinder.image.image_utils [None req-1794af17-87f0-4e0f-ac48-0f70d89ace91 tempest-VolumeImageDependencyTests-415092953 None] Image download 0.00 MB at 0.00 MB/s Jun 29 03:44:23 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[17fb9691-594e-4144-97e8-62faaddaffc0]: (4, 'raw') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:44:23 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-1794af17-87f0-4e0f-ac48-0f70d89ace91 tempest-VolumeImageDependencyTests-415092953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fa0d190d-d915-4772-ad50-268a7ef5854a__7_jmvbjdevstack@QuobyteHD {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:44:23 devstack sudo[114705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fa0d190d-d915-4772-ad50-268a7ef5854a__7_jmvbjdevstack@QuobyteHD Jun 29 03:44:23 devstack sudo[114705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:44:24 devstack sudo[114701]: pam_unix(sudo:session): session closed for user root Jun 29 03:44:24 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-21f61b97-0af2-412c-8e5f-ea0a9564678f tempest-CreateVolumesFromSnapshotTest-1093373581 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-49966b9a-3398-4ae6-8747-519f7e8d490f" returned: 0 in 1.093s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:44:24 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-21f61b97-0af2-412c-8e5f-ea0a9564678f tempest-CreateVolumesFromSnapshotTest-1093373581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-49966b9a-3398-4ae6-8747-519f7e8d490f {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:44:24 devstack sudo[114712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-49966b9a-3398-4ae6-8747-519f7e8d490f Jun 29 03:44:24 devstack sudo[114712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:44:24 devstack sudo[114700]: pam_unix(sudo:session): session closed for user root Jun 29 03:44:24 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a1c99802-7649-46d8-8f65-8b391e75245c tempest-VolumeDependencyTests-1245577734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-1aad3d1f-6a61-4b52-a9a0-ddf7ca5fbe87" returned: 0 in 1.450s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:44:24 devstack cinder-volume[93468]: DEBUG cinder.image.image_utils [None req-a1c99802-7649-46d8-8f65-8b391e75245c tempest-VolumeDependencyTests-1245577734 None] Image conversion details: src /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-1aad3d1f-6a61-4b52-a9a0-ddf7ca5fbe87, size 1024.00 MB, duration 7.60 sec, destination /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-f6084173-ec5a-4172-8d3d-379f109afe8a {{(pid=93468) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 29 03:44:24 devstack cinder-volume[93468]: INFO cinder.image.image_utils [None req-a1c99802-7649-46d8-8f65-8b391e75245c tempest-VolumeDependencyTests-1245577734 None] Converted 1024.00 MB image at 134.74 MB/s Jun 29 03:44:24 devstack cinder-volume[93468]: WARNING cinder.volume.drivers.remotefs [None req-a1c99802-7649-46d8-8f65-8b391e75245c tempest-VolumeDependencyTests-1245577734 None] /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-f6084173-ec5a-4172-8d3d-379f109afe8a is being set with open permissions: ugo+rw Jun 29 03:44:24 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a1c99802-7649-46d8-8f65-8b391e75245c tempest-VolumeDependencyTests-1245577734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-f6084173-ec5a-4172-8d3d-379f109afe8a {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:44:24 devstack sudo[114715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-f6084173-ec5a-4172-8d3d-379f109afe8a Jun 29 03:44:24 devstack sudo[114715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:44:24 devstack sudo[114705]: pam_unix(sudo:session): session closed for user root Jun 29 03:44:24 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-1794af17-87f0-4e0f-ac48-0f70d89ace91 tempest-VolumeImageDependencyTests-415092953 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fa0d190d-d915-4772-ad50-268a7ef5854a__7_jmvbjdevstack@QuobyteHD" returned: 0 in 1.037s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:44:24 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-1794af17-87f0-4e0f-ac48-0f70d89ace91 tempest-VolumeImageDependencyTests-415092953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fa0d190d-d915-4772-ad50-268a7ef5854a__7_jmvbjdevstack@QuobyteHD {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:44:24 devstack sudo[114719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fa0d190d-d915-4772-ad50-268a7ef5854a__7_jmvbjdevstack@QuobyteHD Jun 29 03:44:24 devstack sudo[114719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:44:24 devstack sudo[114712]: pam_unix(sudo:session): session closed for user root Jun 29 03:44:24 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-21f61b97-0af2-412c-8e5f-ea0a9564678f tempest-CreateVolumesFromSnapshotTest-1093373581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-49966b9a-3398-4ae6-8747-519f7e8d490f" returned: 0 in 0.797s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:44:24 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-21f61b97-0af2-412c-8e5f-ea0a9564678f tempest-CreateVolumesFromSnapshotTest-1093373581 None] Lock "cinder-quobyte-49966b9a-3398-4ae6-8747-519f7e8d490f" released by "delete_volume" :: held 1.967s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:44:25 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-21f61b97-0af2-412c-8e5f-ea0a9564678f tempest-CreateVolumesFromSnapshotTest-1093373581 None] Created reservations ['cfc7a9aa-0292-49e1-bf1a-d4297acca590', 'dabc5ad1-9de2-4f48-b193-02b3adca3ac0', 'e54bf5c2-f598-4b45-a99b-40651f08bc0f', '43004760-08e2-41d6-8f1d-52613d1efb91'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:44:25 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-21f61b97-0af2-412c-8e5f-ea0a9564678f tempest-CreateVolumesFromSnapshotTest-1093373581 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:44:25 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-21f61b97-0af2-412c-8e5f-ea0a9564678f tempest-CreateVolumesFromSnapshotTest-1093373581 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:44:25 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-21f61b97-0af2-412c-8e5f-ea0a9564678f tempest-CreateVolumesFromSnapshotTest-1093373581 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:44:25 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-21f61b97-0af2-412c-8e5f-ea0a9564678f tempest-CreateVolumesFromSnapshotTest-1093373581 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:44:25 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-21f61b97-0af2-412c-8e5f-ea0a9564678f tempest-CreateVolumesFromSnapshotTest-1093373581 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:44:25 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-21f61b97-0af2-412c-8e5f-ea0a9564678f tempest-CreateVolumesFromSnapshotTest-1093373581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:44:25 devstack sudo[114723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf Jun 29 03:44:25 devstack sudo[114723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:44:25 devstack sudo[114715]: pam_unix(sudo:session): session closed for user root Jun 29 03:44:25 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a1c99802-7649-46d8-8f65-8b391e75245c tempest-VolumeDependencyTests-1245577734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-f6084173-ec5a-4172-8d3d-379f109afe8a" returned: 0 in 0.806s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:44:25 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-a1c99802-7649-46d8-8f65-8b391e75245c tempest-VolumeDependencyTests-1245577734 None] Lock "cinder-quobyte-f6084173-ec5a-4172-8d3d-379f109afe8a" released by "_copy_volume_from_snapshot" :: held 12.079s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:44:25 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-a1c99802-7649-46d8-8f65-8b391e75245c tempest-VolumeDependencyTests-1245577734 None] Lock "cinder-quobyte-29cc1948-65a7-40e9-940e-6ec7933c4757-f6084173-ec5a-4172-8d3d-379f109afe8a" released by "_create_volume_from_snapshot" :: held 12.120s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:44:25 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-a1c99802-7649-46d8-8f65-8b391e75245c tempest-VolumeDependencyTests-1245577734 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.166s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:44:25 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-a1c99802-7649-46d8-8f65-8b391e75245c tempest-VolumeDependencyTests-1245577734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07941ea6-cf25-4f02-bba5-c120ef3d71d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6084173-ec5a-4172-8d3d-379f109afe8a', 'volume_size': 1, 'snapshot_id': '29cc1948-65a7-40e9-940e-6ec7933c4757'}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:44:25 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-a1c99802-7649-46d8-8f65-8b391e75245c tempest-VolumeDependencyTests-1245577734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df660dd8-13ad-488a-830f-f7f888431628) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:44:25 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-a1c99802-7649-46d8-8f65-8b391e75245c tempest-VolumeDependencyTests-1245577734 None] Volume volume-f6084173-ec5a-4172-8d3d-379f109afe8a (f6084173-ec5a-4172-8d3d-379f109afe8a): created successfully Jun 29 03:44:25 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-a1c99802-7649-46d8-8f65-8b391e75245c tempest-VolumeDependencyTests-1245577734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df660dd8-13ad-488a-830f-f7f888431628) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:44:25 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-a1c99802-7649-46d8-8f65-8b391e75245c tempest-VolumeDependencyTests-1245577734 None] Flow 'volume_create_manager' (14b3fb7d-cc53-40e8-a8e9-3a9008918804) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:44:25 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-a1c99802-7649-46d8-8f65-8b391e75245c tempest-VolumeDependencyTests-1245577734 None] Created volume successfully. Jun 29 03:44:25 devstack sudo[114719]: pam_unix(sudo:session): session closed for user root Jun 29 03:44:25 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-1794af17-87f0-4e0f-ac48-0f70d89ace91 tempest-VolumeImageDependencyTests-415092953 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fa0d190d-d915-4772-ad50-268a7ef5854a__7_jmvbjdevstack@QuobyteHD" returned: 1 in 0.875s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:44:25 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-1794af17-87f0-4e0f-ac48-0f70d89ace91 tempest-VolumeImageDependencyTests-415092953 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fa0d190d-d915-4772-ad50-268a7ef5854a__7_jmvbjdevstack@QuobyteHD' failed. Not Retrying. {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 29 03:44:25 devstack cinder-volume[93468]: DEBUG cinder.image.image_utils [None req-1794af17-87f0-4e0f-ac48-0f70d89ace91 tempest-VolumeImageDependencyTests-415092953 None] Temporary image fa0d190d-d915-4772-ad50-268a7ef5854a is fetched for user 3b6469cb5ee149f4afab81d3c1217593. {{(pid=93468) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 29 03:44:25 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9911f89-4d15-477a-9b10-a001edff540e]: (4, 'raw') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:44:25 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-1794af17-87f0-4e0f-ac48-0f70d89ace91 tempest-VolumeImageDependencyTests-415092953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fa0d190d-d915-4772-ad50-268a7ef5854a__7_jmvbjdevstack@QuobyteHD {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:44:25 devstack sudo[114728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fa0d190d-d915-4772-ad50-268a7ef5854a__7_jmvbjdevstack@QuobyteHD Jun 29 03:44:25 devstack sudo[114728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:44:25 devstack sudo[114723]: pam_unix(sudo:session): session closed for user root Jun 29 03:44:25 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-21f61b97-0af2-412c-8e5f-ea0a9564678f tempest-CreateVolumesFromSnapshotTest-1093373581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf" returned: 0 in 0.782s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:44:25 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-21f61b97-0af2-412c-8e5f-ea0a9564678f tempest-CreateVolumesFromSnapshotTest-1093373581 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:44:25 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-21f61b97-0af2-412c-8e5f-ea0a9564678f tempest-CreateVolumesFromSnapshotTest-1093373581 None] Deleted volume successfully. Jun 29 03:44:25 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-21f61b97-0af2-412c-8e5f-ea0a9564678f tempest-CreateVolumesFromSnapshotTest-1093373581 None] Lock "cinder-49966b9a-3398-4ae6-8747-519f7e8d490f-delete_volume" released by "delete_volume" :: held 3.259s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:44:26 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-785a6d30-0345-4da3-8029-aced4246dfad tempest-CreateVolumesFromSnapshotTest-1093373581 None] Acquiring lock "cinder-d719f89f-317b-493f-8498-9984506f0903-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:44:26 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-785a6d30-0345-4da3-8029-aced4246dfad tempest-CreateVolumesFromSnapshotTest-1093373581 None] Lock "cinder-d719f89f-317b-493f-8498-9984506f0903-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:44:26 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-785a6d30-0345-4da3-8029-aced4246dfad tempest-CreateVolumesFromSnapshotTest-1093373581 None] Acquiring lock "cinder-quobyte-d719f89f-317b-493f-8498-9984506f0903" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:44:26 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-785a6d30-0345-4da3-8029-aced4246dfad tempest-CreateVolumesFromSnapshotTest-1093373581 None] Lock "cinder-quobyte-d719f89f-317b-493f-8498-9984506f0903" acquired by "delete_volume" :: waited 0.037s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:44:26 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbf2fb96-9a02-4e22-82dc-d70e3ed02d86]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:44:26 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-785a6d30-0345-4da3-8029-aced4246dfad tempest-CreateVolumesFromSnapshotTest-1093373581 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-d719f89f-317b-493f-8498-9984506f0903 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:44:26 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-cab3a4d4-22c3-4293-9ff0-52b45da14a2b tempest-VolumeDependencyTests-1245577734 None] Acquiring lock "cinder-29cc1948-65a7-40e9-940e-6ec7933c4757-delete_snapshot" by "delete_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:44:26 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-cab3a4d4-22c3-4293-9ff0-52b45da14a2b tempest-VolumeDependencyTests-1245577734 None] Lock "cinder-29cc1948-65a7-40e9-940e-6ec7933c4757-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:44:26 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-cab3a4d4-22c3-4293-9ff0-52b45da14a2b tempest-VolumeDependencyTests-1245577734 None] Acquiring lock "cinder-quobyte-1aad3d1f-6a61-4b52-a9a0-ddf7ca5fbe87" by "delete_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:44:26 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-cab3a4d4-22c3-4293-9ff0-52b45da14a2b tempest-VolumeDependencyTests-1245577734 None] Lock "cinder-quobyte-1aad3d1f-6a61-4b52-a9a0-ddf7ca5fbe87" acquired by "delete_snapshot" :: waited 0.021s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:44:26 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-cab3a4d4-22c3-4293-9ff0-52b45da14a2b tempest-VolumeDependencyTests-1245577734 None] Acquiring lock "cinder-quobyte-29cc1948-65a7-40e9-940e-6ec7933c4757" by "_delete_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:44:26 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-cab3a4d4-22c3-4293-9ff0-52b45da14a2b tempest-VolumeDependencyTests-1245577734 None] Lock "cinder-quobyte-29cc1948-65a7-40e9-940e-6ec7933c4757" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:44:26 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-cab3a4d4-22c3-4293-9ff0-52b45da14a2b tempest-VolumeDependencyTests-1245577734 None] Deleting offline snapshot 29cc1948-65a7-40e9-940e-6ec7933c4757 of volume 1aad3d1f-6a61-4b52-a9a0-ddf7ca5fbe87 {{(pid=93468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 29 03:44:26 devstack sudo[114731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-d719f89f-317b-493f-8498-9984506f0903 Jun 29 03:44:26 devstack sudo[114731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:44:26 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-cab3a4d4-22c3-4293-9ff0-52b45da14a2b tempest-VolumeDependencyTests-1245577734 None] snapshot_file for this snap is: volume-1aad3d1f-6a61-4b52-a9a0-ddf7ca5fbe87.29cc1948-65a7-40e9-940e-6ec7933c4757 {{(pid=93468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 29 03:44:26 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[04f13f6f-c81e-46f3-8203-a82987ca4786]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:44:26 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-cab3a4d4-22c3-4293-9ff0-52b45da14a2b tempest-VolumeDependencyTests-1245577734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-1aad3d1f-6a61-4b52-a9a0-ddf7ca5fbe87.29cc1948-65a7-40e9-940e-6ec7933c4757 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:44:26 devstack sudo[114728]: pam_unix(sudo:session): session closed for user root Jun 29 03:44:26 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-1794af17-87f0-4e0f-ac48-0f70d89ace91 tempest-VolumeImageDependencyTests-415092953 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fa0d190d-d915-4772-ad50-268a7ef5854a__7_jmvbjdevstack@QuobyteHD" returned: 0 in 0.881s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:44:26 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-1794af17-87f0-4e0f-ac48-0f70d89ace91 tempest-VolumeImageDependencyTests-415092953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fa0d190d-d915-4772-ad50-268a7ef5854a__7_jmvbjdevstack@QuobyteHD {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:44:26 devstack sudo[114735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-1aad3d1f-6a61-4b52-a9a0-ddf7ca5fbe87.29cc1948-65a7-40e9-940e-6ec7933c4757 Jun 29 03:44:26 devstack sudo[114735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:44:26 devstack sudo[114736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fa0d190d-d915-4772-ad50-268a7ef5854a__7_jmvbjdevstack@QuobyteHD Jun 29 03:44:26 devstack sudo[114736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:44:27 devstack sudo[114731]: pam_unix(sudo:session): session closed for user root Jun 29 03:44:27 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-785a6d30-0345-4da3-8029-aced4246dfad tempest-CreateVolumesFromSnapshotTest-1093373581 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-d719f89f-317b-493f-8498-9984506f0903" returned: 0 in 1.141s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:44:27 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-785a6d30-0345-4da3-8029-aced4246dfad tempest-CreateVolumesFromSnapshotTest-1093373581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-d719f89f-317b-493f-8498-9984506f0903 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:44:27 devstack sudo[114735]: pam_unix(sudo:session): session closed for user root Jun 29 03:44:27 devstack sudo[114736]: pam_unix(sudo:session): session closed for user root Jun 29 03:44:27 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-cab3a4d4-22c3-4293-9ff0-52b45da14a2b tempest-VolumeDependencyTests-1245577734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-1aad3d1f-6a61-4b52-a9a0-ddf7ca5fbe87.29cc1948-65a7-40e9-940e-6ec7933c4757" returned: 0 in 0.968s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:44:27 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-cab3a4d4-22c3-4293-9ff0-52b45da14a2b tempest-VolumeDependencyTests-1245577734 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1aad3d1f-6a61-4b52-a9a0-ddf7ca5fbe87(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93468) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 29 03:44:27 devstack sudo[114755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-d719f89f-317b-493f-8498-9984506f0903 Jun 29 03:44:27 devstack sudo[114755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:44:27 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-1794af17-87f0-4e0f-ac48-0f70d89ace91 tempest-VolumeImageDependencyTests-415092953 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fa0d190d-d915-4772-ad50-268a7ef5854a__7_jmvbjdevstack@QuobyteHD" returned: 1 in 0.930s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:44:27 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-1794af17-87f0-4e0f-ac48-0f70d89ace91 tempest-VolumeImageDependencyTests-415092953 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fa0d190d-d915-4772-ad50-268a7ef5854a__7_jmvbjdevstack@QuobyteHD' failed. Not Retrying. {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 29 03:44:27 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-1794af17-87f0-4e0f-ac48-0f70d89ace91 tempest-VolumeImageDependencyTests-415092953 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:44:27 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-1794af17-87f0-4e0f-ac48-0f70d89ace91 tempest-VolumeImageDependencyTests-415092953 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:44:27 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-1794af17-87f0-4e0f-ac48-0f70d89ace91 tempest-VolumeImageDependencyTests-415092953 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:44:22Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99a2aa65-6bc4-454d-83d6-2751a5bf7d04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad83370ab78f4d0698a55dd1b02b5bcc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:44:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:44:23Z,use_quota=True,user_id='3b6469cb5ee149f4afab81d3c1217593',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:44:27 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-1794af17-87f0-4e0f-ac48-0f70d89ace91 tempest-VolumeImageDependencyTests-415092953 None] Creating volume 99a2aa65-6bc4-454d-83d6-2751a5bf7d04 {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:44:27 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-1794af17-87f0-4e0f-ac48-0f70d89ace91 tempest-VolumeImageDependencyTests-415092953 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:44:27 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-1794af17-87f0-4e0f-ac48-0f70d89ace91 tempest-VolumeImageDependencyTests-415092953 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:44:27 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-1794af17-87f0-4e0f-ac48-0f70d89ace91 tempest-VolumeImageDependencyTests-415092953 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:44:27 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-1794af17-87f0-4e0f-ac48-0f70d89ace91 tempest-VolumeImageDependencyTests-415092953 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:44:27 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-1794af17-87f0-4e0f-ac48-0f70d89ace91 tempest-VolumeImageDependencyTests-415092953 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:44:27 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-1794af17-87f0-4e0f-ac48-0f70d89ace91 tempest-VolumeImageDependencyTests-415092953 None] Selected osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:44:27 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-1794af17-87f0-4e0f-ac48-0f70d89ace91 tempest-VolumeImageDependencyTests-415092953 None] casted to osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f Jun 29 03:44:27 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-1794af17-87f0-4e0f-ac48-0f70d89ace91 tempest-VolumeImageDependencyTests-415092953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-99a2aa65-6bc4-454d-83d6-2751a5bf7d04 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:44:27 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[16722514-7413-42f0-ae90-2c94bffca794]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:44:27 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-cab3a4d4-22c3-4293-9ff0-52b45da14a2b tempest-VolumeDependencyTests-1245577734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-1aad3d1f-6a61-4b52-a9a0-ddf7ca5fbe87 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:44:27 devstack sudo[114757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-99a2aa65-6bc4-454d-83d6-2751a5bf7d04 1073741824 Jun 29 03:44:27 devstack sudo[114757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:44:27 devstack sudo[114758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-1aad3d1f-6a61-4b52-a9a0-ddf7ca5fbe87 Jun 29 03:44:27 devstack sudo[114758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:44:28 devstack sudo[114755]: pam_unix(sudo:session): session closed for user root Jun 29 03:44:28 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-785a6d30-0345-4da3-8029-aced4246dfad tempest-CreateVolumesFromSnapshotTest-1093373581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-d719f89f-317b-493f-8498-9984506f0903" returned: 0 in 0.767s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:44:28 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-785a6d30-0345-4da3-8029-aced4246dfad tempest-CreateVolumesFromSnapshotTest-1093373581 None] Lock "cinder-quobyte-d719f89f-317b-493f-8498-9984506f0903" released by "delete_volume" :: held 1.971s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:44:28 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-785a6d30-0345-4da3-8029-aced4246dfad tempest-CreateVolumesFromSnapshotTest-1093373581 None] Created reservations ['d855bcec-9099-4d33-a25f-9de89293f019', '3b35a178-8c63-4f00-8693-fd375cfcd4ac', 'af815a7b-0150-41a7-add7-e19c40f7e844', '2fed8415-e511-4fa6-aef1-73fa891543d3'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:44:28 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-785a6d30-0345-4da3-8029-aced4246dfad tempest-CreateVolumesFromSnapshotTest-1093373581 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:44:28 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-785a6d30-0345-4da3-8029-aced4246dfad tempest-CreateVolumesFromSnapshotTest-1093373581 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:44:28 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-785a6d30-0345-4da3-8029-aced4246dfad tempest-CreateVolumesFromSnapshotTest-1093373581 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:44:28 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-785a6d30-0345-4da3-8029-aced4246dfad tempest-CreateVolumesFromSnapshotTest-1093373581 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:44:28 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-785a6d30-0345-4da3-8029-aced4246dfad tempest-CreateVolumesFromSnapshotTest-1093373581 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:44:28 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-785a6d30-0345-4da3-8029-aced4246dfad tempest-CreateVolumesFromSnapshotTest-1093373581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:44:28 devstack sudo[114770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf Jun 29 03:44:28 devstack sudo[114770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:44:28 devstack sudo[114758]: pam_unix(sudo:session): session closed for user root Jun 29 03:44:28 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-cab3a4d4-22c3-4293-9ff0-52b45da14a2b tempest-VolumeDependencyTests-1245577734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-1aad3d1f-6a61-4b52-a9a0-ddf7ca5fbe87" returned: 0 in 0.944s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:44:28 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-cab3a4d4-22c3-4293-9ff0-52b45da14a2b tempest-VolumeDependencyTests-1245577734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-1aad3d1f-6a61-4b52-a9a0-ddf7ca5fbe87.29cc1948-65a7-40e9-940e-6ec7933c4757 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:44:28 devstack sudo[114757]: pam_unix(sudo:session): session closed for user root Jun 29 03:44:28 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-1794af17-87f0-4e0f-ac48-0f70d89ace91 tempest-VolumeImageDependencyTests-415092953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-99a2aa65-6bc4-454d-83d6-2751a5bf7d04 1073741824" returned: 0 in 0.985s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:44:28 devstack sudo[114772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-1aad3d1f-6a61-4b52-a9a0-ddf7ca5fbe87.29cc1948-65a7-40e9-940e-6ec7933c4757 Jun 29 03:44:28 devstack sudo[114772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:44:28 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-e76b908f-a593-41a2-bf34-f7c5801ba953 tempest-CreateVolumesFromSnapshotTest-1093373581 None] Acquiring lock "cinder-78d66f48-6e6e-4baf-ba19-2d449c369bcc-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:44:28 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-e76b908f-a593-41a2-bf34-f7c5801ba953 tempest-CreateVolumesFromSnapshotTest-1093373581 None] Lock "cinder-78d66f48-6e6e-4baf-ba19-2d449c369bcc-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:44:28 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-1794af17-87f0-4e0f-ac48-0f70d89ace91 tempest-VolumeImageDependencyTests-415092953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-99a2aa65-6bc4-454d-83d6-2751a5bf7d04 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:44:28 devstack sudo[114774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-99a2aa65-6bc4-454d-83d6-2751a5bf7d04 Jun 29 03:44:28 devstack sudo[114774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:44:28 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-e76b908f-a593-41a2-bf34-f7c5801ba953 tempest-CreateVolumesFromSnapshotTest-1093373581 None] Acquiring lock "cinder-quobyte-78d66f48-6e6e-4baf-ba19-2d449c369bcc" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:44:28 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-e76b908f-a593-41a2-bf34-f7c5801ba953 tempest-CreateVolumesFromSnapshotTest-1093373581 None] Lock "cinder-quobyte-78d66f48-6e6e-4baf-ba19-2d449c369bcc" acquired by "delete_volume" :: waited 0.024s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:44:28 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3530319-2c90-42c5-b94e-9c16ce8ee320]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:44:28 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-e76b908f-a593-41a2-bf34-f7c5801ba953 tempest-CreateVolumesFromSnapshotTest-1093373581 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-78d66f48-6e6e-4baf-ba19-2d449c369bcc {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:44:28 devstack sudo[114776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-78d66f48-6e6e-4baf-ba19-2d449c369bcc Jun 29 03:44:28 devstack sudo[114776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:44:29 devstack sudo[114774]: pam_unix(sudo:session): session closed for user root Jun 29 03:44:29 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-1794af17-87f0-4e0f-ac48-0f70d89ace91 tempest-VolumeImageDependencyTests-415092953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-99a2aa65-6bc4-454d-83d6-2751a5bf7d04" returned: 0 in 0.801s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:44:29 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-1794af17-87f0-4e0f-ac48-0f70d89ace91 tempest-VolumeImageDependencyTests-415092953 None] <== create_volume: return (1874ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:44:29 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-1794af17-87f0-4e0f-ac48-0f70d89ace91 tempest-VolumeImageDependencyTests-415092953 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.879s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:44:29 devstack cinder-volume[93468]: DEBUG cinder.volume.volume_utils [None req-1794af17-87f0-4e0f-ac48-0f70d89ace91 tempest-VolumeImageDependencyTests-415092953 None] Attempting download of fa0d190d-d915-4772-ad50-268a7ef5854a ((None, [{'url': 'file:///opt/stack/data/glance/images/fa0d190d-d915-4772-ad50-268a7ef5854a', 'metadata': {}}])) to volume 99a2aa65-6bc4-454d-83d6-2751a5bf7d04. {{(pid=93468) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 29 03:44:29 devstack sudo[114772]: pam_unix(sudo:session): session closed for user root Jun 29 03:44:29 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-cab3a4d4-22c3-4293-9ff0-52b45da14a2b tempest-VolumeDependencyTests-1245577734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-1aad3d1f-6a61-4b52-a9a0-ddf7ca5fbe87.29cc1948-65a7-40e9-940e-6ec7933c4757" returned: 0 in 0.985s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:44:29 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-cab3a4d4-22c3-4293-9ff0-52b45da14a2b tempest-VolumeDependencyTests-1245577734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-1aad3d1f-6a61-4b52-a9a0-ddf7ca5fbe87.29cc1948-65a7-40e9-940e-6ec7933c4757 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:44:29 devstack sudo[114770]: pam_unix(sudo:session): session closed for user root Jun 29 03:44:29 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-785a6d30-0345-4da3-8029-aced4246dfad tempest-CreateVolumesFromSnapshotTest-1093373581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf" returned: 0 in 1.059s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:44:29 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-785a6d30-0345-4da3-8029-aced4246dfad tempest-CreateVolumesFromSnapshotTest-1093373581 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:44:29 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-785a6d30-0345-4da3-8029-aced4246dfad tempest-CreateVolumesFromSnapshotTest-1093373581 None] Deleted volume successfully. Jun 29 03:44:29 devstack sudo[114783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-1aad3d1f-6a61-4b52-a9a0-ddf7ca5fbe87.29cc1948-65a7-40e9-940e-6ec7933c4757 Jun 29 03:44:29 devstack sudo[114783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:44:29 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-785a6d30-0345-4da3-8029-aced4246dfad tempest-CreateVolumesFromSnapshotTest-1093373581 None] Lock "cinder-d719f89f-317b-493f-8498-9984506f0903-delete_volume" released by "delete_volume" :: held 3.359s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:44:29 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[5abf61e0-c2a4-40a2-8b14-64d1a192bb49]: (4, 'raw') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:44:29 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-1794af17-87f0-4e0f-ac48-0f70d89ace91 tempest-VolumeImageDependencyTests-415092953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fa0d190d-d915-4772-ad50-268a7ef5854a_abaydx64 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:44:29 devstack sudo[114788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fa0d190d-d915-4772-ad50-268a7ef5854a_abaydx64 Jun 29 03:44:29 devstack sudo[114788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:44:29 devstack sudo[114776]: pam_unix(sudo:session): session closed for user root Jun 29 03:44:29 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-e76b908f-a593-41a2-bf34-f7c5801ba953 tempest-CreateVolumesFromSnapshotTest-1093373581 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-78d66f48-6e6e-4baf-ba19-2d449c369bcc" returned: 0 in 1.011s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:44:29 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-e76b908f-a593-41a2-bf34-f7c5801ba953 tempest-CreateVolumesFromSnapshotTest-1093373581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-78d66f48-6e6e-4baf-ba19-2d449c369bcc {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:44:29 devstack sudo[114790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-78d66f48-6e6e-4baf-ba19-2d449c369bcc Jun 29 03:44:29 devstack sudo[114790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:44:30 devstack sudo[114783]: pam_unix(sudo:session): session closed for user root Jun 29 03:44:30 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-cab3a4d4-22c3-4293-9ff0-52b45da14a2b tempest-VolumeDependencyTests-1245577734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-1aad3d1f-6a61-4b52-a9a0-ddf7ca5fbe87.29cc1948-65a7-40e9-940e-6ec7933c4757" returned: 0 in 0.912s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:44:30 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-cab3a4d4-22c3-4293-9ff0-52b45da14a2b tempest-VolumeDependencyTests-1245577734 None] Lock "cinder-quobyte-29cc1948-65a7-40e9-940e-6ec7933c4757" released by "_delete_snapshot" :: held 3.953s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:44:30 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-cab3a4d4-22c3-4293-9ff0-52b45da14a2b tempest-VolumeDependencyTests-1245577734 None] Lock "cinder-quobyte-1aad3d1f-6a61-4b52-a9a0-ddf7ca5fbe87" released by "delete_snapshot" :: held 3.984s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:44:30 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-cab3a4d4-22c3-4293-9ff0-52b45da14a2b tempest-VolumeDependencyTests-1245577734 None] Created reservations ['6d50682a-b85a-4fb1-bdf3-5dc52f21fdb7', 'd707f8e9-ee3d-47ef-8732-15ab433b99bf', '92e80e6b-6b33-42da-886a-eafa3ffe04b9', '0d85f2ea-fcbd-4875-ab56-6f90caed97d4'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:44:30 devstack sudo[114788]: pam_unix(sudo:session): session closed for user root Jun 29 03:44:30 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-1794af17-87f0-4e0f-ac48-0f70d89ace91 tempest-VolumeImageDependencyTests-415092953 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fa0d190d-d915-4772-ad50-268a7ef5854a_abaydx64" returned: 0 in 0.970s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:44:30 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-1794af17-87f0-4e0f-ac48-0f70d89ace91 tempest-VolumeImageDependencyTests-415092953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fa0d190d-d915-4772-ad50-268a7ef5854a_abaydx64 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:44:30 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-cab3a4d4-22c3-4293-9ff0-52b45da14a2b tempest-VolumeDependencyTests-1245577734 None] Delete snapshot completed successfully. Jun 29 03:44:30 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-cab3a4d4-22c3-4293-9ff0-52b45da14a2b tempest-VolumeDependencyTests-1245577734 None] Lock "cinder-29cc1948-65a7-40e9-940e-6ec7933c4757-delete_snapshot" released by "delete_snapshot" :: held 4.163s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:44:30 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-d7c6fd9b-e359-4b77-a1d8-e99541d47f75 tempest-VolumeDependencyTests-1245577734 None] Acquiring lock "cinder-1aad3d1f-6a61-4b52-a9a0-ddf7ca5fbe87-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:44:30 devstack sudo[114795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fa0d190d-d915-4772-ad50-268a7ef5854a_abaydx64 Jun 29 03:44:30 devstack sudo[114795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:44:30 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-d7c6fd9b-e359-4b77-a1d8-e99541d47f75 tempest-VolumeDependencyTests-1245577734 None] Lock "cinder-1aad3d1f-6a61-4b52-a9a0-ddf7ca5fbe87-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:44:30 devstack sudo[114790]: pam_unix(sudo:session): session closed for user root Jun 29 03:44:30 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-e76b908f-a593-41a2-bf34-f7c5801ba953 tempest-CreateVolumesFromSnapshotTest-1093373581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-78d66f48-6e6e-4baf-ba19-2d449c369bcc" returned: 0 in 1.004s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:44:30 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-e76b908f-a593-41a2-bf34-f7c5801ba953 tempest-CreateVolumesFromSnapshotTest-1093373581 None] Lock "cinder-quobyte-78d66f48-6e6e-4baf-ba19-2d449c369bcc" released by "delete_volume" :: held 2.087s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:44:30 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-d7c6fd9b-e359-4b77-a1d8-e99541d47f75 tempest-VolumeDependencyTests-1245577734 None] Acquiring lock "cinder-quobyte-1aad3d1f-6a61-4b52-a9a0-ddf7ca5fbe87" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:44:30 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-d7c6fd9b-e359-4b77-a1d8-e99541d47f75 tempest-VolumeDependencyTests-1245577734 None] Lock "cinder-quobyte-1aad3d1f-6a61-4b52-a9a0-ddf7ca5fbe87" acquired by "delete_volume" :: waited 0.043s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:44:30 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[22be7228-f04b-4def-83be-9b3fdd9a2185]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:44:30 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d7c6fd9b-e359-4b77-a1d8-e99541d47f75 tempest-VolumeDependencyTests-1245577734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-1aad3d1f-6a61-4b52-a9a0-ddf7ca5fbe87 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:44:30 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-e76b908f-a593-41a2-bf34-f7c5801ba953 tempest-CreateVolumesFromSnapshotTest-1093373581 None] Created reservations ['951189b2-669a-4898-8d58-b81360713b77', '508bf008-fb9a-40b5-b7da-034089b94fb1', '2f7780d2-267d-48e7-8b58-fd64ffc19b85', '15baa93f-efcb-4f22-83d7-4ab5a767ffb3'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:44:31 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-e76b908f-a593-41a2-bf34-f7c5801ba953 tempest-CreateVolumesFromSnapshotTest-1093373581 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:44:31 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-e76b908f-a593-41a2-bf34-f7c5801ba953 tempest-CreateVolumesFromSnapshotTest-1093373581 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:44:31 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-e76b908f-a593-41a2-bf34-f7c5801ba953 tempest-CreateVolumesFromSnapshotTest-1093373581 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:44:31 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-e76b908f-a593-41a2-bf34-f7c5801ba953 tempest-CreateVolumesFromSnapshotTest-1093373581 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:44:31 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-e76b908f-a593-41a2-bf34-f7c5801ba953 tempest-CreateVolumesFromSnapshotTest-1093373581 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:44:31 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-e76b908f-a593-41a2-bf34-f7c5801ba953 tempest-CreateVolumesFromSnapshotTest-1093373581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:44:31 devstack sudo[114798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-1aad3d1f-6a61-4b52-a9a0-ddf7ca5fbe87 Jun 29 03:44:31 devstack sudo[114798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:44:31 devstack sudo[114800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf Jun 29 03:44:31 devstack sudo[114800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:44:31 devstack sudo[114795]: pam_unix(sudo:session): session closed for user root Jun 29 03:44:31 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-1794af17-87f0-4e0f-ac48-0f70d89ace91 tempest-VolumeImageDependencyTests-415092953 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fa0d190d-d915-4772-ad50-268a7ef5854a_abaydx64" returned: 1 in 0.887s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:44:31 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-1794af17-87f0-4e0f-ac48-0f70d89ace91 tempest-VolumeImageDependencyTests-415092953 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fa0d190d-d915-4772-ad50-268a7ef5854a_abaydx64' failed. Not Retrying. {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 29 03:44:31 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2927166-f251-4054-9d64-3541eeebf267]: (4, 'raw') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:44:31 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-1794af17-87f0-4e0f-ac48-0f70d89ace91 tempest-VolumeImageDependencyTests-415092953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fa0d190d-d915-4772-ad50-268a7ef5854a__7_jmvbjdevstack@QuobyteHD {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:44:31 devstack sudo[114804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fa0d190d-d915-4772-ad50-268a7ef5854a__7_jmvbjdevstack@QuobyteHD Jun 29 03:44:31 devstack sudo[114804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:44:31 devstack sudo[114798]: pam_unix(sudo:session): session closed for user root Jun 29 03:44:31 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d7c6fd9b-e359-4b77-a1d8-e99541d47f75 tempest-VolumeDependencyTests-1245577734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-1aad3d1f-6a61-4b52-a9a0-ddf7ca5fbe87" returned: 0 in 1.092s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:44:31 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d7c6fd9b-e359-4b77-a1d8-e99541d47f75 tempest-VolumeDependencyTests-1245577734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-1aad3d1f-6a61-4b52-a9a0-ddf7ca5fbe87 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:44:32 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-77ba5db9-49af-4228-ab35-f775ee6a7f0b tempest-CreateVolumesFromSnapshotTest-1093373581 None] Acquiring lock "cinder-5c33f15e-4654-4c11-b949-f3a282e07dc1-delete_snapshot" by "delete_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:44:32 devstack sudo[114811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-1aad3d1f-6a61-4b52-a9a0-ddf7ca5fbe87 Jun 29 03:44:32 devstack sudo[114811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:44:32 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-77ba5db9-49af-4228-ab35-f775ee6a7f0b tempest-CreateVolumesFromSnapshotTest-1093373581 None] Lock "cinder-5c33f15e-4654-4c11-b949-f3a282e07dc1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:44:32 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-77ba5db9-49af-4228-ab35-f775ee6a7f0b tempest-CreateVolumesFromSnapshotTest-1093373581 None] Acquiring lock "cinder-quobyte-9148723b-25c2-4581-884c-91a072699cbd" by "delete_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:44:32 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-77ba5db9-49af-4228-ab35-f775ee6a7f0b tempest-CreateVolumesFromSnapshotTest-1093373581 None] Lock "cinder-quobyte-9148723b-25c2-4581-884c-91a072699cbd" acquired by "delete_snapshot" :: waited 0.032s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:44:32 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-77ba5db9-49af-4228-ab35-f775ee6a7f0b tempest-CreateVolumesFromSnapshotTest-1093373581 None] Acquiring lock "cinder-quobyte-5c33f15e-4654-4c11-b949-f3a282e07dc1" by "_delete_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:44:32 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-77ba5db9-49af-4228-ab35-f775ee6a7f0b tempest-CreateVolumesFromSnapshotTest-1093373581 None] Lock "cinder-quobyte-5c33f15e-4654-4c11-b949-f3a282e07dc1" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:44:32 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-77ba5db9-49af-4228-ab35-f775ee6a7f0b tempest-CreateVolumesFromSnapshotTest-1093373581 None] Deleting offline snapshot 5c33f15e-4654-4c11-b949-f3a282e07dc1 of volume 9148723b-25c2-4581-884c-91a072699cbd {{(pid=93468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 29 03:44:32 devstack sudo[114800]: pam_unix(sudo:session): session closed for user root Jun 29 03:44:32 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-77ba5db9-49af-4228-ab35-f775ee6a7f0b tempest-CreateVolumesFromSnapshotTest-1093373581 None] snapshot_file for this snap is: volume-9148723b-25c2-4581-884c-91a072699cbd.5c33f15e-4654-4c11-b949-f3a282e07dc1 {{(pid=93468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 29 03:44:32 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-e76b908f-a593-41a2-bf34-f7c5801ba953 tempest-CreateVolumesFromSnapshotTest-1093373581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf" returned: 0 in 1.113s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:44:32 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-e76b908f-a593-41a2-bf34-f7c5801ba953 tempest-CreateVolumesFromSnapshotTest-1093373581 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:44:32 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-e76b908f-a593-41a2-bf34-f7c5801ba953 tempest-CreateVolumesFromSnapshotTest-1093373581 None] Deleted volume successfully. Jun 29 03:44:32 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[686c5912-88d5-46d7-8dff-335549408dcc]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:44:32 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-77ba5db9-49af-4228-ab35-f775ee6a7f0b tempest-CreateVolumesFromSnapshotTest-1093373581 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9148723b-25c2-4581-884c-91a072699cbd.5c33f15e-4654-4c11-b949-f3a282e07dc1 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:44:32 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-e76b908f-a593-41a2-bf34-f7c5801ba953 tempest-CreateVolumesFromSnapshotTest-1093373581 None] Lock "cinder-78d66f48-6e6e-4baf-ba19-2d449c369bcc-delete_volume" released by "delete_volume" :: held 3.663s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:44:32 devstack sudo[114813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9148723b-25c2-4581-884c-91a072699cbd.5c33f15e-4654-4c11-b949-f3a282e07dc1 Jun 29 03:44:32 devstack sudo[114813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:44:32 devstack sudo[114804]: pam_unix(sudo:session): session closed for user root Jun 29 03:44:32 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-1794af17-87f0-4e0f-ac48-0f70d89ace91 tempest-VolumeImageDependencyTests-415092953 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fa0d190d-d915-4772-ad50-268a7ef5854a__7_jmvbjdevstack@QuobyteHD" returned: 0 in 1.331s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:44:32 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-1794af17-87f0-4e0f-ac48-0f70d89ace91 tempest-VolumeImageDependencyTests-415092953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fa0d190d-d915-4772-ad50-268a7ef5854a__7_jmvbjdevstack@QuobyteHD {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:44:32 devstack sudo[114811]: pam_unix(sudo:session): session closed for user root Jun 29 03:44:32 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d7c6fd9b-e359-4b77-a1d8-e99541d47f75 tempest-VolumeDependencyTests-1245577734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-1aad3d1f-6a61-4b52-a9a0-ddf7ca5fbe87" returned: 0 in 0.888s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:44:32 devstack sudo[114818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fa0d190d-d915-4772-ad50-268a7ef5854a__7_jmvbjdevstack@QuobyteHD Jun 29 03:44:32 devstack sudo[114818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:44:32 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-d7c6fd9b-e359-4b77-a1d8-e99541d47f75 tempest-VolumeDependencyTests-1245577734 None] Lock "cinder-quobyte-1aad3d1f-6a61-4b52-a9a0-ddf7ca5fbe87" released by "delete_volume" :: held 2.075s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:44:33 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-d7c6fd9b-e359-4b77-a1d8-e99541d47f75 tempest-VolumeDependencyTests-1245577734 None] Created reservations ['1dd13f3f-d3c0-420b-9a73-81a37210928a', '7736e849-c4d1-4fa0-811d-1a2655503110', 'e66461b4-bef5-488b-aed1-c9e997ee7b86', 'b55dd4d6-811c-4da1-894e-ff45144ca51d'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:44:33 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-d7c6fd9b-e359-4b77-a1d8-e99541d47f75 tempest-VolumeDependencyTests-1245577734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:44:33 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-d7c6fd9b-e359-4b77-a1d8-e99541d47f75 tempest-VolumeDependencyTests-1245577734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:44:33 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-d7c6fd9b-e359-4b77-a1d8-e99541d47f75 tempest-VolumeDependencyTests-1245577734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:44:33 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-d7c6fd9b-e359-4b77-a1d8-e99541d47f75 tempest-VolumeDependencyTests-1245577734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:44:33 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-d7c6fd9b-e359-4b77-a1d8-e99541d47f75 tempest-VolumeDependencyTests-1245577734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:44:33 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d7c6fd9b-e359-4b77-a1d8-e99541d47f75 tempest-VolumeDependencyTests-1245577734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:44:33 devstack sudo[114823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf Jun 29 03:44:33 devstack sudo[114823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:44:33 devstack sudo[114813]: pam_unix(sudo:session): session closed for user root Jun 29 03:44:33 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-77ba5db9-49af-4228-ab35-f775ee6a7f0b tempest-CreateVolumesFromSnapshotTest-1093373581 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9148723b-25c2-4581-884c-91a072699cbd.5c33f15e-4654-4c11-b949-f3a282e07dc1" returned: 0 in 1.217s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:44:33 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-77ba5db9-49af-4228-ab35-f775ee6a7f0b tempest-CreateVolumesFromSnapshotTest-1093373581 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9148723b-25c2-4581-884c-91a072699cbd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93468) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 29 03:44:33 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fc081ae-9047-4377-bea6-b3cdd4e0ee77]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:44:33 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-77ba5db9-49af-4228-ab35-f775ee6a7f0b tempest-CreateVolumesFromSnapshotTest-1093373581 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9148723b-25c2-4581-884c-91a072699cbd {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:44:33 devstack sudo[114825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9148723b-25c2-4581-884c-91a072699cbd Jun 29 03:44:33 devstack sudo[114825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:44:33 devstack sudo[114818]: pam_unix(sudo:session): session closed for user root Jun 29 03:44:33 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-1794af17-87f0-4e0f-ac48-0f70d89ace91 tempest-VolumeImageDependencyTests-415092953 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fa0d190d-d915-4772-ad50-268a7ef5854a__7_jmvbjdevstack@QuobyteHD" returned: 1 in 1.156s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:44:33 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-1794af17-87f0-4e0f-ac48-0f70d89ace91 tempest-VolumeImageDependencyTests-415092953 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fa0d190d-d915-4772-ad50-268a7ef5854a__7_jmvbjdevstack@QuobyteHD' failed. Not Retrying. {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 29 03:44:33 devstack cinder-volume[93468]: DEBUG cinder.image.image_utils [None req-1794af17-87f0-4e0f-ac48-0f70d89ace91 tempest-VolumeImageDependencyTests-415092953 None] fa0d190d-d915-4772-ad50-268a7ef5854a was raw, converting to raw {{(pid=93468) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 29 03:44:33 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-1794af17-87f0-4e0f-ac48-0f70d89ace91 tempest-VolumeImageDependencyTests-415092953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_fa0d190d-d915-4772-ad50-268a7ef5854a__7_jmvbjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-99a2aa65-6bc4-454d-83d6-2751a5bf7d04 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:44:33 devstack sudo[114830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_fa0d190d-d915-4772-ad50-268a7ef5854a__7_jmvbjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-99a2aa65-6bc4-454d-83d6-2751a5bf7d04 Jun 29 03:44:33 devstack sudo[114830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:44:34 devstack sudo[114823]: pam_unix(sudo:session): session closed for user root Jun 29 03:44:34 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-d375db66-c193-4472-a22d-c3bb0a4c4d6f tempest-VolumeDependencyTests-1245577734 None] Acquiring lock "cinder-f6084173-ec5a-4172-8d3d-379f109afe8a-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:44:34 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d7c6fd9b-e359-4b77-a1d8-e99541d47f75 tempest-VolumeDependencyTests-1245577734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf" returned: 0 in 1.118s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:44:34 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-d7c6fd9b-e359-4b77-a1d8-e99541d47f75 tempest-VolumeDependencyTests-1245577734 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:44:34 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-d7c6fd9b-e359-4b77-a1d8-e99541d47f75 tempest-VolumeDependencyTests-1245577734 None] Deleted volume successfully. Jun 29 03:44:34 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-d375db66-c193-4472-a22d-c3bb0a4c4d6f tempest-VolumeDependencyTests-1245577734 None] Lock "cinder-f6084173-ec5a-4172-8d3d-379f109afe8a-delete_volume" acquired by "delete_volume" :: waited 0.077s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:44:34 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-d7c6fd9b-e359-4b77-a1d8-e99541d47f75 tempest-VolumeDependencyTests-1245577734 None] Lock "cinder-1aad3d1f-6a61-4b52-a9a0-ddf7ca5fbe87-delete_volume" released by "delete_volume" :: held 3.714s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:44:34 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-d375db66-c193-4472-a22d-c3bb0a4c4d6f tempest-VolumeDependencyTests-1245577734 None] Acquiring lock "cinder-quobyte-f6084173-ec5a-4172-8d3d-379f109afe8a" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:44:34 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-d375db66-c193-4472-a22d-c3bb0a4c4d6f tempest-VolumeDependencyTests-1245577734 None] Lock "cinder-quobyte-f6084173-ec5a-4172-8d3d-379f109afe8a" acquired by "delete_volume" :: waited 0.034s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:44:34 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[751da74e-83d3-431c-87e5-b247294ef951]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:44:34 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d375db66-c193-4472-a22d-c3bb0a4c4d6f tempest-VolumeDependencyTests-1245577734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-f6084173-ec5a-4172-8d3d-379f109afe8a {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:44:34 devstack sudo[114825]: pam_unix(sudo:session): session closed for user root Jun 29 03:44:34 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-77ba5db9-49af-4228-ab35-f775ee6a7f0b tempest-CreateVolumesFromSnapshotTest-1093373581 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9148723b-25c2-4581-884c-91a072699cbd" returned: 0 in 1.152s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:44:34 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-77ba5db9-49af-4228-ab35-f775ee6a7f0b tempest-CreateVolumesFromSnapshotTest-1093373581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9148723b-25c2-4581-884c-91a072699cbd.5c33f15e-4654-4c11-b949-f3a282e07dc1 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:44:34 devstack sudo[114837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9148723b-25c2-4581-884c-91a072699cbd.5c33f15e-4654-4c11-b949-f3a282e07dc1 Jun 29 03:44:34 devstack sudo[114837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:44:34 devstack sudo[114836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-f6084173-ec5a-4172-8d3d-379f109afe8a Jun 29 03:44:34 devstack sudo[114836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:44:35 devstack sudo[114830]: pam_unix(sudo:session): session closed for user root Jun 29 03:44:35 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-1794af17-87f0-4e0f-ac48-0f70d89ace91 tempest-VolumeImageDependencyTests-415092953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_fa0d190d-d915-4772-ad50-268a7ef5854a__7_jmvbjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-99a2aa65-6bc4-454d-83d6-2751a5bf7d04" returned: 0 in 1.149s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:44:35 devstack cinder-volume[93468]: DEBUG cinder.image.image_utils [None req-1794af17-87f0-4e0f-ac48-0f70d89ace91 tempest-VolumeImageDependencyTests-415092953 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_fa0d190d-d915-4772-ad50-268a7ef5854a__7_jmvbjdevstack@QuobyteHD, size 0.00 MB, duration 1.15 sec, destination /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-99a2aa65-6bc4-454d-83d6-2751a5bf7d04 {{(pid=93468) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 29 03:44:35 devstack cinder-volume[93468]: INFO cinder.image.image_utils [None req-1794af17-87f0-4e0f-ac48-0f70d89ace91 tempest-VolumeImageDependencyTests-415092953 None] Converted 0.00 MB image at 0.00 MB/s Jun 29 03:44:35 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-1794af17-87f0-4e0f-ac48-0f70d89ace91 tempest-VolumeImageDependencyTests-415092953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-99a2aa65-6bc4-454d-83d6-2751a5bf7d04 1G {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:44:35 devstack sudo[114843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-99a2aa65-6bc4-454d-83d6-2751a5bf7d04 1G Jun 29 03:44:35 devstack sudo[114843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:44:35 devstack sudo[114836]: pam_unix(sudo:session): session closed for user root Jun 29 03:44:35 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d375db66-c193-4472-a22d-c3bb0a4c4d6f tempest-VolumeDependencyTests-1245577734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-f6084173-ec5a-4172-8d3d-379f109afe8a" returned: 0 in 1.109s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:44:35 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d375db66-c193-4472-a22d-c3bb0a4c4d6f tempest-VolumeDependencyTests-1245577734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-f6084173-ec5a-4172-8d3d-379f109afe8a {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:44:35 devstack sudo[114837]: pam_unix(sudo:session): session closed for user root Jun 29 03:44:35 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-77ba5db9-49af-4228-ab35-f775ee6a7f0b tempest-CreateVolumesFromSnapshotTest-1093373581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9148723b-25c2-4581-884c-91a072699cbd.5c33f15e-4654-4c11-b949-f3a282e07dc1" returned: 0 in 1.044s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:44:35 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-77ba5db9-49af-4228-ab35-f775ee6a7f0b tempest-CreateVolumesFromSnapshotTest-1093373581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9148723b-25c2-4581-884c-91a072699cbd.5c33f15e-4654-4c11-b949-f3a282e07dc1 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:44:35 devstack sudo[114852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-f6084173-ec5a-4172-8d3d-379f109afe8a Jun 29 03:44:35 devstack sudo[114852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:44:35 devstack sudo[114853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9148723b-25c2-4581-884c-91a072699cbd.5c33f15e-4654-4c11-b949-f3a282e07dc1 Jun 29 03:44:35 devstack sudo[114853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:44:35 devstack sudo[114843]: pam_unix(sudo:session): session closed for user root Jun 29 03:44:35 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-1794af17-87f0-4e0f-ac48-0f70d89ace91 tempest-VolumeImageDependencyTests-415092953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-99a2aa65-6bc4-454d-83d6-2751a5bf7d04 1G" returned: 0 in 0.896s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:44:36 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[afcc527e-e992-45a8-870c-cb71613084c0]: (4, 'raw') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:44:36 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-1794af17-87f0-4e0f-ac48-0f70d89ace91 tempest-VolumeImageDependencyTests-415092953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-99a2aa65-6bc4-454d-83d6-2751a5bf7d04 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:44:36 devstack sudo[114859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-99a2aa65-6bc4-454d-83d6-2751a5bf7d04 Jun 29 03:44:36 devstack sudo[114859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:44:36 devstack sudo[114852]: pam_unix(sudo:session): session closed for user root Jun 29 03:44:36 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d375db66-c193-4472-a22d-c3bb0a4c4d6f tempest-VolumeDependencyTests-1245577734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-f6084173-ec5a-4172-8d3d-379f109afe8a" returned: 0 in 0.831s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:44:36 devstack sudo[114853]: pam_unix(sudo:session): session closed for user root Jun 29 03:44:36 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-77ba5db9-49af-4228-ab35-f775ee6a7f0b tempest-CreateVolumesFromSnapshotTest-1093373581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9148723b-25c2-4581-884c-91a072699cbd.5c33f15e-4654-4c11-b949-f3a282e07dc1" returned: 0 in 0.830s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:44:36 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-d375db66-c193-4472-a22d-c3bb0a4c4d6f tempest-VolumeDependencyTests-1245577734 None] Lock "cinder-quobyte-f6084173-ec5a-4172-8d3d-379f109afe8a" released by "delete_volume" :: held 2.001s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:44:36 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-77ba5db9-49af-4228-ab35-f775ee6a7f0b tempest-CreateVolumesFromSnapshotTest-1093373581 None] Lock "cinder-quobyte-5c33f15e-4654-4c11-b949-f3a282e07dc1" released by "_delete_snapshot" :: held 4.429s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:44:36 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-77ba5db9-49af-4228-ab35-f775ee6a7f0b tempest-CreateVolumesFromSnapshotTest-1093373581 None] Lock "cinder-quobyte-9148723b-25c2-4581-884c-91a072699cbd" released by "delete_snapshot" :: held 4.461s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:44:36 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-d375db66-c193-4472-a22d-c3bb0a4c4d6f tempest-VolumeDependencyTests-1245577734 None] Created reservations ['94d646a0-18d0-4b03-873d-966eaf508ec0', 'baefa2c4-9ac2-4ce7-a90f-620be751926c', '84d37f10-f2bf-47a7-81f8-51c25d1bcaf6', '94c5133b-d2d6-4bb7-a639-b44a1ccf2123'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:44:36 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-77ba5db9-49af-4228-ab35-f775ee6a7f0b tempest-CreateVolumesFromSnapshotTest-1093373581 None] Created reservations ['21c2eb6f-27b9-4150-b754-bbbe3f065258', 'd588c241-989c-4ff6-804f-5a8d24c11c15', '2d1038c1-9763-4852-9acc-cc5f2a357fc2', '44cbb4c0-1562-4944-8d7f-5a631f8b99d0'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:44:36 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-d375db66-c193-4472-a22d-c3bb0a4c4d6f tempest-VolumeDependencyTests-1245577734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:44:36 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-d375db66-c193-4472-a22d-c3bb0a4c4d6f tempest-VolumeDependencyTests-1245577734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:44:36 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-d375db66-c193-4472-a22d-c3bb0a4c4d6f tempest-VolumeDependencyTests-1245577734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:44:36 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-d375db66-c193-4472-a22d-c3bb0a4c4d6f tempest-VolumeDependencyTests-1245577734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:44:36 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-d375db66-c193-4472-a22d-c3bb0a4c4d6f tempest-VolumeDependencyTests-1245577734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:44:36 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d375db66-c193-4472-a22d-c3bb0a4c4d6f tempest-VolumeDependencyTests-1245577734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:44:36 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-77ba5db9-49af-4228-ab35-f775ee6a7f0b tempest-CreateVolumesFromSnapshotTest-1093373581 None] Delete snapshot completed successfully. Jun 29 03:44:36 devstack sudo[114863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf Jun 29 03:44:36 devstack sudo[114863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:44:36 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-77ba5db9-49af-4228-ab35-f775ee6a7f0b tempest-CreateVolumesFromSnapshotTest-1093373581 None] Lock "cinder-5c33f15e-4654-4c11-b949-f3a282e07dc1-delete_snapshot" released by "delete_snapshot" :: held 4.737s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:44:36 devstack sudo[114859]: pam_unix(sudo:session): session closed for user root Jun 29 03:44:36 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-1794af17-87f0-4e0f-ac48-0f70d89ace91 tempest-VolumeImageDependencyTests-415092953 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-99a2aa65-6bc4-454d-83d6-2751a5bf7d04" returned: 0 in 0.960s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:44:36 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-1794af17-87f0-4e0f-ac48-0f70d89ace91 tempest-VolumeImageDependencyTests-415092953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-99a2aa65-6bc4-454d-83d6-2751a5bf7d04 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:44:37 devstack sudo[114867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-99a2aa65-6bc4-454d-83d6-2751a5bf7d04 Jun 29 03:44:37 devstack sudo[114867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:44:37 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-81db6671-73ff-4617-8fe4-6f9c823635b0 tempest-CreateVolumesFromSnapshotTest-1093373581 None] Acquiring lock "cinder-9148723b-25c2-4581-884c-91a072699cbd-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:44:37 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-81db6671-73ff-4617-8fe4-6f9c823635b0 tempest-CreateVolumesFromSnapshotTest-1093373581 None] Lock "cinder-9148723b-25c2-4581-884c-91a072699cbd-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:44:37 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-81db6671-73ff-4617-8fe4-6f9c823635b0 tempest-CreateVolumesFromSnapshotTest-1093373581 None] Acquiring lock "cinder-quobyte-9148723b-25c2-4581-884c-91a072699cbd" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:44:37 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-81db6671-73ff-4617-8fe4-6f9c823635b0 tempest-CreateVolumesFromSnapshotTest-1093373581 None] Lock "cinder-quobyte-9148723b-25c2-4581-884c-91a072699cbd" acquired by "delete_volume" :: waited 0.018s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:44:37 devstack sudo[114863]: pam_unix(sudo:session): session closed for user root Jun 29 03:44:37 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d375db66-c193-4472-a22d-c3bb0a4c4d6f tempest-VolumeDependencyTests-1245577734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf" returned: 0 in 0.945s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:44:37 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-d375db66-c193-4472-a22d-c3bb0a4c4d6f tempest-VolumeDependencyTests-1245577734 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:44:37 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[d715081a-4582-415f-a835-6cc311ecc8c1]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:44:37 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-81db6671-73ff-4617-8fe4-6f9c823635b0 tempest-CreateVolumesFromSnapshotTest-1093373581 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9148723b-25c2-4581-884c-91a072699cbd {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:44:37 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-d375db66-c193-4472-a22d-c3bb0a4c4d6f tempest-VolumeDependencyTests-1245577734 None] Deleted volume successfully. Jun 29 03:44:37 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-d375db66-c193-4472-a22d-c3bb0a4c4d6f tempest-VolumeDependencyTests-1245577734 None] Lock "cinder-f6084173-ec5a-4172-8d3d-379f109afe8a-delete_volume" released by "delete_volume" :: held 3.379s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:44:37 devstack sudo[114870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9148723b-25c2-4581-884c-91a072699cbd Jun 29 03:44:37 devstack sudo[114870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:44:37 devstack sudo[114867]: pam_unix(sudo:session): session closed for user root Jun 29 03:44:37 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-1794af17-87f0-4e0f-ac48-0f70d89ace91 tempest-VolumeImageDependencyTests-415092953 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-99a2aa65-6bc4-454d-83d6-2751a5bf7d04" returned: 1 in 0.979s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:44:37 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-1794af17-87f0-4e0f-ac48-0f70d89ace91 tempest-VolumeImageDependencyTests-415092953 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-99a2aa65-6bc4-454d-83d6-2751a5bf7d04' failed. Not Retrying. {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 29 03:44:37 devstack cinder-volume[93468]: DEBUG cinder.volume.volume_utils [None req-1794af17-87f0-4e0f-ac48-0f70d89ace91 tempest-VolumeImageDependencyTests-415092953 None] Downloaded image fa0d190d-d915-4772-ad50-268a7ef5854a ((None, [{'url': 'file:///opt/stack/data/glance/images/fa0d190d-d915-4772-ad50-268a7ef5854a', 'metadata': {}}])) to volume 99a2aa65-6bc4-454d-83d6-2751a5bf7d04 successfully. {{(pid=93468) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 29 03:44:37 devstack cinder-volume[93468]: DEBUG cinder.image.image_utils [None req-1794af17-87f0-4e0f-ac48-0f70d89ace91 tempest-VolumeImageDependencyTests-415092953 None] Temporary image fa0d190d-d915-4772-ad50-268a7ef5854a for user 3b6469cb5ee149f4afab81d3c1217593 is deleted. {{(pid=93468) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 29 03:44:37 devstack cinder-volume[93468]: DEBUG cinder.volume.volume_utils [None req-1794af17-87f0-4e0f-ac48-0f70d89ace91 tempest-VolumeImageDependencyTests-415092953 None] Marking volume 99a2aa65-6bc4-454d-83d6-2751a5bf7d04 as bootable. {{(pid=93468) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 29 03:44:37 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-1794af17-87f0-4e0f-ac48-0f70d89ace91 tempest-VolumeImageDependencyTests-415092953 None] Copying metadata from image fa0d190d-d915-4772-ad50-268a7ef5854a to 99a2aa65-6bc4-454d-83d6-2751a5bf7d04. {{(pid=93468) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 29 03:44:37 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-1794af17-87f0-4e0f-ac48-0f70d89ace91 tempest-VolumeImageDependencyTests-415092953 None] Creating volume glance metadata for volume 99a2aa65-6bc4-454d-83d6-2751a5bf7d04 backed by image fa0d190d-d915-4772-ad50-268a7ef5854a with: {'image_id': 'fa0d190d-d915-4772-ad50-268a7ef5854a', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '916054516817b4d66462fc52a94d2e6a', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=93468) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 29 03:44:38 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-1794af17-87f0-4e0f-ac48-0f70d89ace91 tempest-VolumeImageDependencyTests-415092953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3924eab6-9ebd-403c-825d-bfd1210a4288) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99a2aa65-6bc4-454d-83d6-2751a5bf7d04', 'volume_size': 1, 'image_id': 'fa0d190d-d915-4772-ad50-268a7ef5854a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fa0d190d-d915-4772-ad50-268a7ef5854a', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '916054516817b4d66462fc52a94d2e6a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'ad83370ab78f4d0698a55dd1b02b5bcc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'aca68fba745cb71524b955ea622ec7233ae923fdc0e82db58a3c1ed165679f62f65f9c2b5dedd1599a147bdc167aa49f9bd62b5bcfecb82864a07ec8d4c9aed3', 'id': 'fa0d190d-d915-4772-ad50-268a7ef5854a', 'created_at': datetime.datetime(2026, 6, 29, 1, 44, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 29, 1, 44, 19, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fa0d190d-d915-4772-ad50-268a7ef5854a/file', 'properties': {}}, 'image_service': }' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:44:38 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-1794af17-87f0-4e0f-ac48-0f70d89ace91 tempest-VolumeImageDependencyTests-415092953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0476692-0468-452d-a936-a29189626dc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:44:38 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-1794af17-87f0-4e0f-ac48-0f70d89ace91 tempest-VolumeImageDependencyTests-415092953 None] Volume volume-99a2aa65-6bc4-454d-83d6-2751a5bf7d04 (99a2aa65-6bc4-454d-83d6-2751a5bf7d04): created successfully Jun 29 03:44:38 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-1794af17-87f0-4e0f-ac48-0f70d89ace91 tempest-VolumeImageDependencyTests-415092953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0476692-0468-452d-a936-a29189626dc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:44:38 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-1794af17-87f0-4e0f-ac48-0f70d89ace91 tempest-VolumeImageDependencyTests-415092953 None] Flow 'volume_create_manager' (dcc0176b-ef51-45a5-97d2-57feeedc6527) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:44:38 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-1794af17-87f0-4e0f-ac48-0f70d89ace91 tempest-VolumeImageDependencyTests-415092953 None] Created volume successfully. Jun 29 03:44:38 devstack sudo[114870]: pam_unix(sudo:session): session closed for user root Jun 29 03:44:38 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-81db6671-73ff-4617-8fe4-6f9c823635b0 tempest-CreateVolumesFromSnapshotTest-1093373581 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9148723b-25c2-4581-884c-91a072699cbd" returned: 0 in 0.932s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:44:38 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-81db6671-73ff-4617-8fe4-6f9c823635b0 tempest-CreateVolumesFromSnapshotTest-1093373581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9148723b-25c2-4581-884c-91a072699cbd {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:44:38 devstack sudo[114878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9148723b-25c2-4581-884c-91a072699cbd Jun 29 03:44:38 devstack sudo[114878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:44:38 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-50bde806-064b-4cc9-b434-e66f615f3359 tempest-SnapshotDependencyTests-1552874669 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:44:38 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-50bde806-064b-4cc9-b434-e66f615f3359 tempest-SnapshotDependencyTests-1552874669 None] Flow 'volume_create_manager' (023b6088-4d1c-48be-b823-39f9e0c7e7ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:44:38 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-50bde806-064b-4cc9-b434-e66f615f3359 tempest-SnapshotDependencyTests-1552874669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b7d8d32-ec5a-4eeb-8ee5-4d1d5c1cad7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:44:38 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-50bde806-064b-4cc9-b434-e66f615f3359 tempest-SnapshotDependencyTests-1552874669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b7d8d32-ec5a-4eeb-8ee5-4d1d5c1cad7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:44:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1917018171',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96fafe64-182a-4bd4-ad3c-c772d5245e04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d15a086091646d88fbfe1a2ecdff48e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:44:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:44:39Z,use_quota=True,user_id='65069cded37145639ac8e87b09879723',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:44:38 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-50bde806-064b-4cc9-b434-e66f615f3359 tempest-SnapshotDependencyTests-1552874669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b24dd8d7-d8d7-49ff-84b6-02c2e7649be4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:44:38 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-50bde806-064b-4cc9-b434-e66f615f3359 tempest-SnapshotDependencyTests-1552874669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b24dd8d7-d8d7-49ff-84b6-02c2e7649be4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:44:38 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-50bde806-064b-4cc9-b434-e66f615f3359 tempest-SnapshotDependencyTests-1552874669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67a2f55f-5fc9-47d2-a70d-88db7af57045) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:44:38 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-50bde806-064b-4cc9-b434-e66f615f3359 tempest-SnapshotDependencyTests-1552874669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67a2f55f-5fc9-47d2-a70d-88db7af57045) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '96fafe64-182a-4bd4-ad3c-c772d5245e04', 'volume_name': 'volume-96fafe64-182a-4bd4-ad3c-c772d5245e04', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:44:38 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-50bde806-064b-4cc9-b434-e66f615f3359 tempest-SnapshotDependencyTests-1552874669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77d6a9e3-c091-401f-b5b3-814dbe038468) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:44:38 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-50bde806-064b-4cc9-b434-e66f615f3359 tempest-SnapshotDependencyTests-1552874669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77d6a9e3-c091-401f-b5b3-814dbe038468) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:44:38 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-50bde806-064b-4cc9-b434-e66f615f3359 tempest-SnapshotDependencyTests-1552874669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac7410f0-aa3c-4787-9336-d20924b72ffa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:44:38 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-50bde806-064b-4cc9-b434-e66f615f3359 tempest-SnapshotDependencyTests-1552874669 None] Volume 96fafe64-182a-4bd4-ad3c-c772d5245e04: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-96fafe64-182a-4bd4-ad3c-c772d5245e04', 'volume_size': 1} Jun 29 03:44:38 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-50bde806-064b-4cc9-b434-e66f615f3359 tempest-SnapshotDependencyTests-1552874669 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:44:38 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-50bde806-064b-4cc9-b434-e66f615f3359 tempest-SnapshotDependencyTests-1552874669 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:44:38 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-50bde806-064b-4cc9-b434-e66f615f3359 tempest-SnapshotDependencyTests-1552874669 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:44:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1917018171',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96fafe64-182a-4bd4-ad3c-c772d5245e04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d15a086091646d88fbfe1a2ecdff48e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:44:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:44:39Z,use_quota=True,user_id='65069cded37145639ac8e87b09879723',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:44:38 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-50bde806-064b-4cc9-b434-e66f615f3359 tempest-SnapshotDependencyTests-1552874669 None] Creating volume 96fafe64-182a-4bd4-ad3c-c772d5245e04 {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:44:38 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-50bde806-064b-4cc9-b434-e66f615f3359 tempest-SnapshotDependencyTests-1552874669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:44:38 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-50bde806-064b-4cc9-b434-e66f615f3359 tempest-SnapshotDependencyTests-1552874669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:44:38 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-50bde806-064b-4cc9-b434-e66f615f3359 tempest-SnapshotDependencyTests-1552874669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:44:38 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-50bde806-064b-4cc9-b434-e66f615f3359 tempest-SnapshotDependencyTests-1552874669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:44:38 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-50bde806-064b-4cc9-b434-e66f615f3359 tempest-SnapshotDependencyTests-1552874669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:44:38 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-50bde806-064b-4cc9-b434-e66f615f3359 tempest-SnapshotDependencyTests-1552874669 None] Selected osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:44:38 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-50bde806-064b-4cc9-b434-e66f615f3359 tempest-SnapshotDependencyTests-1552874669 None] casted to osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f Jun 29 03:44:38 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-50bde806-064b-4cc9-b434-e66f615f3359 tempest-SnapshotDependencyTests-1552874669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-96fafe64-182a-4bd4-ad3c-c772d5245e04 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:44:38 devstack sudo[114880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-96fafe64-182a-4bd4-ad3c-c772d5245e04 1073741824 Jun 29 03:44:38 devstack sudo[114880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:44:38 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-5ebb85d8-2bee-4ffc-bc36-b8420ecb56d9 tempest-VolumeImageDependencyTests-415092953 None] Acquiring lock "cinder-99a2aa65-6bc4-454d-83d6-2751a5bf7d04-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:44:39 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-5ebb85d8-2bee-4ffc-bc36-b8420ecb56d9 tempest-VolumeImageDependencyTests-415092953 None] Lock "cinder-99a2aa65-6bc4-454d-83d6-2751a5bf7d04-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:44:39 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-5ebb85d8-2bee-4ffc-bc36-b8420ecb56d9 tempest-VolumeImageDependencyTests-415092953 None] Acquiring lock "cinder-quobyte-99a2aa65-6bc4-454d-83d6-2751a5bf7d04" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:44:39 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-5ebb85d8-2bee-4ffc-bc36-b8420ecb56d9 tempest-VolumeImageDependencyTests-415092953 None] Lock "cinder-quobyte-99a2aa65-6bc4-454d-83d6-2751a5bf7d04" acquired by "delete_volume" :: waited 0.043s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:44:39 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8764bde-64cc-4eea-9495-458523aaf4c0]: (4, 'raw') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:44:39 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-5ebb85d8-2bee-4ffc-bc36-b8420ecb56d9 tempest-VolumeImageDependencyTests-415092953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-99a2aa65-6bc4-454d-83d6-2751a5bf7d04 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:44:39 devstack sudo[114882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-99a2aa65-6bc4-454d-83d6-2751a5bf7d04 Jun 29 03:44:39 devstack sudo[114882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:44:39 devstack sudo[114878]: pam_unix(sudo:session): session closed for user root Jun 29 03:44:39 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-81db6671-73ff-4617-8fe4-6f9c823635b0 tempest-CreateVolumesFromSnapshotTest-1093373581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-9148723b-25c2-4581-884c-91a072699cbd" returned: 0 in 0.853s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:44:39 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-81db6671-73ff-4617-8fe4-6f9c823635b0 tempest-CreateVolumesFromSnapshotTest-1093373581 None] Lock "cinder-quobyte-9148723b-25c2-4581-884c-91a072699cbd" released by "delete_volume" :: held 1.885s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:44:39 devstack cinder-volume[93468]: DEBUG dbcounter [-] [93468] Writing DB stats cinder:SELECT=126,cinder:UPDATE=166,cinder:INSERT=58,cinder:DELETE=17 {{(pid=93468) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 29 03:44:39 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-81db6671-73ff-4617-8fe4-6f9c823635b0 tempest-CreateVolumesFromSnapshotTest-1093373581 None] Created reservations ['424a57f7-2f0e-4242-9b2a-cd8d50bdcb4b', '0c24ea43-de8c-410e-9aff-d843654db8cf', '9859d311-f5e2-40ed-88f7-97d59c0b0cbe', 'aa5516ef-dd2b-4094-abe5-166776e9b84e'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:44:39 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-81db6671-73ff-4617-8fe4-6f9c823635b0 tempest-CreateVolumesFromSnapshotTest-1093373581 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:44:39 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-81db6671-73ff-4617-8fe4-6f9c823635b0 tempest-CreateVolumesFromSnapshotTest-1093373581 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:44:39 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-81db6671-73ff-4617-8fe4-6f9c823635b0 tempest-CreateVolumesFromSnapshotTest-1093373581 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:44:39 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-81db6671-73ff-4617-8fe4-6f9c823635b0 tempest-CreateVolumesFromSnapshotTest-1093373581 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:44:39 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-81db6671-73ff-4617-8fe4-6f9c823635b0 tempest-CreateVolumesFromSnapshotTest-1093373581 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:44:39 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-81db6671-73ff-4617-8fe4-6f9c823635b0 tempest-CreateVolumesFromSnapshotTest-1093373581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:44:39 devstack sudo[114889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf Jun 29 03:44:39 devstack sudo[114889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:44:39 devstack sudo[114880]: pam_unix(sudo:session): session closed for user root Jun 29 03:44:39 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-50bde806-064b-4cc9-b434-e66f615f3359 tempest-SnapshotDependencyTests-1552874669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-96fafe64-182a-4bd4-ad3c-c772d5245e04 1073741824" returned: 0 in 1.105s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:44:40 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-50bde806-064b-4cc9-b434-e66f615f3359 tempest-SnapshotDependencyTests-1552874669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-96fafe64-182a-4bd4-ad3c-c772d5245e04 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:44:40 devstack sudo[114893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-96fafe64-182a-4bd4-ad3c-c772d5245e04 Jun 29 03:44:40 devstack sudo[114893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:44:40 devstack sudo[114882]: pam_unix(sudo:session): session closed for user root Jun 29 03:44:40 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-5ebb85d8-2bee-4ffc-bc36-b8420ecb56d9 tempest-VolumeImageDependencyTests-415092953 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-99a2aa65-6bc4-454d-83d6-2751a5bf7d04" returned: 0 in 1.206s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:44:40 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-5ebb85d8-2bee-4ffc-bc36-b8420ecb56d9 tempest-VolumeImageDependencyTests-415092953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-99a2aa65-6bc4-454d-83d6-2751a5bf7d04 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:44:40 devstack sudo[114895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-99a2aa65-6bc4-454d-83d6-2751a5bf7d04 Jun 29 03:44:40 devstack sudo[114895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:44:40 devstack sudo[114889]: pam_unix(sudo:session): session closed for user root Jun 29 03:44:40 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-81db6671-73ff-4617-8fe4-6f9c823635b0 tempest-CreateVolumesFromSnapshotTest-1093373581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf" returned: 0 in 0.970s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:44:40 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-81db6671-73ff-4617-8fe4-6f9c823635b0 tempest-CreateVolumesFromSnapshotTest-1093373581 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:44:40 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-81db6671-73ff-4617-8fe4-6f9c823635b0 tempest-CreateVolumesFromSnapshotTest-1093373581 None] Deleted volume successfully. Jun 29 03:44:40 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-81db6671-73ff-4617-8fe4-6f9c823635b0 tempest-CreateVolumesFromSnapshotTest-1093373581 None] Lock "cinder-9148723b-25c2-4581-884c-91a072699cbd-delete_volume" released by "delete_volume" :: held 3.157s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:44:40 devstack sudo[114893]: pam_unix(sudo:session): session closed for user root Jun 29 03:44:40 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-50bde806-064b-4cc9-b434-e66f615f3359 tempest-SnapshotDependencyTests-1552874669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-96fafe64-182a-4bd4-ad3c-c772d5245e04" returned: 0 in 0.914s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:44:40 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-50bde806-064b-4cc9-b434-e66f615f3359 tempest-SnapshotDependencyTests-1552874669 None] <== create_volume: return (2080ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:44:40 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-50bde806-064b-4cc9-b434-e66f615f3359 tempest-SnapshotDependencyTests-1552874669 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.088s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:44:40 devstack cinder-volume[93468]: DEBUG dbcounter [-] [93468] Writing DB stats cinder:UPDATE=179,cinder:SELECT=140,cinder:INSERT=41,cinder:DELETE=13 {{(pid=93468) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 29 03:44:40 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-50bde806-064b-4cc9-b434-e66f615f3359 tempest-SnapshotDependencyTests-1552874669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac7410f0-aa3c-4787-9336-d20924b72ffa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96fafe64-182a-4bd4-ad3c-c772d5245e04', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:44:40 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-50bde806-064b-4cc9-b434-e66f615f3359 tempest-SnapshotDependencyTests-1552874669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7e0c4d1-6d76-4625-a5a1-fa569dc98531) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:44:41 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-50bde806-064b-4cc9-b434-e66f615f3359 tempest-SnapshotDependencyTests-1552874669 None] Volume volume-96fafe64-182a-4bd4-ad3c-c772d5245e04 (96fafe64-182a-4bd4-ad3c-c772d5245e04): created successfully Jun 29 03:44:41 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-50bde806-064b-4cc9-b434-e66f615f3359 tempest-SnapshotDependencyTests-1552874669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7e0c4d1-6d76-4625-a5a1-fa569dc98531) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:44:41 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-50bde806-064b-4cc9-b434-e66f615f3359 tempest-SnapshotDependencyTests-1552874669 None] Flow 'volume_create_manager' (023b6088-4d1c-48be-b823-39f9e0c7e7ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:44:41 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-50bde806-064b-4cc9-b434-e66f615f3359 tempest-SnapshotDependencyTests-1552874669 None] Created volume successfully. Jun 29 03:44:41 devstack sudo[114895]: pam_unix(sudo:session): session closed for user root Jun 29 03:44:41 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-5ebb85d8-2bee-4ffc-bc36-b8420ecb56d9 tempest-VolumeImageDependencyTests-415092953 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-99a2aa65-6bc4-454d-83d6-2751a5bf7d04" returned: 1 in 1.076s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:44:41 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-5ebb85d8-2bee-4ffc-bc36-b8420ecb56d9 tempest-VolumeImageDependencyTests-415092953 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-99a2aa65-6bc4-454d-83d6-2751a5bf7d04' failed. Not Retrying. {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 29 03:44:41 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-5ebb85d8-2bee-4ffc-bc36-b8420ecb56d9 tempest-VolumeImageDependencyTests-415092953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-99a2aa65-6bc4-454d-83d6-2751a5bf7d04 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:44:41 devstack sudo[114902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-99a2aa65-6bc4-454d-83d6-2751a5bf7d04 Jun 29 03:44:41 devstack sudo[114902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:44:41 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e4f88ae-7773-472c-8cd6-6df7c8f9d31f tempest-CinderUnicodeTest-959952973 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:44:41 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-4e4f88ae-7773-472c-8cd6-6df7c8f9d31f tempest-CinderUnicodeTest-959952973 None] Flow 'volume_create_manager' (48a6c97c-cb55-4aac-96a0-d7a8879ae577) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:44:41 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-4e4f88ae-7773-472c-8cd6-6df7c8f9d31f tempest-CinderUnicodeTest-959952973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0cf87629-9d1a-4790-803c-c6c4dd838e6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:44:41 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-4e4f88ae-7773-472c-8cd6-6df7c8f9d31f tempest-CinderUnicodeTest-959952973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0cf87629-9d1a-4790-803c-c6c4dd838e6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:44:41Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98bd7c7a-a124-4930-b4f9-36bec30a31bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ed6f3063c74416daf90ec31a930954e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:44:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:44:42Z,use_quota=True,user_id='c7e0cc8d5eca4c9c930d2c5c8fbc09f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:44:41 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-4e4f88ae-7773-472c-8cd6-6df7c8f9d31f tempest-CinderUnicodeTest-959952973 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36020ca7-56b5-4de2-8538-17288aa93e65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:44:41 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-4e4f88ae-7773-472c-8cd6-6df7c8f9d31f tempest-CinderUnicodeTest-959952973 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36020ca7-56b5-4de2-8538-17288aa93e65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:44:41 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-4e4f88ae-7773-472c-8cd6-6df7c8f9d31f tempest-CinderUnicodeTest-959952973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75db1560-9d89-4ba6-ab5b-b9a73ea350b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:44:41 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-4e4f88ae-7773-472c-8cd6-6df7c8f9d31f tempest-CinderUnicodeTest-959952973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75db1560-9d89-4ba6-ab5b-b9a73ea350b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '98bd7c7a-a124-4930-b4f9-36bec30a31bd', 'volume_name': 'volume-98bd7c7a-a124-4930-b4f9-36bec30a31bd', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:44:41 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-4e4f88ae-7773-472c-8cd6-6df7c8f9d31f tempest-CinderUnicodeTest-959952973 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f05f7d3c-797d-47e0-9b76-8673b2144b20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:44:41 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-4e4f88ae-7773-472c-8cd6-6df7c8f9d31f tempest-CinderUnicodeTest-959952973 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f05f7d3c-797d-47e0-9b76-8673b2144b20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:44:41 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-4e4f88ae-7773-472c-8cd6-6df7c8f9d31f tempest-CinderUnicodeTest-959952973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4eea7e7a-741a-488e-b18b-47cd8a501cd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:44:41 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-4e4f88ae-7773-472c-8cd6-6df7c8f9d31f tempest-CinderUnicodeTest-959952973 None] Volume 98bd7c7a-a124-4930-b4f9-36bec30a31bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-98bd7c7a-a124-4930-b4f9-36bec30a31bd', 'volume_size': 1} Jun 29 03:44:41 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-4e4f88ae-7773-472c-8cd6-6df7c8f9d31f tempest-CinderUnicodeTest-959952973 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:44:41 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-4e4f88ae-7773-472c-8cd6-6df7c8f9d31f tempest-CinderUnicodeTest-959952973 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:44:41 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-4e4f88ae-7773-472c-8cd6-6df7c8f9d31f tempest-CinderUnicodeTest-959952973 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:44:41Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98bd7c7a-a124-4930-b4f9-36bec30a31bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ed6f3063c74416daf90ec31a930954e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:44:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:44:42Z,use_quota=True,user_id='c7e0cc8d5eca4c9c930d2c5c8fbc09f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:44:41 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-4e4f88ae-7773-472c-8cd6-6df7c8f9d31f tempest-CinderUnicodeTest-959952973 None] Creating volume 98bd7c7a-a124-4930-b4f9-36bec30a31bd {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:44:41 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-4e4f88ae-7773-472c-8cd6-6df7c8f9d31f tempest-CinderUnicodeTest-959952973 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:44:41 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-4e4f88ae-7773-472c-8cd6-6df7c8f9d31f tempest-CinderUnicodeTest-959952973 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:44:41 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-4e4f88ae-7773-472c-8cd6-6df7c8f9d31f tempest-CinderUnicodeTest-959952973 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:44:41 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-4e4f88ae-7773-472c-8cd6-6df7c8f9d31f tempest-CinderUnicodeTest-959952973 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:44:41 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-4e4f88ae-7773-472c-8cd6-6df7c8f9d31f tempest-CinderUnicodeTest-959952973 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:44:41 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-4e4f88ae-7773-472c-8cd6-6df7c8f9d31f tempest-CinderUnicodeTest-959952973 None] Selected osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:44:41 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-4e4f88ae-7773-472c-8cd6-6df7c8f9d31f tempest-CinderUnicodeTest-959952973 None] casted to osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f Jun 29 03:44:41 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-4e4f88ae-7773-472c-8cd6-6df7c8f9d31f tempest-CinderUnicodeTest-959952973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-98bd7c7a-a124-4930-b4f9-36bec30a31bd 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:44:41 devstack sudo[114904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-98bd7c7a-a124-4930-b4f9-36bec30a31bd 1073741824 Jun 29 03:44:41 devstack sudo[114904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:44:42 devstack sudo[114902]: pam_unix(sudo:session): session closed for user root Jun 29 03:44:42 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-5ebb85d8-2bee-4ffc-bc36-b8420ecb56d9 tempest-VolumeImageDependencyTests-415092953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-99a2aa65-6bc4-454d-83d6-2751a5bf7d04" returned: 0 in 0.730s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:44:42 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-5ebb85d8-2bee-4ffc-bc36-b8420ecb56d9 tempest-VolumeImageDependencyTests-415092953 None] Lock "cinder-quobyte-99a2aa65-6bc4-454d-83d6-2751a5bf7d04" released by "delete_volume" :: held 3.110s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:44:42 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-1d1bc1f2-9b43-4c8a-ac30-6077ba95ceb7 tempest-SnapshotDependencyTests-1552874669 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:44:42 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-5ebb85d8-2bee-4ffc-bc36-b8420ecb56d9 tempest-VolumeImageDependencyTests-415092953 None] Created reservations ['d5dfb83a-eb97-4a3d-9053-6b5bbd510fba', '1fcde563-cc13-4d73-a6d1-b209d2d0f545', '1c928fed-e5e4-4a51-b4d8-3984ff4b7c6a', '320eb637-7ed5-47ea-a147-2a7ba19159e2'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:44:42 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-5ebb85d8-2bee-4ffc-bc36-b8420ecb56d9 tempest-VolumeImageDependencyTests-415092953 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:44:42 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-5ebb85d8-2bee-4ffc-bc36-b8420ecb56d9 tempest-VolumeImageDependencyTests-415092953 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:44:42 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-5ebb85d8-2bee-4ffc-bc36-b8420ecb56d9 tempest-VolumeImageDependencyTests-415092953 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:44:42 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-5ebb85d8-2bee-4ffc-bc36-b8420ecb56d9 tempest-VolumeImageDependencyTests-415092953 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:44:42 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-5ebb85d8-2bee-4ffc-bc36-b8420ecb56d9 tempest-VolumeImageDependencyTests-415092953 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:44:42 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-5ebb85d8-2bee-4ffc-bc36-b8420ecb56d9 tempest-VolumeImageDependencyTests-415092953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:44:42 devstack sudo[114908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf Jun 29 03:44:42 devstack sudo[114908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:44:42 devstack sudo[114904]: pam_unix(sudo:session): session closed for user root Jun 29 03:44:42 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-4e4f88ae-7773-472c-8cd6-6df7c8f9d31f tempest-CinderUnicodeTest-959952973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-98bd7c7a-a124-4930-b4f9-36bec30a31bd 1073741824" returned: 0 in 1.148s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:44:42 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-4e4f88ae-7773-472c-8cd6-6df7c8f9d31f tempest-CinderUnicodeTest-959952973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-98bd7c7a-a124-4930-b4f9-36bec30a31bd {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:44:42 devstack sudo[114913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-98bd7c7a-a124-4930-b4f9-36bec30a31bd Jun 29 03:44:42 devstack sudo[114913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:44:43 devstack sudo[114908]: pam_unix(sudo:session): session closed for user root Jun 29 03:44:43 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-5ebb85d8-2bee-4ffc-bc36-b8420ecb56d9 tempest-VolumeImageDependencyTests-415092953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf" returned: 0 in 0.888s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:44:43 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-5ebb85d8-2bee-4ffc-bc36-b8420ecb56d9 tempest-VolumeImageDependencyTests-415092953 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:44:43 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-5ebb85d8-2bee-4ffc-bc36-b8420ecb56d9 tempest-VolumeImageDependencyTests-415092953 None] Deleted volume successfully. Jun 29 03:44:43 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-5ebb85d8-2bee-4ffc-bc36-b8420ecb56d9 tempest-VolumeImageDependencyTests-415092953 None] Lock "cinder-99a2aa65-6bc4-454d-83d6-2751a5bf7d04-delete_volume" released by "delete_volume" :: held 4.323s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:44:43 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-3104ea18-85f1-4303-b262-34d30fca34d7 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:44:43 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-3104ea18-85f1-4303-b262-34d30fca34d7 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Flow 'volume_create_manager' (1e785198-e8ed-4def-a87d-b2f7f39b2f6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:44:43 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-3104ea18-85f1-4303-b262-34d30fca34d7 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0d6f094-3175-4df3-b347-0cfd5e591b3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:44:43 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-3104ea18-85f1-4303-b262-34d30fca34d7 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0d6f094-3175-4df3-b347-0cfd5e591b3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:44:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-710325637',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77ea720f-92eb-446d-bc6b-8574635ef223,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0577b359fb67438a9be89aefbfa3faf5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:44:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:44:44Z,use_quota=True,user_id='4bafea5b2c65446a9139152133325f4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:44:43 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-3104ea18-85f1-4303-b262-34d30fca34d7 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e75aa1d-5bd4-4868-93ab-4f3dc72e6f3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:44:43 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-3104ea18-85f1-4303-b262-34d30fca34d7 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e75aa1d-5bd4-4868-93ab-4f3dc72e6f3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:44:43 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-3104ea18-85f1-4303-b262-34d30fca34d7 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60771812-8cc8-45d6-a8b2-e703ee9e78dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:44:43 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-3104ea18-85f1-4303-b262-34d30fca34d7 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60771812-8cc8-45d6-a8b2-e703ee9e78dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '77ea720f-92eb-446d-bc6b-8574635ef223', 'volume_name': 'volume-77ea720f-92eb-446d-bc6b-8574635ef223', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:44:43 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-3104ea18-85f1-4303-b262-34d30fca34d7 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39e774e1-2a3c-4251-955b-48792467402d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:44:43 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-3104ea18-85f1-4303-b262-34d30fca34d7 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39e774e1-2a3c-4251-955b-48792467402d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:44:43 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-3104ea18-85f1-4303-b262-34d30fca34d7 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a64de16-5119-4dbe-a522-ffa0cdf9fcd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:44:43 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-3104ea18-85f1-4303-b262-34d30fca34d7 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Volume 77ea720f-92eb-446d-bc6b-8574635ef223: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-77ea720f-92eb-446d-bc6b-8574635ef223', 'volume_size': 1} Jun 29 03:44:43 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-3104ea18-85f1-4303-b262-34d30fca34d7 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:44:43 devstack sudo[114913]: pam_unix(sudo:session): session closed for user root Jun 29 03:44:43 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-4e4f88ae-7773-472c-8cd6-6df7c8f9d31f tempest-CinderUnicodeTest-959952973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-98bd7c7a-a124-4930-b4f9-36bec30a31bd" returned: 0 in 0.875s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:44:43 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-4e4f88ae-7773-472c-8cd6-6df7c8f9d31f tempest-CinderUnicodeTest-959952973 None] <== create_volume: return (2073ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:44:43 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-4e4f88ae-7773-472c-8cd6-6df7c8f9d31f tempest-CinderUnicodeTest-959952973 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.076s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:44:43 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-1d1bc1f2-9b43-4c8a-ac30-6077ba95ceb7 tempest-SnapshotDependencyTests-1552874669 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.588s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:44:43 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-4e4f88ae-7773-472c-8cd6-6df7c8f9d31f tempest-CinderUnicodeTest-959952973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4eea7e7a-741a-488e-b18b-47cd8a501cd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-98bd7c7a-a124-4930-b4f9-36bec30a31bd', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:44:43 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-4e4f88ae-7773-472c-8cd6-6df7c8f9d31f tempest-CinderUnicodeTest-959952973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e037080-df01-423c-9e05-568dbb02b03a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:44:43 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-1d1bc1f2-9b43-4c8a-ac30-6077ba95ceb7 tempest-SnapshotDependencyTests-1552874669 None] Creating offline snapshot 8c76f07b-c923-4a09-9b76-aaf8171bc0a2 of volume 96fafe64-182a-4bd4-ad3c-c772d5245e04 {{(pid=93468) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 29 03:44:43 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-4e4f88ae-7773-472c-8cd6-6df7c8f9d31f tempest-CinderUnicodeTest-959952973 None] Volume volume-98bd7c7a-a124-4930-b4f9-36bec30a31bd (98bd7c7a-a124-4930-b4f9-36bec30a31bd): created successfully Jun 29 03:44:43 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-4e4f88ae-7773-472c-8cd6-6df7c8f9d31f tempest-CinderUnicodeTest-959952973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e037080-df01-423c-9e05-568dbb02b03a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:44:43 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-4e4f88ae-7773-472c-8cd6-6df7c8f9d31f tempest-CinderUnicodeTest-959952973 None] Flow 'volume_create_manager' (48a6c97c-cb55-4aac-96a0-d7a8879ae577) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:44:43 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[8baea8a8-69be-4a16-b55a-16f88c1305f9]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:44:43 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-1d1bc1f2-9b43-4c8a-ac30-6077ba95ceb7 tempest-SnapshotDependencyTests-1552874669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-96fafe64-182a-4bd4-ad3c-c772d5245e04 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:44:43 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-4e4f88ae-7773-472c-8cd6-6df7c8f9d31f tempest-CinderUnicodeTest-959952973 None] Created volume successfully. Jun 29 03:44:44 devstack sudo[114918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-96fafe64-182a-4bd4-ad3c-c772d5245e04 Jun 29 03:44:44 devstack sudo[114918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:44:44 devstack sudo[114918]: pam_unix(sudo:session): session closed for user root Jun 29 03:44:44 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-1d1bc1f2-9b43-4c8a-ac30-6077ba95ceb7 tempest-SnapshotDependencyTests-1552874669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-96fafe64-182a-4bd4-ad3c-c772d5245e04" returned: 0 in 0.799s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:44:44 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-1d1bc1f2-9b43-4c8a-ac30-6077ba95ceb7 tempest-SnapshotDependencyTests-1552874669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-96fafe64-182a-4bd4-ad3c-c772d5245e04,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-96fafe64-182a-4bd4-ad3c-c772d5245e04.8c76f07b-c923-4a09-9b76-aaf8171bc0a2 1G {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:44:44 devstack sudo[114923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-96fafe64-182a-4bd4-ad3c-c772d5245e04,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-96fafe64-182a-4bd4-ad3c-c772d5245e04.8c76f07b-c923-4a09-9b76-aaf8171bc0a2 1G Jun 29 03:44:44 devstack sudo[114923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:44:45 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-df0c4b29-530a-4556-bdd9-f8cecfec8957 tempest-CinderUnicodeTest-959952973 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:44:45 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-df0c4b29-530a-4556-bdd9-f8cecfec8957 tempest-CinderUnicodeTest-959952973 None] Flow 'volume_create_manager' (2b1954d8-1f1a-4e1a-9077-6c39f82512c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:44:45 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-df0c4b29-530a-4556-bdd9-f8cecfec8957 tempest-CinderUnicodeTest-959952973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (417f74fc-4302-4f77-ac05-810e0b53b17b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:44:45 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-df0c4b29-530a-4556-bdd9-f8cecfec8957 tempest-CinderUnicodeTest-959952973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (417f74fc-4302-4f77-ac05-810e0b53b17b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:44:45Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-880021432',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59bb9eeb-2c3b-44a9-8995-d0a92ac00421,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ed6f3063c74416daf90ec31a930954e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:44:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:44:45Z,use_quota=True,user_id='c7e0cc8d5eca4c9c930d2c5c8fbc09f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:44:45 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-df0c4b29-530a-4556-bdd9-f8cecfec8957 tempest-CinderUnicodeTest-959952973 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1ccf067-748c-4004-82e4-122923598d0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:44:45 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-df0c4b29-530a-4556-bdd9-f8cecfec8957 tempest-CinderUnicodeTest-959952973 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1ccf067-748c-4004-82e4-122923598d0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:44:45 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-df0c4b29-530a-4556-bdd9-f8cecfec8957 tempest-CinderUnicodeTest-959952973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (735848ea-a3fc-436d-9d4a-6a2b9a1c8a0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:44:45 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-df0c4b29-530a-4556-bdd9-f8cecfec8957 tempest-CinderUnicodeTest-959952973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (735848ea-a3fc-436d-9d4a-6a2b9a1c8a0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '59bb9eeb-2c3b-44a9-8995-d0a92ac00421', 'volume_name': 'volume-59bb9eeb-2c3b-44a9-8995-d0a92ac00421', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:44:45 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-df0c4b29-530a-4556-bdd9-f8cecfec8957 tempest-CinderUnicodeTest-959952973 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04a0be02-5bf5-40ca-a883-6286425d80b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:44:45 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-df0c4b29-530a-4556-bdd9-f8cecfec8957 tempest-CinderUnicodeTest-959952973 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04a0be02-5bf5-40ca-a883-6286425d80b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:44:45 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-df0c4b29-530a-4556-bdd9-f8cecfec8957 tempest-CinderUnicodeTest-959952973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc33af99-90d7-47df-8c61-8a186515c5aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:44:45 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-df0c4b29-530a-4556-bdd9-f8cecfec8957 tempest-CinderUnicodeTest-959952973 None] Volume 59bb9eeb-2c3b-44a9-8995-d0a92ac00421: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-59bb9eeb-2c3b-44a9-8995-d0a92ac00421', 'volume_size': 1} Jun 29 03:44:45 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-df0c4b29-530a-4556-bdd9-f8cecfec8957 tempest-CinderUnicodeTest-959952973 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:44:45 devstack sudo[114923]: pam_unix(sudo:session): session closed for user root Jun 29 03:44:45 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-1d1bc1f2-9b43-4c8a-ac30-6077ba95ceb7 tempest-SnapshotDependencyTests-1552874669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-96fafe64-182a-4bd4-ad3c-c772d5245e04,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-96fafe64-182a-4bd4-ad3c-c772d5245e04.8c76f07b-c923-4a09-9b76-aaf8171bc0a2 1G" returned: 0 in 0.836s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:44:45 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-1d1bc1f2-9b43-4c8a-ac30-6077ba95ceb7 tempest-SnapshotDependencyTests-1552874669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-96fafe64-182a-4bd4-ad3c-c772d5245e04 -F qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-96fafe64-182a-4bd4-ad3c-c772d5245e04.8c76f07b-c923-4a09-9b76-aaf8171bc0a2 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:44:45 devstack sudo[114928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-96fafe64-182a-4bd4-ad3c-c772d5245e04 -F qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-96fafe64-182a-4bd4-ad3c-c772d5245e04.8c76f07b-c923-4a09-9b76-aaf8171bc0a2 Jun 29 03:44:45 devstack sudo[114928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:44:46 devstack sudo[114928]: pam_unix(sudo:session): session closed for user root Jun 29 03:44:46 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-1d1bc1f2-9b43-4c8a-ac30-6077ba95ceb7 tempest-SnapshotDependencyTests-1552874669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-96fafe64-182a-4bd4-ad3c-c772d5245e04 -F qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-96fafe64-182a-4bd4-ad3c-c772d5245e04.8c76f07b-c923-4a09-9b76-aaf8171bc0a2" returned: 0 in 0.680s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:44:46 devstack cinder-volume[93468]: WARNING cinder.volume.drivers.remotefs [None req-1d1bc1f2-9b43-4c8a-ac30-6077ba95ceb7 tempest-SnapshotDependencyTests-1552874669 None] /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-96fafe64-182a-4bd4-ad3c-c772d5245e04.8c76f07b-c923-4a09-9b76-aaf8171bc0a2 is being set with open permissions: ugo+rw Jun 29 03:44:46 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-1d1bc1f2-9b43-4c8a-ac30-6077ba95ceb7 tempest-SnapshotDependencyTests-1552874669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-96fafe64-182a-4bd4-ad3c-c772d5245e04.8c76f07b-c923-4a09-9b76-aaf8171bc0a2 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:44:46 devstack sudo[114933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-96fafe64-182a-4bd4-ad3c-c772d5245e04.8c76f07b-c923-4a09-9b76-aaf8171bc0a2 Jun 29 03:44:46 devstack sudo[114933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:44:46 devstack sudo[114933]: pam_unix(sudo:session): session closed for user root Jun 29 03:44:46 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-1d1bc1f2-9b43-4c8a-ac30-6077ba95ceb7 tempest-SnapshotDependencyTests-1552874669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-96fafe64-182a-4bd4-ad3c-c772d5245e04.8c76f07b-c923-4a09-9b76-aaf8171bc0a2" returned: 0 in 0.666s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:44:46 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-1d1bc1f2-9b43-4c8a-ac30-6077ba95ceb7 tempest-SnapshotDependencyTests-1552874669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-96fafe64-182a-4bd4-ad3c-c772d5245e04.info {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:44:46 devstack sudo[114936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-96fafe64-182a-4bd4-ad3c-c772d5245e04.info Jun 29 03:44:46 devstack sudo[114936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:44:47 devstack sudo[114936]: pam_unix(sudo:session): session closed for user root Jun 29 03:44:47 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-1d1bc1f2-9b43-4c8a-ac30-6077ba95ceb7 tempest-SnapshotDependencyTests-1552874669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-96fafe64-182a-4bd4-ad3c-c772d5245e04.info" returned: 0 in 0.633s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:44:47 devstack cinder-volume[93468]: WARNING cinder.volume.drivers.remotefs [None req-1d1bc1f2-9b43-4c8a-ac30-6077ba95ceb7 tempest-SnapshotDependencyTests-1552874669 None] /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-96fafe64-182a-4bd4-ad3c-c772d5245e04.info is being set with open permissions: ugo+rw Jun 29 03:44:47 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-1d1bc1f2-9b43-4c8a-ac30-6077ba95ceb7 tempest-SnapshotDependencyTests-1552874669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-96fafe64-182a-4bd4-ad3c-c772d5245e04.info {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:44:47 devstack sudo[114939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-96fafe64-182a-4bd4-ad3c-c772d5245e04.info Jun 29 03:44:47 devstack sudo[114939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:44:48 devstack sudo[114939]: pam_unix(sudo:session): session closed for user root Jun 29 03:44:48 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-1d1bc1f2-9b43-4c8a-ac30-6077ba95ceb7 tempest-SnapshotDependencyTests-1552874669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-96fafe64-182a-4bd4-ad3c-c772d5245e04.info" returned: 0 in 0.633s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:44:48 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-1d1bc1f2-9b43-4c8a-ac30-6077ba95ceb7 tempest-SnapshotDependencyTests-1552874669 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.360s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:44:48 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-3104ea18-85f1-4303-b262-34d30fca34d7 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.441s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:44:48 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-3104ea18-85f1-4303-b262-34d30fca34d7 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:44:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-710325637',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77ea720f-92eb-446d-bc6b-8574635ef223,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0577b359fb67438a9be89aefbfa3faf5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:44:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:44:44Z,use_quota=True,user_id='4bafea5b2c65446a9139152133325f4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:44:48 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-3104ea18-85f1-4303-b262-34d30fca34d7 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Creating volume 77ea720f-92eb-446d-bc6b-8574635ef223 {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:44:48 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-3104ea18-85f1-4303-b262-34d30fca34d7 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:44:48 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-3104ea18-85f1-4303-b262-34d30fca34d7 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:44:48 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-3104ea18-85f1-4303-b262-34d30fca34d7 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:44:48 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-3104ea18-85f1-4303-b262-34d30fca34d7 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:44:48 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-3104ea18-85f1-4303-b262-34d30fca34d7 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:44:48 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-3104ea18-85f1-4303-b262-34d30fca34d7 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Selected osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:44:48 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-3104ea18-85f1-4303-b262-34d30fca34d7 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] casted to osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f Jun 29 03:44:48 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-3104ea18-85f1-4303-b262-34d30fca34d7 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-77ea720f-92eb-446d-bc6b-8574635ef223 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:44:48 devstack sudo[114942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-77ea720f-92eb-446d-bc6b-8574635ef223 1073741824 Jun 29 03:44:48 devstack sudo[114942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:44:48 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-1d1bc1f2-9b43-4c8a-ac30-6077ba95ceb7 tempest-SnapshotDependencyTests-1552874669 None] Create snapshot completed successfully Jun 29 03:44:49 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-feeec1e8-b079-40fa-b711-7ede18064cb7 tempest-SnapshotDependencyTests-1552874669 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:44:49 devstack sudo[114942]: pam_unix(sudo:session): session closed for user root Jun 29 03:44:49 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-3104ea18-85f1-4303-b262-34d30fca34d7 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-77ea720f-92eb-446d-bc6b-8574635ef223 1073741824" returned: 0 in 0.931s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:44:49 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-feeec1e8-b079-40fa-b711-7ede18064cb7 tempest-SnapshotDependencyTests-1552874669 None] Flow 'volume_create_manager' (0c7e5c29-d45b-4129-9473-43c1304dbf1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:44:49 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-feeec1e8-b079-40fa-b711-7ede18064cb7 tempest-SnapshotDependencyTests-1552874669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d432648-f216-4873-b6f0-63f9462df0ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:44:49 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-feeec1e8-b079-40fa-b711-7ede18064cb7 tempest-SnapshotDependencyTests-1552874669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d432648-f216-4873-b6f0-63f9462df0ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:44:49Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bda352a8-b493-49ee-9420-ca94eb4ee3cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d15a086091646d88fbfe1a2ecdff48e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:44:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=8c76f07b-c923-4a09-9b76-aaf8171bc0a2,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:44:49Z,use_quota=True,user_id='65069cded37145639ac8e87b09879723',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:44:49 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-feeec1e8-b079-40fa-b711-7ede18064cb7 tempest-SnapshotDependencyTests-1552874669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f1a7c84-0911-4e17-952c-b886324ef727) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:44:49 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-feeec1e8-b079-40fa-b711-7ede18064cb7 tempest-SnapshotDependencyTests-1552874669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f1a7c84-0911-4e17-952c-b886324ef727) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:44:49 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-feeec1e8-b079-40fa-b711-7ede18064cb7 tempest-SnapshotDependencyTests-1552874669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (062016ae-b62d-4fe2-bab0-b779371ad41a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:44:49 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-feeec1e8-b079-40fa-b711-7ede18064cb7 tempest-SnapshotDependencyTests-1552874669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (062016ae-b62d-4fe2-bab0-b779371ad41a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'bda352a8-b493-49ee-9420-ca94eb4ee3cd', 'volume_name': 'volume-bda352a8-b493-49ee-9420-ca94eb4ee3cd', 'volume_size': 1, 'snapshot_id': '8c76f07b-c923-4a09-9b76-aaf8171bc0a2'}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:44:49 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-feeec1e8-b079-40fa-b711-7ede18064cb7 tempest-SnapshotDependencyTests-1552874669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b14bbff-264e-46a5-a3a0-8f50c6d1ac48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:44:49 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-feeec1e8-b079-40fa-b711-7ede18064cb7 tempest-SnapshotDependencyTests-1552874669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b14bbff-264e-46a5-a3a0-8f50c6d1ac48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:44:49 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-feeec1e8-b079-40fa-b711-7ede18064cb7 tempest-SnapshotDependencyTests-1552874669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ef9c97b-6404-4404-a3b3-f0dff3db99f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:44:49 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-feeec1e8-b079-40fa-b711-7ede18064cb7 tempest-SnapshotDependencyTests-1552874669 None] Volume bda352a8-b493-49ee-9420-ca94eb4ee3cd: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-bda352a8-b493-49ee-9420-ca94eb4ee3cd', 'volume_size': 1, 'snapshot_id': '8c76f07b-c923-4a09-9b76-aaf8171bc0a2'} Jun 29 03:44:49 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-feeec1e8-b079-40fa-b711-7ede18064cb7 tempest-SnapshotDependencyTests-1552874669 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:44:49 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-3104ea18-85f1-4303-b262-34d30fca34d7 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-77ea720f-92eb-446d-bc6b-8574635ef223 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:44:49 devstack sudo[114984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-77ea720f-92eb-446d-bc6b-8574635ef223 Jun 29 03:44:49 devstack sudo[114984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:44:49 devstack sudo[114984]: pam_unix(sudo:session): session closed for user root Jun 29 03:44:49 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-3104ea18-85f1-4303-b262-34d30fca34d7 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-77ea720f-92eb-446d-bc6b-8574635ef223" returned: 0 in 0.670s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:44:49 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-3104ea18-85f1-4303-b262-34d30fca34d7 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] <== create_volume: return (1727ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:44:49 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-3104ea18-85f1-4303-b262-34d30fca34d7 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.730s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:44:49 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-df0c4b29-530a-4556-bdd9-f8cecfec8957 tempest-CinderUnicodeTest-959952973 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.444s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:44:49 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-df0c4b29-530a-4556-bdd9-f8cecfec8957 tempest-CinderUnicodeTest-959952973 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:44:45Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-880021432',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59bb9eeb-2c3b-44a9-8995-d0a92ac00421,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ed6f3063c74416daf90ec31a930954e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:44:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:44:45Z,use_quota=True,user_id='c7e0cc8d5eca4c9c930d2c5c8fbc09f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:44:49 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-df0c4b29-530a-4556-bdd9-f8cecfec8957 tempest-CinderUnicodeTest-959952973 None] Creating volume 59bb9eeb-2c3b-44a9-8995-d0a92ac00421 {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:44:49 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-df0c4b29-530a-4556-bdd9-f8cecfec8957 tempest-CinderUnicodeTest-959952973 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:44:49 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-df0c4b29-530a-4556-bdd9-f8cecfec8957 tempest-CinderUnicodeTest-959952973 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:44:49 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-df0c4b29-530a-4556-bdd9-f8cecfec8957 tempest-CinderUnicodeTest-959952973 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:44:49 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-df0c4b29-530a-4556-bdd9-f8cecfec8957 tempest-CinderUnicodeTest-959952973 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:44:49 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-df0c4b29-530a-4556-bdd9-f8cecfec8957 tempest-CinderUnicodeTest-959952973 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:44:49 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-df0c4b29-530a-4556-bdd9-f8cecfec8957 tempest-CinderUnicodeTest-959952973 None] Selected osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:44:49 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-df0c4b29-530a-4556-bdd9-f8cecfec8957 tempest-CinderUnicodeTest-959952973 None] casted to osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f Jun 29 03:44:49 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-df0c4b29-530a-4556-bdd9-f8cecfec8957 tempest-CinderUnicodeTest-959952973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-59bb9eeb-2c3b-44a9-8995-d0a92ac00421 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:44:49 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-3104ea18-85f1-4303-b262-34d30fca34d7 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a64de16-5119-4dbe-a522-ffa0cdf9fcd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-77ea720f-92eb-446d-bc6b-8574635ef223', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:44:49 devstack sudo[114987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-59bb9eeb-2c3b-44a9-8995-d0a92ac00421 1073741824 Jun 29 03:44:49 devstack sudo[114987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:44:49 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-3104ea18-85f1-4303-b262-34d30fca34d7 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c1915f4-3baf-401b-af53-027f330aca15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:44:49 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-3104ea18-85f1-4303-b262-34d30fca34d7 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Volume volume-77ea720f-92eb-446d-bc6b-8574635ef223 (77ea720f-92eb-446d-bc6b-8574635ef223): created successfully Jun 29 03:44:49 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-3104ea18-85f1-4303-b262-34d30fca34d7 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c1915f4-3baf-401b-af53-027f330aca15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:44:49 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-3104ea18-85f1-4303-b262-34d30fca34d7 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Flow 'volume_create_manager' (1e785198-e8ed-4def-a87d-b2f7f39b2f6e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:44:50 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-3104ea18-85f1-4303-b262-34d30fca34d7 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Created volume successfully. Jun 29 03:44:50 devstack sudo[114987]: pam_unix(sudo:session): session closed for user root Jun 29 03:44:50 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-df0c4b29-530a-4556-bdd9-f8cecfec8957 tempest-CinderUnicodeTest-959952973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-59bb9eeb-2c3b-44a9-8995-d0a92ac00421 1073741824" returned: 0 in 0.822s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:44:50 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-df0c4b29-530a-4556-bdd9-f8cecfec8957 tempest-CinderUnicodeTest-959952973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-59bb9eeb-2c3b-44a9-8995-d0a92ac00421 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:44:50 devstack sudo[114992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-59bb9eeb-2c3b-44a9-8995-d0a92ac00421 Jun 29 03:44:50 devstack sudo[114992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:44:51 devstack sudo[114992]: pam_unix(sudo:session): session closed for user root Jun 29 03:44:51 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-df0c4b29-530a-4556-bdd9-f8cecfec8957 tempest-CinderUnicodeTest-959952973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-59bb9eeb-2c3b-44a9-8995-d0a92ac00421" returned: 0 in 0.681s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:44:51 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-df0c4b29-530a-4556-bdd9-f8cecfec8957 tempest-CinderUnicodeTest-959952973 None] <== create_volume: return (1543ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:44:51 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-df0c4b29-530a-4556-bdd9-f8cecfec8957 tempest-CinderUnicodeTest-959952973 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.549s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:44:51 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-feeec1e8-b079-40fa-b711-7ede18064cb7 tempest-SnapshotDependencyTests-1552874669 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.243s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:44:51 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-feeec1e8-b079-40fa-b711-7ede18064cb7 tempest-SnapshotDependencyTests-1552874669 None] Acquiring lock "cinder-quobyte-8c76f07b-c923-4a09-9b76-aaf8171bc0a2-bda352a8-b493-49ee-9420-ca94eb4ee3cd" by "_create_volume_from_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:44:51 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-72fcdf5e-0450-4b26-81a5-a6d5ef07b7ad tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:44:51 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-72fcdf5e-0450-4b26-81a5-a6d5ef07b7ad tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Flow 'volume_create_manager' (b6284cb8-ca33-402f-90f4-e5070bad5d8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:44:51 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-72fcdf5e-0450-4b26-81a5-a6d5ef07b7ad tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38a8136c-d63b-42f1-a793-e03778ec433d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:44:51 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-df0c4b29-530a-4556-bdd9-f8cecfec8957 tempest-CinderUnicodeTest-959952973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc33af99-90d7-47df-8c61-8a186515c5aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-59bb9eeb-2c3b-44a9-8995-d0a92ac00421', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:44:51 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-df0c4b29-530a-4556-bdd9-f8cecfec8957 tempest-CinderUnicodeTest-959952973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fbc3627-497f-4c91-861f-fd2844d5f1bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:44:51 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-feeec1e8-b079-40fa-b711-7ede18064cb7 tempest-SnapshotDependencyTests-1552874669 None] Lock "cinder-quobyte-8c76f07b-c923-4a09-9b76-aaf8171bc0a2-bda352a8-b493-49ee-9420-ca94eb4ee3cd" acquired by "_create_volume_from_snapshot" :: waited 0.070s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:44:51 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-feeec1e8-b079-40fa-b711-7ede18064cb7 tempest-SnapshotDependencyTests-1552874669 None] Creating volume bda352a8-b493-49ee-9420-ca94eb4ee3cd from snapshot 8c76f07b-c923-4a09-9b76-aaf8171bc0a2 {{(pid=93468) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 29 03:44:51 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-feeec1e8-b079-40fa-b711-7ede18064cb7 tempest-SnapshotDependencyTests-1552874669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:44:51 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-feeec1e8-b079-40fa-b711-7ede18064cb7 tempest-SnapshotDependencyTests-1552874669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:44:51 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-feeec1e8-b079-40fa-b711-7ede18064cb7 tempest-SnapshotDependencyTests-1552874669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:44:51 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-feeec1e8-b079-40fa-b711-7ede18064cb7 tempest-SnapshotDependencyTests-1552874669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:44:51 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-feeec1e8-b079-40fa-b711-7ede18064cb7 tempest-SnapshotDependencyTests-1552874669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:44:51 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-feeec1e8-b079-40fa-b711-7ede18064cb7 tempest-SnapshotDependencyTests-1552874669 None] Selected osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:44:51 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-feeec1e8-b079-40fa-b711-7ede18064cb7 tempest-SnapshotDependencyTests-1552874669 None] Acquiring lock "cinder-quobyte-bda352a8-b493-49ee-9420-ca94eb4ee3cd" by "_copy_volume_from_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:44:51 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-72fcdf5e-0450-4b26-81a5-a6d5ef07b7ad tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38a8136c-d63b-42f1-a793-e03778ec433d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:44:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1588151187',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3d773d4-9513-4eea-836a-6fc1b02a2fa2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0577b359fb67438a9be89aefbfa3faf5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:44:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:44:51Z,use_quota=True,user_id='4bafea5b2c65446a9139152133325f4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:44:51 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-72fcdf5e-0450-4b26-81a5-a6d5ef07b7ad tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe83f505-12eb-4688-8d05-0cecafcfa215) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:44:51 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-72fcdf5e-0450-4b26-81a5-a6d5ef07b7ad tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe83f505-12eb-4688-8d05-0cecafcfa215) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:44:51 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-72fcdf5e-0450-4b26-81a5-a6d5ef07b7ad tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (112fed7f-ee6f-4290-a233-4fb69fa4eeb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:44:51 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-72fcdf5e-0450-4b26-81a5-a6d5ef07b7ad tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (112fed7f-ee6f-4290-a233-4fb69fa4eeb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b3d773d4-9513-4eea-836a-6fc1b02a2fa2', 'volume_name': 'volume-b3d773d4-9513-4eea-836a-6fc1b02a2fa2', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:44:51 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-72fcdf5e-0450-4b26-81a5-a6d5ef07b7ad tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8538fbf-a84e-4a4e-973f-985aa1d34240) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:44:51 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-72fcdf5e-0450-4b26-81a5-a6d5ef07b7ad tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8538fbf-a84e-4a4e-973f-985aa1d34240) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:44:51 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-72fcdf5e-0450-4b26-81a5-a6d5ef07b7ad tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04354d09-62c5-4a14-a892-897d32743a80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:44:51 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-72fcdf5e-0450-4b26-81a5-a6d5ef07b7ad tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Volume b3d773d4-9513-4eea-836a-6fc1b02a2fa2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b3d773d4-9513-4eea-836a-6fc1b02a2fa2', 'volume_size': 1} Jun 29 03:44:51 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-72fcdf5e-0450-4b26-81a5-a6d5ef07b7ad tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:44:51 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-df0c4b29-530a-4556-bdd9-f8cecfec8957 tempest-CinderUnicodeTest-959952973 None] Volume volume-59bb9eeb-2c3b-44a9-8995-d0a92ac00421 (59bb9eeb-2c3b-44a9-8995-d0a92ac00421): created successfully Jun 29 03:44:51 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-df0c4b29-530a-4556-bdd9-f8cecfec8957 tempest-CinderUnicodeTest-959952973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fbc3627-497f-4c91-861f-fd2844d5f1bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:44:51 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-df0c4b29-530a-4556-bdd9-f8cecfec8957 tempest-CinderUnicodeTest-959952973 None] Flow 'volume_create_manager' (2b1954d8-1f1a-4e1a-9077-6c39f82512c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:44:51 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-feeec1e8-b079-40fa-b711-7ede18064cb7 tempest-SnapshotDependencyTests-1552874669 None] Lock "cinder-quobyte-bda352a8-b493-49ee-9420-ca94eb4ee3cd" acquired by "_copy_volume_from_snapshot" :: waited 0.085s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:44:51 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-feeec1e8-b079-40fa-b711-7ede18064cb7 tempest-SnapshotDependencyTests-1552874669 None] snapshot: 8c76f07b-c923-4a09-9b76-aaf8171bc0a2, volume: bda352a8-b493-49ee-9420-ca94eb4ee3cd, {{(pid=93468) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 29 03:44:51 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-df0c4b29-530a-4556-bdd9-f8cecfec8957 tempest-CinderUnicodeTest-959952973 None] Created volume successfully. Jun 29 03:44:51 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-feeec1e8-b079-40fa-b711-7ede18064cb7 tempest-SnapshotDependencyTests-1552874669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:44:51 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-feeec1e8-b079-40fa-b711-7ede18064cb7 tempest-SnapshotDependencyTests-1552874669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:44:51 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-feeec1e8-b079-40fa-b711-7ede18064cb7 tempest-SnapshotDependencyTests-1552874669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:44:51 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-feeec1e8-b079-40fa-b711-7ede18064cb7 tempest-SnapshotDependencyTests-1552874669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:44:51 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-feeec1e8-b079-40fa-b711-7ede18064cb7 tempest-SnapshotDependencyTests-1552874669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:44:51 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[f44b3d4f-a2f1-4f1d-8bb1-6c13c2e52b8f]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:44:51 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-feeec1e8-b079-40fa-b711-7ede18064cb7 tempest-SnapshotDependencyTests-1552874669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-96fafe64-182a-4bd4-ad3c-c772d5245e04.8c76f07b-c923-4a09-9b76-aaf8171bc0a2 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:44:51 devstack sudo[114995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-96fafe64-182a-4bd4-ad3c-c772d5245e04.8c76f07b-c923-4a09-9b76-aaf8171bc0a2 Jun 29 03:44:51 devstack sudo[114995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:44:51 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-889a0e31-2b87-47f3-8236-427828d43dcb tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:44:51 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-889a0e31-2b87-47f3-8236-427828d43dcb tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Flow 'volume_create_manager' (d688b847-f227-4233-a2fb-6b148e31f388) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:44:51 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-889a0e31-2b87-47f3-8236-427828d43dcb tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9eb2af31-ef22-4bdd-aae3-364374799ece) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:44:51 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-889a0e31-2b87-47f3-8236-427828d43dcb tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9eb2af31-ef22-4bdd-aae3-364374799ece) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:44:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-705118037',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0068d0d-3e19-44fb-beae-6a0ea5cc24c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0577b359fb67438a9be89aefbfa3faf5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:44:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:44:52Z,use_quota=True,user_id='4bafea5b2c65446a9139152133325f4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:44:51 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-889a0e31-2b87-47f3-8236-427828d43dcb tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98f20b88-5e52-4be9-b8ee-460dbcaad979) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:44:51 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-889a0e31-2b87-47f3-8236-427828d43dcb tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98f20b88-5e52-4be9-b8ee-460dbcaad979) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:44:51 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-889a0e31-2b87-47f3-8236-427828d43dcb tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26f3ba38-80ec-4ff2-a8f8-3c8fa448dc12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:44:51 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-889a0e31-2b87-47f3-8236-427828d43dcb tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26f3ba38-80ec-4ff2-a8f8-3c8fa448dc12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a0068d0d-3e19-44fb-beae-6a0ea5cc24c6', 'volume_name': 'volume-a0068d0d-3e19-44fb-beae-6a0ea5cc24c6', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:44:51 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-889a0e31-2b87-47f3-8236-427828d43dcb tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a2719fe-3587-43ff-9af6-aff680a3f312) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:44:51 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-889a0e31-2b87-47f3-8236-427828d43dcb tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a2719fe-3587-43ff-9af6-aff680a3f312) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:44:51 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-889a0e31-2b87-47f3-8236-427828d43dcb tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a0bd8c0-fdd5-4eff-8a1e-2377dd6a565c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:44:51 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-889a0e31-2b87-47f3-8236-427828d43dcb tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Volume a0068d0d-3e19-44fb-beae-6a0ea5cc24c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a0068d0d-3e19-44fb-beae-6a0ea5cc24c6', 'volume_size': 1} Jun 29 03:44:51 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-889a0e31-2b87-47f3-8236-427828d43dcb tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:44:52 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-602df98f-c5d3-40a4-bfa6-59c80b9300e8 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:44:52 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-602df98f-c5d3-40a4-bfa6-59c80b9300e8 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Flow 'volume_create_manager' (b65bede8-99c3-4929-8126-f0e20af20ee8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:44:52 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-602df98f-c5d3-40a4-bfa6-59c80b9300e8 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b132a55d-36f8-4a85-84fc-2584c811590c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:44:52 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-602df98f-c5d3-40a4-bfa6-59c80b9300e8 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b132a55d-36f8-4a85-84fc-2584c811590c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:44:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-884519507',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b84c5655-69dd-49b7-a20e-ef2aedb2a564,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0577b359fb67438a9be89aefbfa3faf5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:44:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:44:52Z,use_quota=True,user_id='4bafea5b2c65446a9139152133325f4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:44:52 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-602df98f-c5d3-40a4-bfa6-59c80b9300e8 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a411cb1-9904-489f-a725-fcc3b3853e11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:44:52 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-602df98f-c5d3-40a4-bfa6-59c80b9300e8 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a411cb1-9904-489f-a725-fcc3b3853e11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:44:52 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-602df98f-c5d3-40a4-bfa6-59c80b9300e8 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f815074-edba-4a54-b1a2-5ed18ab88002) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:44:52 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-602df98f-c5d3-40a4-bfa6-59c80b9300e8 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f815074-edba-4a54-b1a2-5ed18ab88002) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b84c5655-69dd-49b7-a20e-ef2aedb2a564', 'volume_name': 'volume-b84c5655-69dd-49b7-a20e-ef2aedb2a564', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:44:52 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-602df98f-c5d3-40a4-bfa6-59c80b9300e8 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2f46f79-7d4f-437b-8848-20ca89418363) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:44:52 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-602df98f-c5d3-40a4-bfa6-59c80b9300e8 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2f46f79-7d4f-437b-8848-20ca89418363) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:44:52 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-602df98f-c5d3-40a4-bfa6-59c80b9300e8 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (858d2594-9363-4cf7-9572-88bcb421fd23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:44:52 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-602df98f-c5d3-40a4-bfa6-59c80b9300e8 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Volume b84c5655-69dd-49b7-a20e-ef2aedb2a564: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b84c5655-69dd-49b7-a20e-ef2aedb2a564', 'volume_size': 1} Jun 29 03:44:52 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-602df98f-c5d3-40a4-bfa6-59c80b9300e8 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:44:52 devstack sudo[114995]: pam_unix(sudo:session): session closed for user root Jun 29 03:44:52 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-feeec1e8-b079-40fa-b711-7ede18064cb7 tempest-SnapshotDependencyTests-1552874669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-96fafe64-182a-4bd4-ad3c-c772d5245e04.8c76f07b-c923-4a09-9b76-aaf8171bc0a2" returned: 0 in 0.834s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:44:52 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-feeec1e8-b079-40fa-b711-7ede18064cb7 tempest-SnapshotDependencyTests-1552874669 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-96fafe64-182a-4bd4-ad3c-c772d5245e04(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93468) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 29 03:44:52 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-feeec1e8-b079-40fa-b711-7ede18064cb7 tempest-SnapshotDependencyTests-1552874669 None] will copy from snapshot at /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-96fafe64-182a-4bd4-ad3c-c772d5245e04 {{(pid=93468) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 29 03:44:52 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-feeec1e8-b079-40fa-b711-7ede18064cb7 tempest-SnapshotDependencyTests-1552874669 None] Creating direct copy from snapshot {{(pid=93468) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 29 03:44:52 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-d93075c8-2685-43a0-bf4f-f0b89248c3fa tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:44:52 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-d93075c8-2685-43a0-bf4f-f0b89248c3fa tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Flow 'volume_create_manager' (56d49fd6-94bf-4abf-87d5-fb5dd364d6e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:44:52 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-d93075c8-2685-43a0-bf4f-f0b89248c3fa tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbc06865-0bbe-4614-a18e-fc3d74ff1c46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:44:52 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[76f53918-b419-4f51-8629-80a2a3e541e4]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:44:52 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-feeec1e8-b079-40fa-b711-7ede18064cb7 tempest-SnapshotDependencyTests-1552874669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-96fafe64-182a-4bd4-ad3c-c772d5245e04 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:44:52 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-d93075c8-2685-43a0-bf4f-f0b89248c3fa tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbc06865-0bbe-4614-a18e-fc3d74ff1c46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:44:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2009392683',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69b16541-d50c-4105-9578-2150f9d0152b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0577b359fb67438a9be89aefbfa3faf5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:44:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:44:52Z,use_quota=True,user_id='4bafea5b2c65446a9139152133325f4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:44:52 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-d93075c8-2685-43a0-bf4f-f0b89248c3fa tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69c36eee-6af1-465a-87c1-ebe540b950a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:44:52 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-d93075c8-2685-43a0-bf4f-f0b89248c3fa tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69c36eee-6af1-465a-87c1-ebe540b950a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:44:52 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-d93075c8-2685-43a0-bf4f-f0b89248c3fa tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd118c10-914a-4d8c-a495-3d084e7365eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:44:52 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-d93075c8-2685-43a0-bf4f-f0b89248c3fa tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd118c10-914a-4d8c-a495-3d084e7365eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69b16541-d50c-4105-9578-2150f9d0152b', 'volume_name': 'volume-69b16541-d50c-4105-9578-2150f9d0152b', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:44:52 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-d93075c8-2685-43a0-bf4f-f0b89248c3fa tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce43b5e9-277f-45ba-bf1d-1b2ba0caa2dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:44:52 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-d93075c8-2685-43a0-bf4f-f0b89248c3fa tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce43b5e9-277f-45ba-bf1d-1b2ba0caa2dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:44:52 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-d93075c8-2685-43a0-bf4f-f0b89248c3fa tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (991bd53d-1490-4625-a11d-c28ec5749a8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:44:52 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-d93075c8-2685-43a0-bf4f-f0b89248c3fa tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Volume 69b16541-d50c-4105-9578-2150f9d0152b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69b16541-d50c-4105-9578-2150f9d0152b', 'volume_size': 1} Jun 29 03:44:52 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-d93075c8-2685-43a0-bf4f-f0b89248c3fa tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:44:52 devstack sudo[115001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-96fafe64-182a-4bd4-ad3c-c772d5245e04 Jun 29 03:44:52 devstack sudo[115001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:44:52 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-edd02fda-e3ff-4a19-b59a-5ce08cd1e717 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:44:52 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-edd02fda-e3ff-4a19-b59a-5ce08cd1e717 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Flow 'volume_create_manager' (66b458f6-10be-4964-bc2d-dbd0d08afe96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:44:52 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-edd02fda-e3ff-4a19-b59a-5ce08cd1e717 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53c4eeb5-37c4-4926-8290-a715424ef601) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:44:52 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-edd02fda-e3ff-4a19-b59a-5ce08cd1e717 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53c4eeb5-37c4-4926-8290-a715424ef601) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:44:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-647456435',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=618d2754-88da-46a6-83da-a311e1a0286f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0577b359fb67438a9be89aefbfa3faf5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:44:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:44:53Z,use_quota=True,user_id='4bafea5b2c65446a9139152133325f4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:44:53 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-edd02fda-e3ff-4a19-b59a-5ce08cd1e717 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9791de7-da35-42ea-87a2-9b827500cf1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:44:53 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-edd02fda-e3ff-4a19-b59a-5ce08cd1e717 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9791de7-da35-42ea-87a2-9b827500cf1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:44:53 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-edd02fda-e3ff-4a19-b59a-5ce08cd1e717 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30957c3c-c480-4263-ab8a-c90c3346b026) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:44:53 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-edd02fda-e3ff-4a19-b59a-5ce08cd1e717 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30957c3c-c480-4263-ab8a-c90c3346b026) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '618d2754-88da-46a6-83da-a311e1a0286f', 'volume_name': 'volume-618d2754-88da-46a6-83da-a311e1a0286f', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:44:53 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-edd02fda-e3ff-4a19-b59a-5ce08cd1e717 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a34df65a-556f-4130-bcf1-37843c8e6512) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:44:53 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-edd02fda-e3ff-4a19-b59a-5ce08cd1e717 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a34df65a-556f-4130-bcf1-37843c8e6512) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:44:53 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-edd02fda-e3ff-4a19-b59a-5ce08cd1e717 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e5e4b34-cadf-41fa-b338-14af5c782eb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:44:53 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-edd02fda-e3ff-4a19-b59a-5ce08cd1e717 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Volume 618d2754-88da-46a6-83da-a311e1a0286f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-618d2754-88da-46a6-83da-a311e1a0286f', 'volume_size': 1} Jun 29 03:44:53 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-edd02fda-e3ff-4a19-b59a-5ce08cd1e717 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:44:53 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-a337179a-8cc2-4f17-9ace-a6b2fc1f0c53 tempest-CinderUnicodeTest-959952973 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:44:53 devstack sudo[115001]: pam_unix(sudo:session): session closed for user root Jun 29 03:44:53 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-feeec1e8-b079-40fa-b711-7ede18064cb7 tempest-SnapshotDependencyTests-1552874669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-96fafe64-182a-4bd4-ad3c-c772d5245e04" returned: 0 in 0.831s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:44:53 devstack cinder-volume[93468]: DEBUG cinder.utils [None req-feeec1e8-b079-40fa-b711-7ede18064cb7 tempest-SnapshotDependencyTests-1552874669 None] Path /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-bda352a8-b493-49ee-9420-ca94eb4ee3cd not found in is_blk_device check {{(pid=93468) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 29 03:44:53 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-feeec1e8-b079-40fa-b711-7ede18064cb7 tempest-SnapshotDependencyTests-1552874669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-96fafe64-182a-4bd4-ad3c-c772d5245e04 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-bda352a8-b493-49ee-9420-ca94eb4ee3cd {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:44:53 devstack sudo[115006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-96fafe64-182a-4bd4-ad3c-c772d5245e04 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-bda352a8-b493-49ee-9420-ca94eb4ee3cd Jun 29 03:44:53 devstack sudo[115006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:44:58 devstack sudo[115006]: pam_unix(sudo:session): session closed for user root Jun 29 03:44:58 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-feeec1e8-b079-40fa-b711-7ede18064cb7 tempest-SnapshotDependencyTests-1552874669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-96fafe64-182a-4bd4-ad3c-c772d5245e04 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-bda352a8-b493-49ee-9420-ca94eb4ee3cd" returned: 0 in 4.670s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:44:58 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[5780cf04-818c-4863-b48f-cf08ffd58b95]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:44:58 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-feeec1e8-b079-40fa-b711-7ede18064cb7 tempest-SnapshotDependencyTests-1552874669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-96fafe64-182a-4bd4-ad3c-c772d5245e04 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:44:58 devstack sudo[115019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-96fafe64-182a-4bd4-ad3c-c772d5245e04 Jun 29 03:44:58 devstack sudo[115019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:44:59 devstack sudo[115019]: pam_unix(sudo:session): session closed for user root Jun 29 03:44:59 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-feeec1e8-b079-40fa-b711-7ede18064cb7 tempest-SnapshotDependencyTests-1552874669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-96fafe64-182a-4bd4-ad3c-c772d5245e04" returned: 0 in 0.930s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:44:59 devstack cinder-volume[93468]: DEBUG cinder.image.image_utils [None req-feeec1e8-b079-40fa-b711-7ede18064cb7 tempest-SnapshotDependencyTests-1552874669 None] Image conversion details: src /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-96fafe64-182a-4bd4-ad3c-c772d5245e04, size 1024.00 MB, duration 4.67 sec, destination /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-bda352a8-b493-49ee-9420-ca94eb4ee3cd {{(pid=93468) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 29 03:44:59 devstack cinder-volume[93468]: INFO cinder.image.image_utils [None req-feeec1e8-b079-40fa-b711-7ede18064cb7 tempest-SnapshotDependencyTests-1552874669 None] Converted 1024.00 MB image at 219.20 MB/s Jun 29 03:44:59 devstack cinder-volume[93468]: WARNING cinder.volume.drivers.remotefs [None req-feeec1e8-b079-40fa-b711-7ede18064cb7 tempest-SnapshotDependencyTests-1552874669 None] /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-bda352a8-b493-49ee-9420-ca94eb4ee3cd is being set with open permissions: ugo+rw Jun 29 03:44:59 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-feeec1e8-b079-40fa-b711-7ede18064cb7 tempest-SnapshotDependencyTests-1552874669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-bda352a8-b493-49ee-9420-ca94eb4ee3cd {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:44:59 devstack sudo[115024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-bda352a8-b493-49ee-9420-ca94eb4ee3cd Jun 29 03:44:59 devstack sudo[115024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:44:59 devstack sudo[115024]: pam_unix(sudo:session): session closed for user root Jun 29 03:44:59 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-feeec1e8-b079-40fa-b711-7ede18064cb7 tempest-SnapshotDependencyTests-1552874669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-bda352a8-b493-49ee-9420-ca94eb4ee3cd" returned: 0 in 0.647s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:44:59 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-feeec1e8-b079-40fa-b711-7ede18064cb7 tempest-SnapshotDependencyTests-1552874669 None] Lock "cinder-quobyte-bda352a8-b493-49ee-9420-ca94eb4ee3cd" released by "_copy_volume_from_snapshot" :: held 8.039s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:44:59 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-feeec1e8-b079-40fa-b711-7ede18064cb7 tempest-SnapshotDependencyTests-1552874669 None] Lock "cinder-quobyte-8c76f07b-c923-4a09-9b76-aaf8171bc0a2-bda352a8-b493-49ee-9420-ca94eb4ee3cd" released by "_create_volume_from_snapshot" :: held 8.141s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:44:59 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-feeec1e8-b079-40fa-b711-7ede18064cb7 tempest-SnapshotDependencyTests-1552874669 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.213s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:44:59 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-72fcdf5e-0450-4b26-81a5-a6d5ef07b7ad tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.098s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:44:59 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-72fcdf5e-0450-4b26-81a5-a6d5ef07b7ad tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:44:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1588151187',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3d773d4-9513-4eea-836a-6fc1b02a2fa2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0577b359fb67438a9be89aefbfa3faf5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:44:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:44:51Z,use_quota=True,user_id='4bafea5b2c65446a9139152133325f4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:44:59 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-72fcdf5e-0450-4b26-81a5-a6d5ef07b7ad tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Creating volume b3d773d4-9513-4eea-836a-6fc1b02a2fa2 {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:44:59 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-72fcdf5e-0450-4b26-81a5-a6d5ef07b7ad tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:44:59 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-72fcdf5e-0450-4b26-81a5-a6d5ef07b7ad tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:44:59 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-72fcdf5e-0450-4b26-81a5-a6d5ef07b7ad tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:44:59 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-72fcdf5e-0450-4b26-81a5-a6d5ef07b7ad tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:44:59 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-72fcdf5e-0450-4b26-81a5-a6d5ef07b7ad tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:44:59 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-72fcdf5e-0450-4b26-81a5-a6d5ef07b7ad tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Selected osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:44:59 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-72fcdf5e-0450-4b26-81a5-a6d5ef07b7ad tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] casted to osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f Jun 29 03:44:59 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-72fcdf5e-0450-4b26-81a5-a6d5ef07b7ad tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-b3d773d4-9513-4eea-836a-6fc1b02a2fa2 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:44:59 devstack sudo[115027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-b3d773d4-9513-4eea-836a-6fc1b02a2fa2 1073741824 Jun 29 03:44:59 devstack sudo[115027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:44:59 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-feeec1e8-b079-40fa-b711-7ede18064cb7 tempest-SnapshotDependencyTests-1552874669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ef9c97b-6404-4404-a3b3-f0dff3db99f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bda352a8-b493-49ee-9420-ca94eb4ee3cd', 'volume_size': 1, 'snapshot_id': '8c76f07b-c923-4a09-9b76-aaf8171bc0a2'}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:44:59 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-feeec1e8-b079-40fa-b711-7ede18064cb7 tempest-SnapshotDependencyTests-1552874669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6fb6bdd-6859-4666-a3e0-17dd1e7c2f4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:44:59 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-feeec1e8-b079-40fa-b711-7ede18064cb7 tempest-SnapshotDependencyTests-1552874669 None] Volume volume-bda352a8-b493-49ee-9420-ca94eb4ee3cd (bda352a8-b493-49ee-9420-ca94eb4ee3cd): created successfully Jun 29 03:44:59 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-feeec1e8-b079-40fa-b711-7ede18064cb7 tempest-SnapshotDependencyTests-1552874669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6fb6bdd-6859-4666-a3e0-17dd1e7c2f4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:44:59 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-feeec1e8-b079-40fa-b711-7ede18064cb7 tempest-SnapshotDependencyTests-1552874669 None] Flow 'volume_create_manager' (0c7e5c29-d45b-4129-9473-43c1304dbf1e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:44:59 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-feeec1e8-b079-40fa-b711-7ede18064cb7 tempest-SnapshotDependencyTests-1552874669 None] Created volume successfully. Jun 29 03:44:59 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-d45633a2-8f47-4821-aa3b-42a0cd58b28c tempest-SnapshotDependencyTests-1552874669 None] Acquiring lock "cinder-8c76f07b-c923-4a09-9b76-aaf8171bc0a2-delete_snapshot" by "delete_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:44:59 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-d45633a2-8f47-4821-aa3b-42a0cd58b28c tempest-SnapshotDependencyTests-1552874669 None] Lock "cinder-8c76f07b-c923-4a09-9b76-aaf8171bc0a2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:44:59 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-d45633a2-8f47-4821-aa3b-42a0cd58b28c tempest-SnapshotDependencyTests-1552874669 None] Acquiring lock "cinder-quobyte-96fafe64-182a-4bd4-ad3c-c772d5245e04" by "delete_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:45:00 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-d45633a2-8f47-4821-aa3b-42a0cd58b28c tempest-SnapshotDependencyTests-1552874669 None] Lock "cinder-quobyte-96fafe64-182a-4bd4-ad3c-c772d5245e04" acquired by "delete_snapshot" :: waited 0.017s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:45:00 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-d45633a2-8f47-4821-aa3b-42a0cd58b28c tempest-SnapshotDependencyTests-1552874669 None] Acquiring lock "cinder-quobyte-8c76f07b-c923-4a09-9b76-aaf8171bc0a2" by "_delete_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:45:00 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-d45633a2-8f47-4821-aa3b-42a0cd58b28c tempest-SnapshotDependencyTests-1552874669 None] Lock "cinder-quobyte-8c76f07b-c923-4a09-9b76-aaf8171bc0a2" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:45:00 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-d45633a2-8f47-4821-aa3b-42a0cd58b28c tempest-SnapshotDependencyTests-1552874669 None] Deleting offline snapshot 8c76f07b-c923-4a09-9b76-aaf8171bc0a2 of volume 96fafe64-182a-4bd4-ad3c-c772d5245e04 {{(pid=93468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 29 03:45:00 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-d45633a2-8f47-4821-aa3b-42a0cd58b28c tempest-SnapshotDependencyTests-1552874669 None] snapshot_file for this snap is: volume-96fafe64-182a-4bd4-ad3c-c772d5245e04.8c76f07b-c923-4a09-9b76-aaf8171bc0a2 {{(pid=93468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 29 03:45:00 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a1a6a90-b149-41ea-8019-7264c46d7205]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:45:00 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d45633a2-8f47-4821-aa3b-42a0cd58b28c tempest-SnapshotDependencyTests-1552874669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-96fafe64-182a-4bd4-ad3c-c772d5245e04.8c76f07b-c923-4a09-9b76-aaf8171bc0a2 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:45:00 devstack sudo[115029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-96fafe64-182a-4bd4-ad3c-c772d5245e04.8c76f07b-c923-4a09-9b76-aaf8171bc0a2 Jun 29 03:45:00 devstack sudo[115029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:45:00 devstack sudo[115027]: pam_unix(sudo:session): session closed for user root Jun 29 03:45:00 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-72fcdf5e-0450-4b26-81a5-a6d5ef07b7ad tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-b3d773d4-9513-4eea-836a-6fc1b02a2fa2 1073741824" returned: 0 in 0.855s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:45:00 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-72fcdf5e-0450-4b26-81a5-a6d5ef07b7ad tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-b3d773d4-9513-4eea-836a-6fc1b02a2fa2 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:45:00 devstack sudo[115034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-b3d773d4-9513-4eea-836a-6fc1b02a2fa2 Jun 29 03:45:00 devstack sudo[115034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:45:00 devstack sudo[115029]: pam_unix(sudo:session): session closed for user root Jun 29 03:45:00 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d45633a2-8f47-4821-aa3b-42a0cd58b28c tempest-SnapshotDependencyTests-1552874669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-96fafe64-182a-4bd4-ad3c-c772d5245e04.8c76f07b-c923-4a09-9b76-aaf8171bc0a2" returned: 0 in 0.789s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:45:00 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-d45633a2-8f47-4821-aa3b-42a0cd58b28c tempest-SnapshotDependencyTests-1552874669 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-96fafe64-182a-4bd4-ad3c-c772d5245e04(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93468) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 29 03:45:00 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[652e7e5b-4787-4ba0-9a2b-c4f188c8ebd4]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:45:00 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d45633a2-8f47-4821-aa3b-42a0cd58b28c tempest-SnapshotDependencyTests-1552874669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-96fafe64-182a-4bd4-ad3c-c772d5245e04 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:45:01 devstack sudo[115039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-96fafe64-182a-4bd4-ad3c-c772d5245e04 Jun 29 03:45:01 devstack sudo[115039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:45:01 devstack sudo[115034]: pam_unix(sudo:session): session closed for user root Jun 29 03:45:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-72fcdf5e-0450-4b26-81a5-a6d5ef07b7ad tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-b3d773d4-9513-4eea-836a-6fc1b02a2fa2" returned: 0 in 0.646s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:45:01 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-72fcdf5e-0450-4b26-81a5-a6d5ef07b7ad tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] <== create_volume: return (1539ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:45:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-72fcdf5e-0450-4b26-81a5-a6d5ef07b7ad tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.544s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:45:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-889a0e31-2b87-47f3-8236-427828d43dcb tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.332s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:45:01 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-889a0e31-2b87-47f3-8236-427828d43dcb tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:44:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-705118037',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0068d0d-3e19-44fb-beae-6a0ea5cc24c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0577b359fb67438a9be89aefbfa3faf5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:44:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:44:52Z,use_quota=True,user_id='4bafea5b2c65446a9139152133325f4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:45:01 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-889a0e31-2b87-47f3-8236-427828d43dcb tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Creating volume a0068d0d-3e19-44fb-beae-6a0ea5cc24c6 {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:45:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-889a0e31-2b87-47f3-8236-427828d43dcb tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:45:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-889a0e31-2b87-47f3-8236-427828d43dcb tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:45:01 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-889a0e31-2b87-47f3-8236-427828d43dcb tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:45:01 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-889a0e31-2b87-47f3-8236-427828d43dcb tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:45:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-889a0e31-2b87-47f3-8236-427828d43dcb tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:45:01 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-889a0e31-2b87-47f3-8236-427828d43dcb tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Selected osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:45:01 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-889a0e31-2b87-47f3-8236-427828d43dcb tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] casted to osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f Jun 29 03:45:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-889a0e31-2b87-47f3-8236-427828d43dcb tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-a0068d0d-3e19-44fb-beae-6a0ea5cc24c6 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:45:01 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-72fcdf5e-0450-4b26-81a5-a6d5ef07b7ad tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04354d09-62c5-4a14-a892-897d32743a80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3d773d4-9513-4eea-836a-6fc1b02a2fa2', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:45:01 devstack sudo[115042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-a0068d0d-3e19-44fb-beae-6a0ea5cc24c6 1073741824 Jun 29 03:45:01 devstack sudo[115042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:45:01 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-72fcdf5e-0450-4b26-81a5-a6d5ef07b7ad tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14902958-ee75-45a0-929e-8aae275a4dca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:45:01 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-72fcdf5e-0450-4b26-81a5-a6d5ef07b7ad tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Volume volume-b3d773d4-9513-4eea-836a-6fc1b02a2fa2 (b3d773d4-9513-4eea-836a-6fc1b02a2fa2): created successfully Jun 29 03:45:01 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-72fcdf5e-0450-4b26-81a5-a6d5ef07b7ad tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14902958-ee75-45a0-929e-8aae275a4dca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:45:01 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-72fcdf5e-0450-4b26-81a5-a6d5ef07b7ad tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Flow 'volume_create_manager' (b6284cb8-ca33-402f-90f4-e5070bad5d8c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:45:01 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-72fcdf5e-0450-4b26-81a5-a6d5ef07b7ad tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Created volume successfully. Jun 29 03:45:01 devstack sudo[115039]: pam_unix(sudo:session): session closed for user root Jun 29 03:45:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d45633a2-8f47-4821-aa3b-42a0cd58b28c tempest-SnapshotDependencyTests-1552874669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-96fafe64-182a-4bd4-ad3c-c772d5245e04" returned: 0 in 0.785s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:45:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d45633a2-8f47-4821-aa3b-42a0cd58b28c tempest-SnapshotDependencyTests-1552874669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-96fafe64-182a-4bd4-ad3c-c772d5245e04.8c76f07b-c923-4a09-9b76-aaf8171bc0a2 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:45:01 devstack sudo[115051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-96fafe64-182a-4bd4-ad3c-c772d5245e04.8c76f07b-c923-4a09-9b76-aaf8171bc0a2 Jun 29 03:45:01 devstack sudo[115051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:45:02 devstack sudo[115042]: pam_unix(sudo:session): session closed for user root Jun 29 03:45:02 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-889a0e31-2b87-47f3-8236-427828d43dcb tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-a0068d0d-3e19-44fb-beae-6a0ea5cc24c6 1073741824" returned: 0 in 0.825s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:45:02 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-889a0e31-2b87-47f3-8236-427828d43dcb tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-a0068d0d-3e19-44fb-beae-6a0ea5cc24c6 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:45:02 devstack sudo[115058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-a0068d0d-3e19-44fb-beae-6a0ea5cc24c6 Jun 29 03:45:02 devstack sudo[115058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:45:02 devstack sudo[115051]: pam_unix(sudo:session): session closed for user root Jun 29 03:45:02 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d45633a2-8f47-4821-aa3b-42a0cd58b28c tempest-SnapshotDependencyTests-1552874669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-96fafe64-182a-4bd4-ad3c-c772d5245e04.8c76f07b-c923-4a09-9b76-aaf8171bc0a2" returned: 0 in 0.749s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:45:02 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d45633a2-8f47-4821-aa3b-42a0cd58b28c tempest-SnapshotDependencyTests-1552874669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-96fafe64-182a-4bd4-ad3c-c772d5245e04.8c76f07b-c923-4a09-9b76-aaf8171bc0a2 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:45:02 devstack sudo[115063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-96fafe64-182a-4bd4-ad3c-c772d5245e04.8c76f07b-c923-4a09-9b76-aaf8171bc0a2 Jun 29 03:45:02 devstack sudo[115063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:45:02 devstack sudo[115058]: pam_unix(sudo:session): session closed for user root Jun 29 03:45:02 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-889a0e31-2b87-47f3-8236-427828d43dcb tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-a0068d0d-3e19-44fb-beae-6a0ea5cc24c6" returned: 0 in 0.673s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:45:02 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-889a0e31-2b87-47f3-8236-427828d43dcb tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] <== create_volume: return (1537ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:45:02 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-889a0e31-2b87-47f3-8236-427828d43dcb tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.541s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:45:02 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-602df98f-c5d3-40a4-bfa6-59c80b9300e8 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.509s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:45:02 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-602df98f-c5d3-40a4-bfa6-59c80b9300e8 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:44:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-884519507',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b84c5655-69dd-49b7-a20e-ef2aedb2a564,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0577b359fb67438a9be89aefbfa3faf5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:44:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:44:52Z,use_quota=True,user_id='4bafea5b2c65446a9139152133325f4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:45:02 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-602df98f-c5d3-40a4-bfa6-59c80b9300e8 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Creating volume b84c5655-69dd-49b7-a20e-ef2aedb2a564 {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:45:02 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-602df98f-c5d3-40a4-bfa6-59c80b9300e8 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:45:02 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-602df98f-c5d3-40a4-bfa6-59c80b9300e8 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:45:02 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-602df98f-c5d3-40a4-bfa6-59c80b9300e8 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:45:02 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-602df98f-c5d3-40a4-bfa6-59c80b9300e8 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:45:02 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-602df98f-c5d3-40a4-bfa6-59c80b9300e8 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:45:02 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-602df98f-c5d3-40a4-bfa6-59c80b9300e8 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Selected osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:45:02 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-602df98f-c5d3-40a4-bfa6-59c80b9300e8 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] casted to osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f Jun 29 03:45:02 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-602df98f-c5d3-40a4-bfa6-59c80b9300e8 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-b84c5655-69dd-49b7-a20e-ef2aedb2a564 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:45:02 devstack sudo[115066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-b84c5655-69dd-49b7-a20e-ef2aedb2a564 1073741824 Jun 29 03:45:02 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-889a0e31-2b87-47f3-8236-427828d43dcb tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a0bd8c0-fdd5-4eff-8a1e-2377dd6a565c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0068d0d-3e19-44fb-beae-6a0ea5cc24c6', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:45:02 devstack sudo[115066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:45:02 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-889a0e31-2b87-47f3-8236-427828d43dcb tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (165c6444-2f33-4ab3-a0ec-627ee9473b95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:45:02 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-889a0e31-2b87-47f3-8236-427828d43dcb tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Volume volume-a0068d0d-3e19-44fb-beae-6a0ea5cc24c6 (a0068d0d-3e19-44fb-beae-6a0ea5cc24c6): created successfully Jun 29 03:45:02 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-889a0e31-2b87-47f3-8236-427828d43dcb tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (165c6444-2f33-4ab3-a0ec-627ee9473b95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:45:02 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-889a0e31-2b87-47f3-8236-427828d43dcb tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Flow 'volume_create_manager' (d688b847-f227-4233-a2fb-6b148e31f388) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:45:02 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-889a0e31-2b87-47f3-8236-427828d43dcb tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Created volume successfully. Jun 29 03:45:03 devstack sudo[115063]: pam_unix(sudo:session): session closed for user root Jun 29 03:45:03 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d45633a2-8f47-4821-aa3b-42a0cd58b28c tempest-SnapshotDependencyTests-1552874669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-96fafe64-182a-4bd4-ad3c-c772d5245e04.8c76f07b-c923-4a09-9b76-aaf8171bc0a2" returned: 0 in 0.664s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:45:03 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-d45633a2-8f47-4821-aa3b-42a0cd58b28c tempest-SnapshotDependencyTests-1552874669 None] Lock "cinder-quobyte-8c76f07b-c923-4a09-9b76-aaf8171bc0a2" released by "_delete_snapshot" :: held 3.099s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:45:03 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-d45633a2-8f47-4821-aa3b-42a0cd58b28c tempest-SnapshotDependencyTests-1552874669 None] Lock "cinder-quobyte-96fafe64-182a-4bd4-ad3c-c772d5245e04" released by "delete_snapshot" :: held 3.131s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:45:03 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-d45633a2-8f47-4821-aa3b-42a0cd58b28c tempest-SnapshotDependencyTests-1552874669 None] Created reservations ['dfdd2b49-7b46-4b21-911c-7218f56035e8', 'ff23a90d-4057-45da-89ca-a395509e3ec0', '281869d4-b8cc-4455-9f27-57d38312e71a', '5ec7be6e-b2f8-4c5a-a4af-8e94f8e87e23'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:45:03 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-d45633a2-8f47-4821-aa3b-42a0cd58b28c tempest-SnapshotDependencyTests-1552874669 None] Delete snapshot completed successfully. Jun 29 03:45:03 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-d45633a2-8f47-4821-aa3b-42a0cd58b28c tempest-SnapshotDependencyTests-1552874669 None] Lock "cinder-8c76f07b-c923-4a09-9b76-aaf8171bc0a2-delete_snapshot" released by "delete_snapshot" :: held 3.266s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:45:03 devstack sudo[115066]: pam_unix(sudo:session): session closed for user root Jun 29 03:45:03 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-602df98f-c5d3-40a4-bfa6-59c80b9300e8 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-b84c5655-69dd-49b7-a20e-ef2aedb2a564 1073741824" returned: 0 in 0.834s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:45:03 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-602df98f-c5d3-40a4-bfa6-59c80b9300e8 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-b84c5655-69dd-49b7-a20e-ef2aedb2a564 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:45:03 devstack sudo[115073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-b84c5655-69dd-49b7-a20e-ef2aedb2a564 Jun 29 03:45:03 devstack sudo[115073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:45:04 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-64db592f-bd1e-4396-a9e3-0501ef7fc465 tempest-SnapshotDependencyTests-1552874669 None] Acquiring lock "cinder-96fafe64-182a-4bd4-ad3c-c772d5245e04-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:45:04 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-64db592f-bd1e-4396-a9e3-0501ef7fc465 tempest-SnapshotDependencyTests-1552874669 None] Lock "cinder-96fafe64-182a-4bd4-ad3c-c772d5245e04-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:45:04 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-64db592f-bd1e-4396-a9e3-0501ef7fc465 tempest-SnapshotDependencyTests-1552874669 None] Acquiring lock "cinder-quobyte-96fafe64-182a-4bd4-ad3c-c772d5245e04" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:45:04 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-64db592f-bd1e-4396-a9e3-0501ef7fc465 tempest-SnapshotDependencyTests-1552874669 None] Lock "cinder-quobyte-96fafe64-182a-4bd4-ad3c-c772d5245e04" acquired by "delete_volume" :: waited 0.017s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:45:04 devstack sudo[115073]: pam_unix(sudo:session): session closed for user root Jun 29 03:45:04 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[15f3d1c8-7095-4570-91be-e4bc15821dfe]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:45:04 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-64db592f-bd1e-4396-a9e3-0501ef7fc465 tempest-SnapshotDependencyTests-1552874669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-96fafe64-182a-4bd4-ad3c-c772d5245e04 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:45:04 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-602df98f-c5d3-40a4-bfa6-59c80b9300e8 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-b84c5655-69dd-49b7-a20e-ef2aedb2a564" returned: 0 in 0.697s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:45:04 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-602df98f-c5d3-40a4-bfa6-59c80b9300e8 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] <== create_volume: return (1570ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:45:04 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-602df98f-c5d3-40a4-bfa6-59c80b9300e8 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.573s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:45:04 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-d93075c8-2685-43a0-bf4f-f0b89248c3fa tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.721s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:45:04 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-d93075c8-2685-43a0-bf4f-f0b89248c3fa tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:44:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2009392683',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69b16541-d50c-4105-9578-2150f9d0152b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0577b359fb67438a9be89aefbfa3faf5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:44:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:44:52Z,use_quota=True,user_id='4bafea5b2c65446a9139152133325f4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:45:04 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-d93075c8-2685-43a0-bf4f-f0b89248c3fa tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Creating volume 69b16541-d50c-4105-9578-2150f9d0152b {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:45:04 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-d93075c8-2685-43a0-bf4f-f0b89248c3fa tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:45:04 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-d93075c8-2685-43a0-bf4f-f0b89248c3fa tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:45:04 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-d93075c8-2685-43a0-bf4f-f0b89248c3fa tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:45:04 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-d93075c8-2685-43a0-bf4f-f0b89248c3fa tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:45:04 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-d93075c8-2685-43a0-bf4f-f0b89248c3fa tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:45:04 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-d93075c8-2685-43a0-bf4f-f0b89248c3fa tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Selected osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:45:04 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-d93075c8-2685-43a0-bf4f-f0b89248c3fa tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] casted to osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f Jun 29 03:45:04 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d93075c8-2685-43a0-bf4f-f0b89248c3fa tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-69b16541-d50c-4105-9578-2150f9d0152b 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:45:04 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-602df98f-c5d3-40a4-bfa6-59c80b9300e8 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (858d2594-9363-4cf7-9572-88bcb421fd23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b84c5655-69dd-49b7-a20e-ef2aedb2a564', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:45:04 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-602df98f-c5d3-40a4-bfa6-59c80b9300e8 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2e9249b-c56e-4f54-a736-fe50e6def81c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:45:04 devstack sudo[115077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-69b16541-d50c-4105-9578-2150f9d0152b 1073741824 Jun 29 03:45:04 devstack sudo[115077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:45:04 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-602df98f-c5d3-40a4-bfa6-59c80b9300e8 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Volume volume-b84c5655-69dd-49b7-a20e-ef2aedb2a564 (b84c5655-69dd-49b7-a20e-ef2aedb2a564): created successfully Jun 29 03:45:04 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-602df98f-c5d3-40a4-bfa6-59c80b9300e8 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2e9249b-c56e-4f54-a736-fe50e6def81c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:45:04 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-602df98f-c5d3-40a4-bfa6-59c80b9300e8 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Flow 'volume_create_manager' (b65bede8-99c3-4929-8126-f0e20af20ee8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:45:04 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-602df98f-c5d3-40a4-bfa6-59c80b9300e8 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Created volume successfully. Jun 29 03:45:04 devstack sudo[115076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-96fafe64-182a-4bd4-ad3c-c772d5245e04 Jun 29 03:45:04 devstack sudo[115076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:45:05 devstack sudo[115076]: pam_unix(sudo:session): session closed for user root Jun 29 03:45:05 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-64db592f-bd1e-4396-a9e3-0501ef7fc465 tempest-SnapshotDependencyTests-1552874669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-96fafe64-182a-4bd4-ad3c-c772d5245e04" returned: 0 in 0.794s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:45:05 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-64db592f-bd1e-4396-a9e3-0501ef7fc465 tempest-SnapshotDependencyTests-1552874669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-96fafe64-182a-4bd4-ad3c-c772d5245e04 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:45:05 devstack sudo[115087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-96fafe64-182a-4bd4-ad3c-c772d5245e04 Jun 29 03:45:05 devstack sudo[115087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:45:05 devstack sudo[115077]: pam_unix(sudo:session): session closed for user root Jun 29 03:45:05 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d93075c8-2685-43a0-bf4f-f0b89248c3fa tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-69b16541-d50c-4105-9578-2150f9d0152b 1073741824" returned: 0 in 0.863s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:45:05 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d93075c8-2685-43a0-bf4f-f0b89248c3fa tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-69b16541-d50c-4105-9578-2150f9d0152b {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:45:05 devstack sudo[115089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-69b16541-d50c-4105-9578-2150f9d0152b Jun 29 03:45:05 devstack sudo[115089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:45:05 devstack sudo[115087]: pam_unix(sudo:session): session closed for user root Jun 29 03:45:05 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-64db592f-bd1e-4396-a9e3-0501ef7fc465 tempest-SnapshotDependencyTests-1552874669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-96fafe64-182a-4bd4-ad3c-c772d5245e04" returned: 0 in 0.656s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:45:05 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-64db592f-bd1e-4396-a9e3-0501ef7fc465 tempest-SnapshotDependencyTests-1552874669 None] Lock "cinder-quobyte-96fafe64-182a-4bd4-ad3c-c772d5245e04" released by "delete_volume" :: held 1.523s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:45:05 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-64db592f-bd1e-4396-a9e3-0501ef7fc465 tempest-SnapshotDependencyTests-1552874669 None] Created reservations ['dd8926e7-0cc6-4965-a78d-abd4bf57d489', 'f867af70-81da-436b-ae5b-3d41efa46d7b', '4c4f0359-fdb5-4b04-8d63-c1f9f1b928ba', 'ca71265d-18e3-4197-b924-bbd614d5a35c'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:45:05 devstack sudo[115089]: pam_unix(sudo:session): session closed for user root Jun 29 03:45:05 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d93075c8-2685-43a0-bf4f-f0b89248c3fa tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-69b16541-d50c-4105-9578-2150f9d0152b" returned: 0 in 0.658s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:45:05 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-d93075c8-2685-43a0-bf4f-f0b89248c3fa tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] <== create_volume: return (1563ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:45:05 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-d93075c8-2685-43a0-bf4f-f0b89248c3fa tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.568s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:45:05 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-edd02fda-e3ff-4a19-b59a-5ce08cd1e717 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.911s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:45:05 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-edd02fda-e3ff-4a19-b59a-5ce08cd1e717 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:44:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-647456435',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=618d2754-88da-46a6-83da-a311e1a0286f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0577b359fb67438a9be89aefbfa3faf5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:44:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:44:53Z,use_quota=True,user_id='4bafea5b2c65446a9139152133325f4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad1ee72-7980-4cf8-8e97-05e95f9b9891),volume_type_id=8ad1ee72-7980-4cf8-8e97-05e95f9b9891)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:45:05 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-edd02fda-e3ff-4a19-b59a-5ce08cd1e717 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Creating volume 618d2754-88da-46a6-83da-a311e1a0286f {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:45:05 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-edd02fda-e3ff-4a19-b59a-5ce08cd1e717 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:45:05 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-edd02fda-e3ff-4a19-b59a-5ce08cd1e717 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:45:05 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-edd02fda-e3ff-4a19-b59a-5ce08cd1e717 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:45:05 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-edd02fda-e3ff-4a19-b59a-5ce08cd1e717 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:45:05 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-edd02fda-e3ff-4a19-b59a-5ce08cd1e717 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:45:05 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-edd02fda-e3ff-4a19-b59a-5ce08cd1e717 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Selected osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:45:05 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-edd02fda-e3ff-4a19-b59a-5ce08cd1e717 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] casted to osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f Jun 29 03:45:05 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-edd02fda-e3ff-4a19-b59a-5ce08cd1e717 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-618d2754-88da-46a6-83da-a311e1a0286f 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:45:05 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-64db592f-bd1e-4396-a9e3-0501ef7fc465 tempest-SnapshotDependencyTests-1552874669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:45:05 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-64db592f-bd1e-4396-a9e3-0501ef7fc465 tempest-SnapshotDependencyTests-1552874669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:45:05 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-64db592f-bd1e-4396-a9e3-0501ef7fc465 tempest-SnapshotDependencyTests-1552874669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:45:05 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-64db592f-bd1e-4396-a9e3-0501ef7fc465 tempest-SnapshotDependencyTests-1552874669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:45:05 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-64db592f-bd1e-4396-a9e3-0501ef7fc465 tempest-SnapshotDependencyTests-1552874669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:45:05 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-64db592f-bd1e-4396-a9e3-0501ef7fc465 tempest-SnapshotDependencyTests-1552874669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:45:05 devstack sudo[115093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-618d2754-88da-46a6-83da-a311e1a0286f 1073741824 Jun 29 03:45:05 devstack sudo[115093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:45:06 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-d93075c8-2685-43a0-bf4f-f0b89248c3fa tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (991bd53d-1490-4625-a11d-c28ec5749a8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69b16541-d50c-4105-9578-2150f9d0152b', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:45:06 devstack sudo[115095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf Jun 29 03:45:06 devstack sudo[115095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:45:06 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-d93075c8-2685-43a0-bf4f-f0b89248c3fa tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77f34337-f2f9-4e61-a06f-3abd16da91ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:45:06 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-d93075c8-2685-43a0-bf4f-f0b89248c3fa tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Volume volume-69b16541-d50c-4105-9578-2150f9d0152b (69b16541-d50c-4105-9578-2150f9d0152b): created successfully Jun 29 03:45:06 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-d93075c8-2685-43a0-bf4f-f0b89248c3fa tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77f34337-f2f9-4e61-a06f-3abd16da91ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:45:06 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-d93075c8-2685-43a0-bf4f-f0b89248c3fa tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Flow 'volume_create_manager' (56d49fd6-94bf-4abf-87d5-fb5dd364d6e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:45:06 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-d93075c8-2685-43a0-bf4f-f0b89248c3fa tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Created volume successfully. Jun 29 03:45:06 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-9768ae28-0599-4a13-80eb-0537c145e282 tempest-SnapshotDependencyTests-1552874669 None] Acquiring lock "cinder-bda352a8-b493-49ee-9420-ca94eb4ee3cd-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:45:06 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-9768ae28-0599-4a13-80eb-0537c145e282 tempest-SnapshotDependencyTests-1552874669 None] Lock "cinder-bda352a8-b493-49ee-9420-ca94eb4ee3cd-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:45:06 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-9768ae28-0599-4a13-80eb-0537c145e282 tempest-SnapshotDependencyTests-1552874669 None] Acquiring lock "cinder-quobyte-bda352a8-b493-49ee-9420-ca94eb4ee3cd" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:45:06 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-9768ae28-0599-4a13-80eb-0537c145e282 tempest-SnapshotDependencyTests-1552874669 None] Lock "cinder-quobyte-bda352a8-b493-49ee-9420-ca94eb4ee3cd" acquired by "delete_volume" :: waited 0.023s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:45:06 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[499f379e-18c9-4078-b144-a4245d16bc6f]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:45:06 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-9768ae28-0599-4a13-80eb-0537c145e282 tempest-SnapshotDependencyTests-1552874669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-bda352a8-b493-49ee-9420-ca94eb4ee3cd {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:45:06 devstack sudo[115095]: pam_unix(sudo:session): session closed for user root Jun 29 03:45:06 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-64db592f-bd1e-4396-a9e3-0501ef7fc465 tempest-SnapshotDependencyTests-1552874669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf" returned: 0 in 0.694s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:45:06 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-64db592f-bd1e-4396-a9e3-0501ef7fc465 tempest-SnapshotDependencyTests-1552874669 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:45:06 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-64db592f-bd1e-4396-a9e3-0501ef7fc465 tempest-SnapshotDependencyTests-1552874669 None] Deleted volume successfully. Jun 29 03:45:06 devstack sudo[115101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-bda352a8-b493-49ee-9420-ca94eb4ee3cd Jun 29 03:45:06 devstack sudo[115101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:45:06 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-64db592f-bd1e-4396-a9e3-0501ef7fc465 tempest-SnapshotDependencyTests-1552874669 None] Lock "cinder-96fafe64-182a-4bd4-ad3c-c772d5245e04-delete_volume" released by "delete_volume" :: held 2.473s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:45:06 devstack sudo[115093]: pam_unix(sudo:session): session closed for user root Jun 29 03:45:06 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-edd02fda-e3ff-4a19-b59a-5ce08cd1e717 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-618d2754-88da-46a6-83da-a311e1a0286f 1073741824" returned: 0 in 0.873s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:45:06 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-edd02fda-e3ff-4a19-b59a-5ce08cd1e717 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-618d2754-88da-46a6-83da-a311e1a0286f {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:45:06 devstack sudo[115104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-618d2754-88da-46a6-83da-a311e1a0286f Jun 29 03:45:06 devstack sudo[115104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:45:07 devstack sudo[115101]: pam_unix(sudo:session): session closed for user root Jun 29 03:45:07 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-9768ae28-0599-4a13-80eb-0537c145e282 tempest-SnapshotDependencyTests-1552874669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-bda352a8-b493-49ee-9420-ca94eb4ee3cd" returned: 0 in 0.779s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:45:07 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-9768ae28-0599-4a13-80eb-0537c145e282 tempest-SnapshotDependencyTests-1552874669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-bda352a8-b493-49ee-9420-ca94eb4ee3cd {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:45:07 devstack sudo[115109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-bda352a8-b493-49ee-9420-ca94eb4ee3cd Jun 29 03:45:07 devstack sudo[115109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:45:07 devstack sudo[115104]: pam_unix(sudo:session): session closed for user root Jun 29 03:45:07 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-edd02fda-e3ff-4a19-b59a-5ce08cd1e717 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-618d2754-88da-46a6-83da-a311e1a0286f" returned: 0 in 0.669s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:45:07 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-edd02fda-e3ff-4a19-b59a-5ce08cd1e717 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] <== create_volume: return (1583ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:45:07 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-edd02fda-e3ff-4a19-b59a-5ce08cd1e717 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.586s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:45:07 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-a337179a-8cc2-4f17-9ace-a6b2fc1f0c53 tempest-CinderUnicodeTest-959952973 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 14.477s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:45:07 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-a337179a-8cc2-4f17-9ace-a6b2fc1f0c53 tempest-CinderUnicodeTest-959952973 None] Creating offline snapshot 6ee5e7c8-d0c1-4352-bb94-7b510062da23 of volume 59bb9eeb-2c3b-44a9-8995-d0a92ac00421 {{(pid=93468) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 29 03:45:07 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-edd02fda-e3ff-4a19-b59a-5ce08cd1e717 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e5e4b34-cadf-41fa-b338-14af5c782eb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-618d2754-88da-46a6-83da-a311e1a0286f', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:45:07 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-edd02fda-e3ff-4a19-b59a-5ce08cd1e717 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (049a575f-f1ff-4aaf-8994-95e5daadfcfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:45:07 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eaca0f8-d54d-4571-9112-0bcccf6b110f]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:45:07 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a337179a-8cc2-4f17-9ace-a6b2fc1f0c53 tempest-CinderUnicodeTest-959952973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-59bb9eeb-2c3b-44a9-8995-d0a92ac00421 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:45:07 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-edd02fda-e3ff-4a19-b59a-5ce08cd1e717 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Volume volume-618d2754-88da-46a6-83da-a311e1a0286f (618d2754-88da-46a6-83da-a311e1a0286f): created successfully Jun 29 03:45:07 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-edd02fda-e3ff-4a19-b59a-5ce08cd1e717 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (049a575f-f1ff-4aaf-8994-95e5daadfcfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:45:07 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-edd02fda-e3ff-4a19-b59a-5ce08cd1e717 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Flow 'volume_create_manager' (66b458f6-10be-4964-bc2d-dbd0d08afe96) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:45:07 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-edd02fda-e3ff-4a19-b59a-5ce08cd1e717 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Created volume successfully. Jun 29 03:45:07 devstack sudo[115112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-59bb9eeb-2c3b-44a9-8995-d0a92ac00421 Jun 29 03:45:07 devstack sudo[115112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:45:08 devstack sudo[115109]: pam_unix(sudo:session): session closed for user root Jun 29 03:45:08 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-9768ae28-0599-4a13-80eb-0537c145e282 tempest-SnapshotDependencyTests-1552874669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-bda352a8-b493-49ee-9420-ca94eb4ee3cd" returned: 0 in 0.662s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:45:08 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-9768ae28-0599-4a13-80eb-0537c145e282 tempest-SnapshotDependencyTests-1552874669 None] Lock "cinder-quobyte-bda352a8-b493-49ee-9420-ca94eb4ee3cd" released by "delete_volume" :: held 1.489s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:45:08 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-9768ae28-0599-4a13-80eb-0537c145e282 tempest-SnapshotDependencyTests-1552874669 None] Created reservations ['7d35f173-0924-4ac1-bf06-b5365b113081', '4216618a-4a1b-4cfe-ba62-c4b93606c02d', '01c83774-3cf7-47b6-a57a-a7e7cf544eae', 'b2b3ae56-4e72-466a-a906-0c80c582f68b'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:45:08 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-9768ae28-0599-4a13-80eb-0537c145e282 tempest-SnapshotDependencyTests-1552874669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:45:08 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-9768ae28-0599-4a13-80eb-0537c145e282 tempest-SnapshotDependencyTests-1552874669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:45:08 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-9768ae28-0599-4a13-80eb-0537c145e282 tempest-SnapshotDependencyTests-1552874669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:45:08 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-9768ae28-0599-4a13-80eb-0537c145e282 tempest-SnapshotDependencyTests-1552874669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:45:08 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-9768ae28-0599-4a13-80eb-0537c145e282 tempest-SnapshotDependencyTests-1552874669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:45:08 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-9768ae28-0599-4a13-80eb-0537c145e282 tempest-SnapshotDependencyTests-1552874669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:45:08 devstack sudo[115115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf Jun 29 03:45:08 devstack sudo[115115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:45:08 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-2623fad0-2076-4da9-84fb-e392b1d120d7 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Acquiring lock "cinder-618d2754-88da-46a6-83da-a311e1a0286f-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:45:08 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-2623fad0-2076-4da9-84fb-e392b1d120d7 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Lock "cinder-618d2754-88da-46a6-83da-a311e1a0286f-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:45:08 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-2623fad0-2076-4da9-84fb-e392b1d120d7 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Acquiring lock "cinder-quobyte-618d2754-88da-46a6-83da-a311e1a0286f" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:45:08 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-2623fad0-2076-4da9-84fb-e392b1d120d7 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Lock "cinder-quobyte-618d2754-88da-46a6-83da-a311e1a0286f" acquired by "delete_volume" :: waited 0.015s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:45:08 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[32b55f0e-975b-48f1-93a1-4a53e15684cb]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:45:08 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2623fad0-2076-4da9-84fb-e392b1d120d7 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-618d2754-88da-46a6-83da-a311e1a0286f {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:45:08 devstack sudo[115112]: pam_unix(sudo:session): session closed for user root Jun 29 03:45:08 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a337179a-8cc2-4f17-9ace-a6b2fc1f0c53 tempest-CinderUnicodeTest-959952973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-59bb9eeb-2c3b-44a9-8995-d0a92ac00421" returned: 0 in 0.860s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:45:08 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a337179a-8cc2-4f17-9ace-a6b2fc1f0c53 tempest-CinderUnicodeTest-959952973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-59bb9eeb-2c3b-44a9-8995-d0a92ac00421,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-59bb9eeb-2c3b-44a9-8995-d0a92ac00421.6ee5e7c8-d0c1-4352-bb94-7b510062da23 1G {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:45:08 devstack sudo[115121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-59bb9eeb-2c3b-44a9-8995-d0a92ac00421,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-59bb9eeb-2c3b-44a9-8995-d0a92ac00421.6ee5e7c8-d0c1-4352-bb94-7b510062da23 1G Jun 29 03:45:08 devstack sudo[115121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:45:08 devstack sudo[115120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-618d2754-88da-46a6-83da-a311e1a0286f Jun 29 03:45:08 devstack sudo[115120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:45:08 devstack sudo[115115]: pam_unix(sudo:session): session closed for user root Jun 29 03:45:08 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-9768ae28-0599-4a13-80eb-0537c145e282 tempest-SnapshotDependencyTests-1552874669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf" returned: 0 in 0.740s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:45:08 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-9768ae28-0599-4a13-80eb-0537c145e282 tempest-SnapshotDependencyTests-1552874669 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:45:08 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-9768ae28-0599-4a13-80eb-0537c145e282 tempest-SnapshotDependencyTests-1552874669 None] Deleted volume successfully. Jun 29 03:45:08 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-9768ae28-0599-4a13-80eb-0537c145e282 tempest-SnapshotDependencyTests-1552874669 None] Lock "cinder-bda352a8-b493-49ee-9420-ca94eb4ee3cd-delete_volume" released by "delete_volume" :: held 2.489s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:45:09 devstack sudo[115120]: pam_unix(sudo:session): session closed for user root Jun 29 03:45:09 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2623fad0-2076-4da9-84fb-e392b1d120d7 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-618d2754-88da-46a6-83da-a311e1a0286f" returned: 0 in 0.812s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:45:09 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2623fad0-2076-4da9-84fb-e392b1d120d7 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-618d2754-88da-46a6-83da-a311e1a0286f {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:45:09 devstack sudo[115131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-618d2754-88da-46a6-83da-a311e1a0286f Jun 29 03:45:09 devstack sudo[115131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:45:09 devstack sudo[115121]: pam_unix(sudo:session): session closed for user root Jun 29 03:45:09 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a337179a-8cc2-4f17-9ace-a6b2fc1f0c53 tempest-CinderUnicodeTest-959952973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-59bb9eeb-2c3b-44a9-8995-d0a92ac00421,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-59bb9eeb-2c3b-44a9-8995-d0a92ac00421.6ee5e7c8-d0c1-4352-bb94-7b510062da23 1G" returned: 0 in 0.889s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:45:09 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a337179a-8cc2-4f17-9ace-a6b2fc1f0c53 tempest-CinderUnicodeTest-959952973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-59bb9eeb-2c3b-44a9-8995-d0a92ac00421 -F qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-59bb9eeb-2c3b-44a9-8995-d0a92ac00421.6ee5e7c8-d0c1-4352-bb94-7b510062da23 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:45:09 devstack sudo[115133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-59bb9eeb-2c3b-44a9-8995-d0a92ac00421 -F qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-59bb9eeb-2c3b-44a9-8995-d0a92ac00421.6ee5e7c8-d0c1-4352-bb94-7b510062da23 Jun 29 03:45:09 devstack sudo[115133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:45:09 devstack sudo[115131]: pam_unix(sudo:session): session closed for user root Jun 29 03:45:09 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2623fad0-2076-4da9-84fb-e392b1d120d7 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-618d2754-88da-46a6-83da-a311e1a0286f" returned: 0 in 0.768s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:45:09 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-2623fad0-2076-4da9-84fb-e392b1d120d7 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Lock "cinder-quobyte-618d2754-88da-46a6-83da-a311e1a0286f" released by "delete_volume" :: held 1.626s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:45:10 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-2623fad0-2076-4da9-84fb-e392b1d120d7 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Created reservations ['c71a3e82-933f-49cf-9be1-b7c990075c72', '0ee197bd-aa6d-48f1-ae4b-dce7b5424aa7', '44b5034f-f506-4098-9b14-60a507b226b0', '4e24b88f-2d7a-400d-95d4-ecce31ebdbd4'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:45:10 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-2623fad0-2076-4da9-84fb-e392b1d120d7 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:45:10 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-2623fad0-2076-4da9-84fb-e392b1d120d7 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:45:10 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-2623fad0-2076-4da9-84fb-e392b1d120d7 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:45:10 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-2623fad0-2076-4da9-84fb-e392b1d120d7 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:45:10 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-2623fad0-2076-4da9-84fb-e392b1d120d7 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:45:10 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2623fad0-2076-4da9-84fb-e392b1d120d7 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:45:10 devstack sudo[115133]: pam_unix(sudo:session): session closed for user root Jun 29 03:45:10 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a337179a-8cc2-4f17-9ace-a6b2fc1f0c53 tempest-CinderUnicodeTest-959952973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-59bb9eeb-2c3b-44a9-8995-d0a92ac00421 -F qcow2 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-59bb9eeb-2c3b-44a9-8995-d0a92ac00421.6ee5e7c8-d0c1-4352-bb94-7b510062da23" returned: 0 in 0.786s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:45:10 devstack cinder-volume[93468]: WARNING cinder.volume.drivers.remotefs [None req-a337179a-8cc2-4f17-9ace-a6b2fc1f0c53 tempest-CinderUnicodeTest-959952973 None] /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-59bb9eeb-2c3b-44a9-8995-d0a92ac00421.6ee5e7c8-d0c1-4352-bb94-7b510062da23 is being set with open permissions: ugo+rw Jun 29 03:45:10 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a337179a-8cc2-4f17-9ace-a6b2fc1f0c53 tempest-CinderUnicodeTest-959952973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-59bb9eeb-2c3b-44a9-8995-d0a92ac00421.6ee5e7c8-d0c1-4352-bb94-7b510062da23 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:45:10 devstack sudo[115141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf Jun 29 03:45:10 devstack sudo[115141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:45:10 devstack sudo[115142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-59bb9eeb-2c3b-44a9-8995-d0a92ac00421.6ee5e7c8-d0c1-4352-bb94-7b510062da23 Jun 29 03:45:10 devstack sudo[115142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:45:10 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-9b379a86-740d-443e-9510-e9bc21fef716 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Acquiring lock "cinder-69b16541-d50c-4105-9578-2150f9d0152b-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:45:10 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-9b379a86-740d-443e-9510-e9bc21fef716 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Lock "cinder-69b16541-d50c-4105-9578-2150f9d0152b-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:45:10 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-9b379a86-740d-443e-9510-e9bc21fef716 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Acquiring lock "cinder-quobyte-69b16541-d50c-4105-9578-2150f9d0152b" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:45:10 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-9b379a86-740d-443e-9510-e9bc21fef716 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Lock "cinder-quobyte-69b16541-d50c-4105-9578-2150f9d0152b" acquired by "delete_volume" :: waited 0.020s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:45:10 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e3bc07b-1473-4dde-95fb-582ab4d2acb0]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:45:10 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-9b379a86-740d-443e-9510-e9bc21fef716 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-69b16541-d50c-4105-9578-2150f9d0152b {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:45:10 devstack sudo[115146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-69b16541-d50c-4105-9578-2150f9d0152b Jun 29 03:45:10 devstack sudo[115146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:45:10 devstack sudo[115141]: pam_unix(sudo:session): session closed for user root Jun 29 03:45:10 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2623fad0-2076-4da9-84fb-e392b1d120d7 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf" returned: 0 in 0.770s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:45:10 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-2623fad0-2076-4da9-84fb-e392b1d120d7 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:45:10 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-2623fad0-2076-4da9-84fb-e392b1d120d7 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Deleted volume successfully. Jun 29 03:45:10 devstack sudo[115142]: pam_unix(sudo:session): session closed for user root Jun 29 03:45:10 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a337179a-8cc2-4f17-9ace-a6b2fc1f0c53 tempest-CinderUnicodeTest-959952973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-59bb9eeb-2c3b-44a9-8995-d0a92ac00421.6ee5e7c8-d0c1-4352-bb94-7b510062da23" returned: 0 in 0.776s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:45:10 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-2623fad0-2076-4da9-84fb-e392b1d120d7 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Lock "cinder-618d2754-88da-46a6-83da-a311e1a0286f-delete_volume" released by "delete_volume" :: held 2.651s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:45:10 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a337179a-8cc2-4f17-9ace-a6b2fc1f0c53 tempest-CinderUnicodeTest-959952973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-59bb9eeb-2c3b-44a9-8995-d0a92ac00421.info {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:45:10 devstack sudo[115150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-59bb9eeb-2c3b-44a9-8995-d0a92ac00421.info Jun 29 03:45:10 devstack sudo[115150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:45:11 devstack sudo[115146]: pam_unix(sudo:session): session closed for user root Jun 29 03:45:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-9b379a86-740d-443e-9510-e9bc21fef716 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-69b16541-d50c-4105-9578-2150f9d0152b" returned: 0 in 0.837s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:45:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-9b379a86-740d-443e-9510-e9bc21fef716 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-69b16541-d50c-4105-9578-2150f9d0152b {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:45:11 devstack sudo[115156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-69b16541-d50c-4105-9578-2150f9d0152b Jun 29 03:45:11 devstack sudo[115156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:45:11 devstack sudo[115150]: pam_unix(sudo:session): session closed for user root Jun 29 03:45:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a337179a-8cc2-4f17-9ace-a6b2fc1f0c53 tempest-CinderUnicodeTest-959952973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-59bb9eeb-2c3b-44a9-8995-d0a92ac00421.info" returned: 0 in 0.687s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:45:11 devstack cinder-volume[93468]: WARNING cinder.volume.drivers.remotefs [None req-a337179a-8cc2-4f17-9ace-a6b2fc1f0c53 tempest-CinderUnicodeTest-959952973 None] /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-59bb9eeb-2c3b-44a9-8995-d0a92ac00421.info is being set with open permissions: ugo+rw Jun 29 03:45:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a337179a-8cc2-4f17-9ace-a6b2fc1f0c53 tempest-CinderUnicodeTest-959952973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-59bb9eeb-2c3b-44a9-8995-d0a92ac00421.info {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:45:11 devstack sudo[115158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-59bb9eeb-2c3b-44a9-8995-d0a92ac00421.info Jun 29 03:45:11 devstack sudo[115158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:45:11 devstack cinder-volume[93468]: DEBUG oslo_service.periodic_task [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93468) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 29 03:45:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:45:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:45:11 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:45:11 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:45:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:45:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:45:11 devstack sudo[115160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf Jun 29 03:45:11 devstack sudo[115160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:45:12 devstack sudo[115156]: pam_unix(sudo:session): session closed for user root Jun 29 03:45:12 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-9b379a86-740d-443e-9510-e9bc21fef716 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-69b16541-d50c-4105-9578-2150f9d0152b" returned: 0 in 0.730s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:45:12 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-9b379a86-740d-443e-9510-e9bc21fef716 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Lock "cinder-quobyte-69b16541-d50c-4105-9578-2150f9d0152b" released by "delete_volume" :: held 1.618s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:45:12 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-9b379a86-740d-443e-9510-e9bc21fef716 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Created reservations ['91df997c-2a83-492d-a00d-6b3297c5b7f1', '72768120-1949-45d4-863f-f7bb0e9a49e1', 'b1694463-d42e-435f-9393-e058d0581c77', 'e0355ffd-82de-433a-8d37-0db8c273c144'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:45:12 devstack sudo[115158]: pam_unix(sudo:session): session closed for user root Jun 29 03:45:12 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a337179a-8cc2-4f17-9ace-a6b2fc1f0c53 tempest-CinderUnicodeTest-959952973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-59bb9eeb-2c3b-44a9-8995-d0a92ac00421.info" returned: 0 in 0.747s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:45:12 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-a337179a-8cc2-4f17-9ace-a6b2fc1f0c53 tempest-CinderUnicodeTest-959952973 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.873s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:45:12 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-9b379a86-740d-443e-9510-e9bc21fef716 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:45:12 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-9b379a86-740d-443e-9510-e9bc21fef716 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:45:12 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-9b379a86-740d-443e-9510-e9bc21fef716 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:45:12 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-9b379a86-740d-443e-9510-e9bc21fef716 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:45:12 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-9b379a86-740d-443e-9510-e9bc21fef716 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:45:12 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-9b379a86-740d-443e-9510-e9bc21fef716 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:45:12 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-a337179a-8cc2-4f17-9ace-a6b2fc1f0c53 tempest-CinderUnicodeTest-959952973 None] Create snapshot completed successfully Jun 29 03:45:12 devstack sudo[115165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf Jun 29 03:45:12 devstack sudo[115165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:45:12 devstack sudo[115160]: pam_unix(sudo:session): session closed for user root Jun 29 03:45:12 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf" returned: 0 in 0.887s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:45:12 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:45:12 devstack cinder-volume[93468]: DEBUG oslo_service.periodic_task [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] Running periodic task VolumeManager._thread_info {{(pid=93468) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 29 03:45:12 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] thread count: 28 {{(pid=93468) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 29 03:45:12 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-b416baac-64b9-46dd-8fe3-75e84537e7aa None None] thread info: [<_MainThread(MainThread, started 132331377287296)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93468) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 29 03:45:12 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-212030f1-e9dc-4749-a7ee-a31597e0f9d1 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Acquiring lock "cinder-b84c5655-69dd-49b7-a20e-ef2aedb2a564-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:45:12 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-212030f1-e9dc-4749-a7ee-a31597e0f9d1 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Lock "cinder-b84c5655-69dd-49b7-a20e-ef2aedb2a564-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:45:12 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-212030f1-e9dc-4749-a7ee-a31597e0f9d1 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Acquiring lock "cinder-quobyte-b84c5655-69dd-49b7-a20e-ef2aedb2a564" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:45:12 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-63e84003-d24d-4e4c-b432-72fac73d4d57 tempest-CinderUnicodeTest-959952973 None] Acquiring lock "cinder-6ee5e7c8-d0c1-4352-bb94-7b510062da23-delete_snapshot" by "delete_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:45:13 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-212030f1-e9dc-4749-a7ee-a31597e0f9d1 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Lock "cinder-quobyte-b84c5655-69dd-49b7-a20e-ef2aedb2a564" acquired by "delete_volume" :: waited 0.038s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:45:13 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-63e84003-d24d-4e4c-b432-72fac73d4d57 tempest-CinderUnicodeTest-959952973 None] Lock "cinder-6ee5e7c8-d0c1-4352-bb94-7b510062da23-delete_snapshot" acquired by "delete_snapshot" :: waited 0.052s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:45:13 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-63e84003-d24d-4e4c-b432-72fac73d4d57 tempest-CinderUnicodeTest-959952973 None] Acquiring lock "cinder-quobyte-59bb9eeb-2c3b-44a9-8995-d0a92ac00421" by "delete_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:45:13 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[3937e43b-27fe-4126-bb99-b06c39c7eda3]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:45:13 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-212030f1-e9dc-4749-a7ee-a31597e0f9d1 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-b84c5655-69dd-49b7-a20e-ef2aedb2a564 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:45:13 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-63e84003-d24d-4e4c-b432-72fac73d4d57 tempest-CinderUnicodeTest-959952973 None] Lock "cinder-quobyte-59bb9eeb-2c3b-44a9-8995-d0a92ac00421" acquired by "delete_snapshot" :: waited 0.040s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:45:13 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-63e84003-d24d-4e4c-b432-72fac73d4d57 tempest-CinderUnicodeTest-959952973 None] Acquiring lock "cinder-quobyte-6ee5e7c8-d0c1-4352-bb94-7b510062da23" by "_delete_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:45:13 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-63e84003-d24d-4e4c-b432-72fac73d4d57 tempest-CinderUnicodeTest-959952973 None] Lock "cinder-quobyte-6ee5e7c8-d0c1-4352-bb94-7b510062da23" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:45:13 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-63e84003-d24d-4e4c-b432-72fac73d4d57 tempest-CinderUnicodeTest-959952973 None] Deleting offline snapshot 6ee5e7c8-d0c1-4352-bb94-7b510062da23 of volume 59bb9eeb-2c3b-44a9-8995-d0a92ac00421 {{(pid=93468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 29 03:45:13 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-63e84003-d24d-4e4c-b432-72fac73d4d57 tempest-CinderUnicodeTest-959952973 None] snapshot_file for this snap is: volume-59bb9eeb-2c3b-44a9-8995-d0a92ac00421.6ee5e7c8-d0c1-4352-bb94-7b510062da23 {{(pid=93468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 29 03:45:13 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[f613ca53-04f0-48bc-ab4f-b44e13631eae]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:45:13 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-63e84003-d24d-4e4c-b432-72fac73d4d57 tempest-CinderUnicodeTest-959952973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-59bb9eeb-2c3b-44a9-8995-d0a92ac00421.6ee5e7c8-d0c1-4352-bb94-7b510062da23 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:45:13 devstack sudo[115168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-b84c5655-69dd-49b7-a20e-ef2aedb2a564 Jun 29 03:45:13 devstack sudo[115168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:45:13 devstack sudo[115169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-59bb9eeb-2c3b-44a9-8995-d0a92ac00421.6ee5e7c8-d0c1-4352-bb94-7b510062da23 Jun 29 03:45:13 devstack sudo[115169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:45:13 devstack sudo[115165]: pam_unix(sudo:session): session closed for user root Jun 29 03:45:13 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-9b379a86-740d-443e-9510-e9bc21fef716 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf" returned: 0 in 0.878s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:45:13 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-9b379a86-740d-443e-9510-e9bc21fef716 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:45:13 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-9b379a86-740d-443e-9510-e9bc21fef716 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Deleted volume successfully. Jun 29 03:45:13 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-9b379a86-740d-443e-9510-e9bc21fef716 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Lock "cinder-69b16541-d50c-4105-9578-2150f9d0152b-delete_volume" released by "delete_volume" :: held 2.798s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:45:14 devstack sudo[115168]: pam_unix(sudo:session): session closed for user root Jun 29 03:45:14 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-212030f1-e9dc-4749-a7ee-a31597e0f9d1 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-b84c5655-69dd-49b7-a20e-ef2aedb2a564" returned: 0 in 1.033s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:45:14 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-212030f1-e9dc-4749-a7ee-a31597e0f9d1 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-b84c5655-69dd-49b7-a20e-ef2aedb2a564 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:45:14 devstack sudo[115180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-b84c5655-69dd-49b7-a20e-ef2aedb2a564 Jun 29 03:45:14 devstack sudo[115180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:45:14 devstack sudo[115169]: pam_unix(sudo:session): session closed for user root Jun 29 03:45:14 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-63e84003-d24d-4e4c-b432-72fac73d4d57 tempest-CinderUnicodeTest-959952973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-59bb9eeb-2c3b-44a9-8995-d0a92ac00421.6ee5e7c8-d0c1-4352-bb94-7b510062da23" returned: 0 in 1.004s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:45:14 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-63e84003-d24d-4e4c-b432-72fac73d4d57 tempest-CinderUnicodeTest-959952973 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-59bb9eeb-2c3b-44a9-8995-d0a92ac00421(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93468) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 29 03:45:14 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[0285573b-ab81-4ce7-98fb-1535f4cb4cbc]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:45:14 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-63e84003-d24d-4e4c-b432-72fac73d4d57 tempest-CinderUnicodeTest-959952973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-59bb9eeb-2c3b-44a9-8995-d0a92ac00421 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:45:14 devstack sudo[115183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-59bb9eeb-2c3b-44a9-8995-d0a92ac00421 Jun 29 03:45:14 devstack sudo[115183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:45:14 devstack sudo[115180]: pam_unix(sudo:session): session closed for user root Jun 29 03:45:14 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-212030f1-e9dc-4749-a7ee-a31597e0f9d1 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-b84c5655-69dd-49b7-a20e-ef2aedb2a564" returned: 0 in 0.767s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:45:14 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-212030f1-e9dc-4749-a7ee-a31597e0f9d1 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Lock "cinder-quobyte-b84c5655-69dd-49b7-a20e-ef2aedb2a564" released by "delete_volume" :: held 1.856s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:45:14 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-212030f1-e9dc-4749-a7ee-a31597e0f9d1 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Created reservations ['a7a63256-d871-43d2-8d34-24d02321f89e', '784d050c-95ef-464e-a1a7-6cb98061f7c4', 'bfeb56f8-198d-41ae-9c0f-9367a4081bb0', '8464fb35-7424-407d-a29e-a3a7173dd0e4'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:45:14 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-212030f1-e9dc-4749-a7ee-a31597e0f9d1 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:45:15 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-212030f1-e9dc-4749-a7ee-a31597e0f9d1 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:45:15 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-212030f1-e9dc-4749-a7ee-a31597e0f9d1 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:45:15 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-212030f1-e9dc-4749-a7ee-a31597e0f9d1 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:45:15 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-212030f1-e9dc-4749-a7ee-a31597e0f9d1 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:45:15 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-212030f1-e9dc-4749-a7ee-a31597e0f9d1 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:45:15 devstack sudo[115189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf Jun 29 03:45:15 devstack sudo[115189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:45:15 devstack sudo[115183]: pam_unix(sudo:session): session closed for user root Jun 29 03:45:15 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-63e84003-d24d-4e4c-b432-72fac73d4d57 tempest-CinderUnicodeTest-959952973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-59bb9eeb-2c3b-44a9-8995-d0a92ac00421" returned: 0 in 0.868s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:45:15 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-63e84003-d24d-4e4c-b432-72fac73d4d57 tempest-CinderUnicodeTest-959952973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-59bb9eeb-2c3b-44a9-8995-d0a92ac00421.6ee5e7c8-d0c1-4352-bb94-7b510062da23 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:45:15 devstack sudo[115191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-59bb9eeb-2c3b-44a9-8995-d0a92ac00421.6ee5e7c8-d0c1-4352-bb94-7b510062da23 Jun 29 03:45:15 devstack sudo[115191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:45:15 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-ea94e0d7-5d68-40f6-bd21-a745a6015557 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Acquiring lock "cinder-a0068d0d-3e19-44fb-beae-6a0ea5cc24c6-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:45:15 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-ea94e0d7-5d68-40f6-bd21-a745a6015557 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Lock "cinder-a0068d0d-3e19-44fb-beae-6a0ea5cc24c6-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:45:15 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-ea94e0d7-5d68-40f6-bd21-a745a6015557 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Acquiring lock "cinder-quobyte-a0068d0d-3e19-44fb-beae-6a0ea5cc24c6" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:45:15 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-ea94e0d7-5d68-40f6-bd21-a745a6015557 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Lock "cinder-quobyte-a0068d0d-3e19-44fb-beae-6a0ea5cc24c6" acquired by "delete_volume" :: waited 0.028s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:45:15 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd5d6215-a10a-4604-96f7-3ddd403416e4]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:45:15 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ea94e0d7-5d68-40f6-bd21-a745a6015557 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-a0068d0d-3e19-44fb-beae-6a0ea5cc24c6 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:45:15 devstack sudo[115193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-a0068d0d-3e19-44fb-beae-6a0ea5cc24c6 Jun 29 03:45:15 devstack sudo[115193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:45:15 devstack sudo[115189]: pam_unix(sudo:session): session closed for user root Jun 29 03:45:15 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-212030f1-e9dc-4749-a7ee-a31597e0f9d1 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf" returned: 0 in 0.786s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:45:15 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-212030f1-e9dc-4749-a7ee-a31597e0f9d1 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:45:15 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-212030f1-e9dc-4749-a7ee-a31597e0f9d1 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Deleted volume successfully. Jun 29 03:45:15 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-212030f1-e9dc-4749-a7ee-a31597e0f9d1 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Lock "cinder-b84c5655-69dd-49b7-a20e-ef2aedb2a564-delete_volume" released by "delete_volume" :: held 2.935s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:45:16 devstack sudo[115191]: pam_unix(sudo:session): session closed for user root Jun 29 03:45:16 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-63e84003-d24d-4e4c-b432-72fac73d4d57 tempest-CinderUnicodeTest-959952973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-59bb9eeb-2c3b-44a9-8995-d0a92ac00421.6ee5e7c8-d0c1-4352-bb94-7b510062da23" returned: 0 in 0.985s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:45:16 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-63e84003-d24d-4e4c-b432-72fac73d4d57 tempest-CinderUnicodeTest-959952973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-59bb9eeb-2c3b-44a9-8995-d0a92ac00421.6ee5e7c8-d0c1-4352-bb94-7b510062da23 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:45:16 devstack sudo[115200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-59bb9eeb-2c3b-44a9-8995-d0a92ac00421.6ee5e7c8-d0c1-4352-bb94-7b510062da23 Jun 29 03:45:16 devstack sudo[115200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:45:16 devstack sudo[115193]: pam_unix(sudo:session): session closed for user root Jun 29 03:45:16 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ea94e0d7-5d68-40f6-bd21-a745a6015557 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-a0068d0d-3e19-44fb-beae-6a0ea5cc24c6" returned: 0 in 0.932s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:45:16 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ea94e0d7-5d68-40f6-bd21-a745a6015557 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-a0068d0d-3e19-44fb-beae-6a0ea5cc24c6 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:45:16 devstack sudo[115205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-a0068d0d-3e19-44fb-beae-6a0ea5cc24c6 Jun 29 03:45:16 devstack sudo[115205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:45:16 devstack sudo[115200]: pam_unix(sudo:session): session closed for user root Jun 29 03:45:16 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-63e84003-d24d-4e4c-b432-72fac73d4d57 tempest-CinderUnicodeTest-959952973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-59bb9eeb-2c3b-44a9-8995-d0a92ac00421.6ee5e7c8-d0c1-4352-bb94-7b510062da23" returned: 0 in 0.706s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:45:16 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-63e84003-d24d-4e4c-b432-72fac73d4d57 tempest-CinderUnicodeTest-959952973 None] Lock "cinder-quobyte-6ee5e7c8-d0c1-4352-bb94-7b510062da23" released by "_delete_snapshot" :: held 3.712s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:45:16 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-63e84003-d24d-4e4c-b432-72fac73d4d57 tempest-CinderUnicodeTest-959952973 None] Lock "cinder-quobyte-59bb9eeb-2c3b-44a9-8995-d0a92ac00421" released by "delete_snapshot" :: held 3.744s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:45:16 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-63e84003-d24d-4e4c-b432-72fac73d4d57 tempest-CinderUnicodeTest-959952973 None] Created reservations ['e5a84e72-970c-4c93-97a9-4140d9bc6cd1', '7207ee32-365f-44aa-937c-e56ac5a9ee25', 'b6fadaa5-c65f-4305-b12b-bfe5c3cf3fa2', 'f9588f04-0945-4e01-bf97-af2be34af904'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:45:17 devstack sudo[115205]: pam_unix(sudo:session): session closed for user root Jun 29 03:45:17 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ea94e0d7-5d68-40f6-bd21-a745a6015557 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-a0068d0d-3e19-44fb-beae-6a0ea5cc24c6" returned: 0 in 0.799s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:45:17 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-ea94e0d7-5d68-40f6-bd21-a745a6015557 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Lock "cinder-quobyte-a0068d0d-3e19-44fb-beae-6a0ea5cc24c6" released by "delete_volume" :: held 1.789s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:45:17 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-63e84003-d24d-4e4c-b432-72fac73d4d57 tempest-CinderUnicodeTest-959952973 None] Delete snapshot completed successfully. Jun 29 03:45:17 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-63e84003-d24d-4e4c-b432-72fac73d4d57 tempest-CinderUnicodeTest-959952973 None] Lock "cinder-6ee5e7c8-d0c1-4352-bb94-7b510062da23-delete_snapshot" released by "delete_snapshot" :: held 4.068s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:45:17 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-ea94e0d7-5d68-40f6-bd21-a745a6015557 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Created reservations ['dea68d72-f00c-44e7-b88f-8a92b1f5128b', 'de324af0-6ebb-4064-be3a-edad665c2d8b', '7ce19646-2e9c-44fc-a8ff-cf86b69edb15', '71c5c52f-6981-40f9-affb-9a09f83c83d2'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:45:17 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-ea94e0d7-5d68-40f6-bd21-a745a6015557 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:45:17 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-ea94e0d7-5d68-40f6-bd21-a745a6015557 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:45:17 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-ea94e0d7-5d68-40f6-bd21-a745a6015557 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:45:17 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-ea94e0d7-5d68-40f6-bd21-a745a6015557 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:45:17 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-ea94e0d7-5d68-40f6-bd21-a745a6015557 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:45:17 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ea94e0d7-5d68-40f6-bd21-a745a6015557 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:45:17 devstack sudo[115211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf Jun 29 03:45:17 devstack sudo[115211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:45:17 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-07a1a8ea-e776-45e1-b4ad-beacf890133b tempest-CinderUnicodeTest-959952973 None] Acquiring lock "cinder-59bb9eeb-2c3b-44a9-8995-d0a92ac00421-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:45:17 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-07a1a8ea-e776-45e1-b4ad-beacf890133b tempest-CinderUnicodeTest-959952973 None] Lock "cinder-59bb9eeb-2c3b-44a9-8995-d0a92ac00421-delete_volume" acquired by "delete_volume" :: waited 0.093s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:45:17 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-07a1a8ea-e776-45e1-b4ad-beacf890133b tempest-CinderUnicodeTest-959952973 None] Acquiring lock "cinder-quobyte-59bb9eeb-2c3b-44a9-8995-d0a92ac00421" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:45:17 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-07a1a8ea-e776-45e1-b4ad-beacf890133b tempest-CinderUnicodeTest-959952973 None] Lock "cinder-quobyte-59bb9eeb-2c3b-44a9-8995-d0a92ac00421" acquired by "delete_volume" :: waited 0.023s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:45:17 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-f49323ce-368b-4b3b-8a26-0a1e7f943761 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Acquiring lock "cinder-b3d773d4-9513-4eea-836a-6fc1b02a2fa2-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:45:17 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[c66da756-eb37-4708-b14b-b2f2d6917edb]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:45:17 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-07a1a8ea-e776-45e1-b4ad-beacf890133b tempest-CinderUnicodeTest-959952973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-59bb9eeb-2c3b-44a9-8995-d0a92ac00421 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:45:17 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-f49323ce-368b-4b3b-8a26-0a1e7f943761 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Lock "cinder-b3d773d4-9513-4eea-836a-6fc1b02a2fa2-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:45:17 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-f49323ce-368b-4b3b-8a26-0a1e7f943761 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Acquiring lock "cinder-quobyte-b3d773d4-9513-4eea-836a-6fc1b02a2fa2" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:45:17 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-f49323ce-368b-4b3b-8a26-0a1e7f943761 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Lock "cinder-quobyte-b3d773d4-9513-4eea-836a-6fc1b02a2fa2" acquired by "delete_volume" :: waited 0.018s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:45:17 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[10a45a46-79b6-4271-9192-e22326ff90e2]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:45:17 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-f49323ce-368b-4b3b-8a26-0a1e7f943761 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-b3d773d4-9513-4eea-836a-6fc1b02a2fa2 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:45:17 devstack sudo[115213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-59bb9eeb-2c3b-44a9-8995-d0a92ac00421 Jun 29 03:45:17 devstack sudo[115213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:45:17 devstack sudo[115214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-b3d773d4-9513-4eea-836a-6fc1b02a2fa2 Jun 29 03:45:17 devstack sudo[115214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:45:18 devstack sudo[115211]: pam_unix(sudo:session): session closed for user root Jun 29 03:45:18 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ea94e0d7-5d68-40f6-bd21-a745a6015557 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf" returned: 0 in 0.846s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:45:18 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-ea94e0d7-5d68-40f6-bd21-a745a6015557 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:45:18 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-ea94e0d7-5d68-40f6-bd21-a745a6015557 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Deleted volume successfully. Jun 29 03:45:18 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-ea94e0d7-5d68-40f6-bd21-a745a6015557 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Lock "cinder-a0068d0d-3e19-44fb-beae-6a0ea5cc24c6-delete_volume" released by "delete_volume" :: held 2.891s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:45:18 devstack sudo[115213]: pam_unix(sudo:session): session closed for user root Jun 29 03:45:18 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-07a1a8ea-e776-45e1-b4ad-beacf890133b tempest-CinderUnicodeTest-959952973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-59bb9eeb-2c3b-44a9-8995-d0a92ac00421" returned: 0 in 1.007s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:45:18 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-07a1a8ea-e776-45e1-b4ad-beacf890133b tempest-CinderUnicodeTest-959952973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-59bb9eeb-2c3b-44a9-8995-d0a92ac00421 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:45:18 devstack sudo[115225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-59bb9eeb-2c3b-44a9-8995-d0a92ac00421 Jun 29 03:45:18 devstack sudo[115225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:45:18 devstack sudo[115214]: pam_unix(sudo:session): session closed for user root Jun 29 03:45:18 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-f49323ce-368b-4b3b-8a26-0a1e7f943761 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-b3d773d4-9513-4eea-836a-6fc1b02a2fa2" returned: 0 in 0.944s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:45:18 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-f49323ce-368b-4b3b-8a26-0a1e7f943761 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-b3d773d4-9513-4eea-836a-6fc1b02a2fa2 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:45:18 devstack sudo[115227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-b3d773d4-9513-4eea-836a-6fc1b02a2fa2 Jun 29 03:45:18 devstack sudo[115227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:45:19 devstack sudo[115225]: pam_unix(sudo:session): session closed for user root Jun 29 03:45:19 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-07a1a8ea-e776-45e1-b4ad-beacf890133b tempest-CinderUnicodeTest-959952973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-59bb9eeb-2c3b-44a9-8995-d0a92ac00421" returned: 0 in 0.755s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:45:19 devstack sudo[115227]: pam_unix(sudo:session): session closed for user root Jun 29 03:45:19 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-f49323ce-368b-4b3b-8a26-0a1e7f943761 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-b3d773d4-9513-4eea-836a-6fc1b02a2fa2" returned: 0 in 0.712s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:45:19 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-07a1a8ea-e776-45e1-b4ad-beacf890133b tempest-CinderUnicodeTest-959952973 None] Lock "cinder-quobyte-59bb9eeb-2c3b-44a9-8995-d0a92ac00421" released by "delete_volume" :: held 1.851s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:45:19 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-f49323ce-368b-4b3b-8a26-0a1e7f943761 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Lock "cinder-quobyte-b3d773d4-9513-4eea-836a-6fc1b02a2fa2" released by "delete_volume" :: held 1.712s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:45:19 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-f49323ce-368b-4b3b-8a26-0a1e7f943761 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Created reservations ['1f329a61-24cf-4a2f-9cd1-5fca38f3332d', '7a70f07b-1c60-4deb-9af8-1a1de162f2b4', '3092269f-d3fb-4ed8-8197-f1edbc124a86', '37fcaeb9-28de-4492-8efb-3798a1893e1a'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:45:19 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-07a1a8ea-e776-45e1-b4ad-beacf890133b tempest-CinderUnicodeTest-959952973 None] Created reservations ['f8e4467f-594e-474a-9548-eb0a4d5c848f', 'c57407cd-8de5-47d1-91a9-65b3db146325', '242a333b-f6d7-4116-8fa4-5f527e6c2448', 'bc65d1c4-7011-4403-8fef-71c3814c192b'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:45:19 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-07a1a8ea-e776-45e1-b4ad-beacf890133b tempest-CinderUnicodeTest-959952973 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:45:19 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-07a1a8ea-e776-45e1-b4ad-beacf890133b tempest-CinderUnicodeTest-959952973 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:45:19 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-07a1a8ea-e776-45e1-b4ad-beacf890133b tempest-CinderUnicodeTest-959952973 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:45:19 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-07a1a8ea-e776-45e1-b4ad-beacf890133b tempest-CinderUnicodeTest-959952973 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:45:19 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-07a1a8ea-e776-45e1-b4ad-beacf890133b tempest-CinderUnicodeTest-959952973 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:45:19 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-07a1a8ea-e776-45e1-b4ad-beacf890133b tempest-CinderUnicodeTest-959952973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:45:19 devstack sudo[115231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf Jun 29 03:45:19 devstack sudo[115231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:45:19 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-f49323ce-368b-4b3b-8a26-0a1e7f943761 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:45:19 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-f49323ce-368b-4b3b-8a26-0a1e7f943761 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:45:19 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-f49323ce-368b-4b3b-8a26-0a1e7f943761 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:45:19 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-f49323ce-368b-4b3b-8a26-0a1e7f943761 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:45:19 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-f49323ce-368b-4b3b-8a26-0a1e7f943761 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:45:19 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-f49323ce-368b-4b3b-8a26-0a1e7f943761 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:45:19 devstack sudo[115233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf Jun 29 03:45:19 devstack sudo[115233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:45:19 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-ac7f98e1-c46a-47ed-8ac5-e73926f831b3 tempest-CinderUnicodeTest-959952973 None] Acquiring lock "cinder-98bd7c7a-a124-4930-b4f9-36bec30a31bd-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:45:19 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-ac7f98e1-c46a-47ed-8ac5-e73926f831b3 tempest-CinderUnicodeTest-959952973 None] Lock "cinder-98bd7c7a-a124-4930-b4f9-36bec30a31bd-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:45:19 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-ac7f98e1-c46a-47ed-8ac5-e73926f831b3 tempest-CinderUnicodeTest-959952973 None] Acquiring lock "cinder-quobyte-98bd7c7a-a124-4930-b4f9-36bec30a31bd" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:45:19 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-bc783614-3088-487e-8964-3e5a685b8954 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Acquiring lock "cinder-77ea720f-92eb-446d-bc6b-8574635ef223-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:45:19 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-ac7f98e1-c46a-47ed-8ac5-e73926f831b3 tempest-CinderUnicodeTest-959952973 None] Lock "cinder-quobyte-98bd7c7a-a124-4930-b4f9-36bec30a31bd" acquired by "delete_volume" :: waited 0.059s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:45:19 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-bc783614-3088-487e-8964-3e5a685b8954 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Lock "cinder-77ea720f-92eb-446d-bc6b-8574635ef223-delete_volume" acquired by "delete_volume" :: waited 0.073s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:45:19 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[693e0c73-c8fa-4e87-a9bf-f2954c7826f0]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:45:19 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ac7f98e1-c46a-47ed-8ac5-e73926f831b3 tempest-CinderUnicodeTest-959952973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-98bd7c7a-a124-4930-b4f9-36bec30a31bd {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:45:19 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-bc783614-3088-487e-8964-3e5a685b8954 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Acquiring lock "cinder-quobyte-77ea720f-92eb-446d-bc6b-8574635ef223" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:45:20 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-bc783614-3088-487e-8964-3e5a685b8954 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Lock "cinder-quobyte-77ea720f-92eb-446d-bc6b-8574635ef223" acquired by "delete_volume" :: waited 0.033s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:45:20 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d7c5e37-34b0-44a3-9c21-aac3a12cc0d4]: (4, 'qcow2') {{(pid=95116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:45:20 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-bc783614-3088-487e-8964-3e5a685b8954 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-77ea720f-92eb-446d-bc6b-8574635ef223 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:45:20 devstack sudo[115236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-98bd7c7a-a124-4930-b4f9-36bec30a31bd Jun 29 03:45:20 devstack sudo[115236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:45:20 devstack sudo[115237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-77ea720f-92eb-446d-bc6b-8574635ef223 Jun 29 03:45:20 devstack sudo[115237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:45:20 devstack sudo[115231]: pam_unix(sudo:session): session closed for user root Jun 29 03:45:20 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-07a1a8ea-e776-45e1-b4ad-beacf890133b tempest-CinderUnicodeTest-959952973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf" returned: 0 in 1.144s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:45:20 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-07a1a8ea-e776-45e1-b4ad-beacf890133b tempest-CinderUnicodeTest-959952973 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:45:20 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-07a1a8ea-e776-45e1-b4ad-beacf890133b tempest-CinderUnicodeTest-959952973 None] Deleted volume successfully. Jun 29 03:45:20 devstack sudo[115233]: pam_unix(sudo:session): session closed for user root Jun 29 03:45:20 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-f49323ce-368b-4b3b-8a26-0a1e7f943761 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf" returned: 0 in 1.081s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:45:20 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-f49323ce-368b-4b3b-8a26-0a1e7f943761 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:45:20 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-f49323ce-368b-4b3b-8a26-0a1e7f943761 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Deleted volume successfully. Jun 29 03:45:20 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-07a1a8ea-e776-45e1-b4ad-beacf890133b tempest-CinderUnicodeTest-959952973 None] Lock "cinder-59bb9eeb-2c3b-44a9-8995-d0a92ac00421-delete_volume" released by "delete_volume" :: held 3.339s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:45:20 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-f49323ce-368b-4b3b-8a26-0a1e7f943761 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Lock "cinder-b3d773d4-9513-4eea-836a-6fc1b02a2fa2-delete_volume" released by "delete_volume" :: held 3.197s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:45:21 devstack sudo[115237]: pam_unix(sudo:session): session closed for user root Jun 29 03:45:21 devstack sudo[115236]: pam_unix(sudo:session): session closed for user root Jun 29 03:45:21 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-bc783614-3088-487e-8964-3e5a685b8954 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-77ea720f-92eb-446d-bc6b-8574635ef223" returned: 0 in 0.948s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:45:21 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-bc783614-3088-487e-8964-3e5a685b8954 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-77ea720f-92eb-446d-bc6b-8574635ef223 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:45:21 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ac7f98e1-c46a-47ed-8ac5-e73926f831b3 tempest-CinderUnicodeTest-959952973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-98bd7c7a-a124-4930-b4f9-36bec30a31bd" returned: 0 in 1.112s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:45:21 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ac7f98e1-c46a-47ed-8ac5-e73926f831b3 tempest-CinderUnicodeTest-959952973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-98bd7c7a-a124-4930-b4f9-36bec30a31bd {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:45:21 devstack sudo[115248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-77ea720f-92eb-446d-bc6b-8574635ef223 Jun 29 03:45:21 devstack sudo[115248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:45:21 devstack sudo[115249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-98bd7c7a-a124-4930-b4f9-36bec30a31bd Jun 29 03:45:21 devstack sudo[115249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:45:21 devstack sudo[115248]: pam_unix(sudo:session): session closed for user root Jun 29 03:45:21 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-bc783614-3088-487e-8964-3e5a685b8954 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-77ea720f-92eb-446d-bc6b-8574635ef223" returned: 0 in 0.674s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:45:21 devstack sudo[115249]: pam_unix(sudo:session): session closed for user root Jun 29 03:45:21 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ac7f98e1-c46a-47ed-8ac5-e73926f831b3 tempest-CinderUnicodeTest-959952973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf/volume-98bd7c7a-a124-4930-b4f9-36bec30a31bd" returned: 0 in 0.672s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:45:21 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-bc783614-3088-487e-8964-3e5a685b8954 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Lock "cinder-quobyte-77ea720f-92eb-446d-bc6b-8574635ef223" released by "delete_volume" :: held 1.679s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:45:21 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-ac7f98e1-c46a-47ed-8ac5-e73926f831b3 tempest-CinderUnicodeTest-959952973 None] Lock "cinder-quobyte-98bd7c7a-a124-4930-b4f9-36bec30a31bd" released by "delete_volume" :: held 1.857s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:45:21 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-bc783614-3088-487e-8964-3e5a685b8954 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Created reservations ['43cf904c-bec2-467c-8dab-7beb3ce460e5', '7aa1c595-e6ad-4889-93b0-d131961ee805', 'edae490c-d886-4b29-aa9e-431833666e95', '1d9997a3-df9f-4d91-a55c-e4217e59990c'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:45:21 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-ac7f98e1-c46a-47ed-8ac5-e73926f831b3 tempest-CinderUnicodeTest-959952973 None] Created reservations ['41d8598f-e112-4c7b-aa98-971c02cf1112', '97d00b41-cd12-40f6-aaed-745edcaa9efc', '88392c2e-0a22-446e-adc1-836879e964b9', '5c39d63f-f375-4b0d-b26b-fb4fb282207e'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:45:21 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-bc783614-3088-487e-8964-3e5a685b8954 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:45:21 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-bc783614-3088-487e-8964-3e5a685b8954 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:45:21 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-bc783614-3088-487e-8964-3e5a685b8954 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:45:21 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-bc783614-3088-487e-8964-3e5a685b8954 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:45:21 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-bc783614-3088-487e-8964-3e5a685b8954 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:45:21 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-bc783614-3088-487e-8964-3e5a685b8954 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:45:21 devstack sudo[115254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf Jun 29 03:45:21 devstack sudo[115254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:45:21 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-ac7f98e1-c46a-47ed-8ac5-e73926f831b3 tempest-CinderUnicodeTest-959952973 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:45:21 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-ac7f98e1-c46a-47ed-8ac5-e73926f831b3 tempest-CinderUnicodeTest-959952973 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:45:21 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-ac7f98e1-c46a-47ed-8ac5-e73926f831b3 tempest-CinderUnicodeTest-959952973 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:45:21 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-ac7f98e1-c46a-47ed-8ac5-e73926f831b3 tempest-CinderUnicodeTest-959952973 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7bac03be-d893-414a-b5f9-3ea49b25e30f'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:45:21 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-ac7f98e1-c46a-47ed-8ac5-e73926f831b3 tempest-CinderUnicodeTest-959952973 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:45:21 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ac7f98e1-c46a-47ed-8ac5-e73926f831b3 tempest-CinderUnicodeTest-959952973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:45:21 devstack sudo[115256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf Jun 29 03:45:21 devstack sudo[115256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:45:22 devstack sudo[115254]: pam_unix(sudo:session): session closed for user root Jun 29 03:45:22 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-bc783614-3088-487e-8964-3e5a685b8954 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf" returned: 0 in 0.704s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:45:22 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-bc783614-3088-487e-8964-3e5a685b8954 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:45:22 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-bc783614-3088-487e-8964-3e5a685b8954 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Deleted volume successfully. Jun 29 03:45:22 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-bc783614-3088-487e-8964-3e5a685b8954 tempest-CreateVolumesFromSourceVolumeTest-1198822803 None] Lock "cinder-77ea720f-92eb-446d-bc6b-8574635ef223-delete_volume" released by "delete_volume" :: held 2.712s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:45:22 devstack sudo[115256]: pam_unix(sudo:session): session closed for user root Jun 29 03:45:22 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ac7f98e1-c46a-47ed-8ac5-e73926f831b3 tempest-CinderUnicodeTest-959952973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/838eddee6a4b0dadc241ac60755fb4cf" returned: 0 in 0.745s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:45:22 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-ac7f98e1-c46a-47ed-8ac5-e73926f831b3 tempest-CinderUnicodeTest-959952973 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:45:22 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-ac7f98e1-c46a-47ed-8ac5-e73926f831b3 tempest-CinderUnicodeTest-959952973 None] Deleted volume successfully. Jun 29 03:45:22 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-ac7f98e1-c46a-47ed-8ac5-e73926f831b3 tempest-CinderUnicodeTest-959952973 None] Lock "cinder-98bd7c7a-a124-4930-b4f9-36bec30a31bd-delete_volume" released by "delete_volume" :: held 2.957s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:45:32 devstack cinder-volume[93468]: DEBUG dbcounter [-] [93468] Writing DB stats cinder:UPDATE=141,cinder:INSERT=36,cinder:DELETE=10,cinder:SELECT=94 {{(pid=93468) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 29 03:45:32 devstack cinder-volume[93468]: DEBUG dbcounter [-] [93468] Writing DB stats cinder:DELETE=14,cinder:UPDATE=123,cinder:SELECT=88,cinder:INSERT=27 {{(pid=93468) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}